ELMIRAIVE

🛠

This subject is work in progress. What is being worked on: Upcoming software Please bear with us while improvements are being made and assume good faith until the edits are complete. For information on how to help, see the guidelines. More subjects categorized here.

🛠

ELMIRAIVE
Company	Bandai Namco Research Inc.
Status	In development
Type	Speech Synthesis, Singing synthesis
Language	English, Japanese
Website	https://elmiraive.tech/

ELMIRAIVE is the research brand of technology created by Bandai Namco Research Inc. . It was announced on March 30, 2023 and spans a range of various technologies developed by Bandai Namco including:

• ELMIRAIVE VOX/Singer
• ELMIRAIVE AX
• ELMIRAIVE CX
• ELMIRAIVE 360
• ELMIRAIVE K-seg/Streamer

Demonstrations

ELMIRAIVE VOX

Demonstrations

demo 01	ELMIRAIVE
demo 02	ELMIRAIVE
demo 03	ELMIRAIVE

ELMIRAIVE Singer

Demonstrations

Carve in your heart ft. YUKITAN & Yukiko Miyagi	YouTube
daughters ft. YUKITAN & Yukiko Miyagi	YouTube
機械仕掛けの僕と僕 ft. YUKITAN & Yukiko Miyagi	YouTube
#Zutto Motto Shot ft. MIRAI & IVE	YouTube

History

On March 30, 2023, the official Mirai Komachi PR Twitter account announced the ELMIRAIVE project, a new technology research subgroup and brand of Bandai Namco Research Inc. The project was developed as a way for creators to interact with their favorite characters, connect with the world, and see future character entertainment experiences with AI and extended reality (XR) technology explored by the BANDAI NAMCO Research Institute. ELMIRAIVE proposes five areas of technology including speech and singing synthesis, AR, video production, and streaming services.

ELMIRAIVE VOX/Singer

VOX

ELMIRAIVE VOX is a speech synthesis technology that is able to reproduce natural and expressive speech, reproduce human voice quality and habits, and interact with characters. It not only contributes to the efficiency and diversification of content production, but also greatly improves the interactive user experience. Using unique design expertise to express character traits, Bandai Namco has developed AI voice synthesis models that represent characters, rather than robotic narrators.

Voice Conversion

Using AI technology, ELMIRAIVE offers voice conversion technology to transform a human voice into that of a different person, rather than simply controlling pitch and formants like conventional methods.

Speech Recognition

AI automates tasks that were previously done by hand, such as consistency checks between recorded audio and the script, or spot the places in the video where the script lines are used.

Singer

ELMIRAIVE Singer is a singing synthesis engine that produces natural-sounding vocals, users can add their own unique singing voice to their favorite songs, and have a character sing on their behalf. It makes music production and hobbies more enjoyable and bringing users closer to the music.

Learning Data

A singing synthesis model can be created by machine learning from about one to two hours of singing audio and music sheet data.

Multi-language Support

AI Model development is possible not only for Japanese singers but also for non-Japanese language singers.

ELMIRAIVE AX

ELMIRAIVE AX is a live performance system that utilizes the metadata such as tempo, measures, beats, tension, and emotions found in music, as well as the buildup of the song creating a system that automatically controls character movements, visual effects, and even the user's device through a network, seamlessly connecting live content with the user's viewing experience.

ELMIRAIVE CX

ELMIRAIVE CX known as the "Character Experience Engine" (CX) was developed to meet the demand for more flexible use of 3D character models created for games and anime in various media and content. By unifying character control method through the CX hub and combining a variety of technologies, such as high-end optical capture systems, XR camera tracking, simple motion capture using smartphones, and AR synthesis, users can flexibly create character live video and contents in various environments.

ELMIRAIVE 360

ELMIRAIVE 360 is a technology that allows users to experience various events while exploring panoramic photos or panoramic video spaces, similar to Street View. In the content offered on this system, users can enter into the world of panoramas and see a wider field of view from your perspective, which allows users to enjoy a high level of immersion and exploration.

ELMIRAIVE K-seg/Streamer

ELMIRAIVE K-seg/Streamer is a technology that links actions by viewers on streaming platforms, such as commenting and gifting, with various productions and interactions with characters in the metaverse or live venue, bringing the excitement of viewers to the live space and creating a sense of unity and excitement between the live venue and the streaming platform.

Upcoming voicebanks

VOX

MIRAI

Singer

IVE

YUKITAN

External links

Official

• ELMIRAIVE website
• Bandai Namco Research Inc. Official Website
• Official Mirai Komachi Website
• Mirai komachi PR Twitter (@miraikomachi_PR)

Articles

• VocaDB (ELMIRAIVE)