This article is about the Synthesizer V Studio software known as a voice database. If you are looking for the Synthesizer V concept then click here.
History[]
On September 22, 2022, Dreamtonics revealed two new voice databases in progress: a masculine Japanese voice known as "Yuma" and a feminine English voice known as "Natalie". Each vocal had one demo featured in their debut video and a brief description of their voice databases. Both were confirmed to be compatible with the Cross-lingual Singing Synthesis, Vocal Mode, and AI retake functions.[1]
On September 26, Dreamtonics addressed the concerns regarding Yuma's name on bilibili. Fans expressed that the name shared similarity with Yamaha Corporation's VOCALOID product VY2, whose codename was also known as "YÅ«ma" (alternatively written as "Yuuma"). Dreamtonics explained that because Yuma was a male vocal with an androgynous voice, they wanted a name that was easy for users to distinguish his gender. They noted that they usually adopted the method of internal investigation to verify and avoid the duplication of official names of other products of the same type in the industry, but did not take account of product development codenames, resulting in the situation of Yuma sharing names with another product. The incident reflected an omission in the naming process, but it was not intentional. Dreamtonics noted that they would be investigating potential duplicate names in more detail in the future to avoid the situation from happening again and hoped that the video comment sections would maintain a friendly atmosphere for discussions. In order to preserve that atmosphere, some inappropriate comments were removed, and Dreamtonics apologized for the behavior.[2]
On October 7, Yuma and Natalie officially released as digital copies, with starter packs available from Dreamtonics and AH-Software Co. Ltd..[3]
Updates[]
Yuma AI v102b1 - November 10, 2022[4]
A free update for Yuma was released following the Synthesizer V Studio 1.8.0b1 update. This enables him to use the new Diffusion Probabilistic Models (DPM) feature.
Final version update compatible for Synthesizer V Studio 1.8.0 which enables Yuma to use the new Diffusion Probabilistic Models (DPM) feature if the beta version was not installed previously.
A free update for Yuma was released following the Synthesizer V Studio 1.8.1b1 update. This improved the neural vocoder for male vocals in general, which results in an enhanced sound quality in the bass range.
Final version update compatible for Synthesizer V Studio 1.8.1 which improves the neural vocoder for all male vocals, including Yuma, resulting in an enhanced sound quality in the bass range.
A free update for Yuma was released following the Synthesizer V Studio 1.9.0b1 update. This implemented the new rap feature available for the English and Mandarin languages. Cantonese Chinese was added to the Cross-lingual Singing Synthesis feature as well as general improvements to the overall function, resulting in more accurate pronunciation that sounds closer to a native speaker when singing foreign words.
A free update for Yuma was released following the Synthesizer V Studio 1.9.0b2 update. This version of the vocal allowed for compatibility with the engine's second beta, which focused on rectifying several design issues identified by the user base in the 1.9.0b1 post-release survey.
Final version update compatible for Synthesizer V Studio 1.9.0 which enables Yuma to use the rap feature (English and Mandarin Chinese only) and allows for Cantonese Chinese Cross-lingual Singing Synthesis if the beta versions were not installed previously.
A free update for Yuma was released following the Synthesizer V Studio 1.10.0b1 update. This enhanced pitch generation by utilizing Reinforcement Learning from Human Feedback (RLHF), translating to fewer off-key errors, making better use of vibrato, and creating more expressive transitions between notes. This also allowed for the use of the new "Enhancement" slider in the AI Retakes panel, which controlled the level of changes introduced by RLHF. For Synthesizer V Studio Pro users, feedback submission was enabled, allowing users to consensually share their preferred takes with only Dreamtonics for research and development purposes, where models trained with this feedback would be deployed in future voice database updates. Users may also opt out of this feature if undesired.
A free update for Yuma was released following the Synthesizer V Studio 1.10.0b2 update, which was the second beta version following version 1.10.0b1 that introduced enhancements to voice databases and integrated the latest user feedback via Reinforcement Learning from Human Feedback (RLHF). Regarding the editor, numerous reported issues were addressed for a more fluid experience. A new generation of pitch models were trained using the extensive feedback from users over the past month, and the new models offered greater accuracy in voice timbre reproduction, as well as a reduction in mispronunciations. Dreamtonics also focused on issues from the previous beta release that made Vocal Modes seem less distinct on certain vocals, ensuring clearer differentiation in the 1.10.0b2 update. The latest update also introduced a new feature in the Note Properties Panel that allowed for even division of a note into multiple syllables, proving to be a useful tool for songs with faster tempos.
Final version update compatible for Synthesizer V Studio 1.10.0 which enables Yuma to use Reinforcement Learning from Human Feedback (RLHF) as well as other enhancements (as listed in v105b1 and v105b2's notes) if the beta version was not installed previously.
Yuma AI v106 - October 26, 2023[26]
A free update for Yuma was released that added support for the Japanese language to the rap feature.
Yuma AI v107b1 - December 18, 2023[27]
A free update for Yuma was released following the Synthesizer V Studio 1.11.0b2 update. This implemented support for the Spanish language in the Cross-lingual Singing Synthesis feature.
Final version update compatible for Synthesizer V Studio 1.11.0 which enables Yuma to sing in Spanish through Cross-lingual Singing Synthesis if the beta version was not installed previously.
Voice Database Information[]
Demonstrations[]
| Demonstrations | |
|---|---|
|
| |
| 天ä½æćØęŖé (Tenshi to Akuma) - Short Acapella Version |  YouTube  bilibili
|
| 天ä½æćØęŖé (Tenshi to Akuma) - Full Version | YouTube bilibili
|
| Dreamtonics Recommended Songs Playlist[30] | |
|---|---|
|
| |
| å¤ē¬ć®ćć¬ć¹ (Kodoku no Palace) - English Cross-lingual Singing Synthesis | YouTube bilibili
|
| å£ę·ę ę (Kuchikase Jouka) | YouTube bilibili
|
| ćć¦ćÆć¼ (Lower) ft. Saki, Ryo, Kevin & Natalie |  NicoNico YouTube bilibili
|
| ē©ŗé³ćµć¤ć¬ć³ćµ (Sorane Silencer) | YouTube bilibili
|
Voice Databases[]
Product Information
Optimum
Range: G3 ~ F#4[31]
Versions
Lite Version/FLT Available?: No Starter Pack Available?: Yes Web Version Available?: No
Package details as noted:
Yuma is a masculine Japanese voice database with a young, fresh texture and an androgynous tone. As expected of an AI voice database, this enables him to sing with a more human-like and realistic voice.
Vocal traits as noted:
- Regarding Yuma's ranges, according to his debut demonstration video, he has a powerful yet clear voice in the mid to high ranges. In the lower mid-range, his unique breathiness reveals a different side of his voice with a more "shadowy" quality.
- Yuma was noted to be flexible as he can handle everything from bright and energetic radio tunes to hard, gothic pop styles. He was said to excel at convincing singing.
- With High Dynamics Voice Model (HDVM), which later migrated to Diffusion Probabilistic Models (DPM) per the 1.8.0b1 update on November 10,[32] Yuma can sing more realistically through changes in volume and breath, further enriching singing details, making each singing unique, and providing creators with more options. Through this mode, he can use AI Retakes to create multiple "takes" of a sung section to find an ideal vocal without the need for "laborious tuning". This feature is only available in the Synthesizer V Studio Pro Editor.
Phonetic notes as noted:
- Phoneme format: Romaji
- Through Cross-lingual Singing Synthesis, Yuma can sing in not only Japanese but also in English and Mandarin Chinese. Since the release of his v104b1 update on April 18, 2023, he can also sing in Cantonese Chinese with this feature; since his v107b1 update on December 18, he can also sing in Spanish with this feature. Cross-lingual Singing Synthesis is only available in the Synthesizer V Studio Pro Editor.
Vocal Modes as noted (Synthesizer V Studio Pro Editor only):
- Yuma comes with four variations:
- "Gentle"
- "Airy"
- "Powerful"
- "Solid"
System requirements as noted:
- OS: Microsoft Windows 10 / 8.1 (64 bit) and up; macOS X: 10.11 or higher; Linux Ubuntu 20.04 or higher
- CPU: Intel Core i3 or higher recommended
- Memory: 2GB or more.
- HDD: 1 GB or more (for installing one voice database)
- Display resolution: 1280 x 800 or higher resolution
- Others: Sound card, audio device, internet connection (necessary for activation and obtaining updates)
License agreements as noted:
- Dreamtonics Co., Ltd.'s End User License Agreement - Japanese
- Dreamtonics Co., Ltd.'s End User License Agreement - English
- Dreamtonics Co., Ltd.'s End User License Agreement - Simplified Chinese
Voice database sample
- Yuma AI SolfĆØge:
File:Yuma AI Solfege.ogg- Vocal Mode SolfĆØges:
- "Gentle":
File:Yuma AI Gentle.ogg - "Airy":
File:Yuma AI Airy.ogg - "Powerful":
File:Yuma AI Powerful.ogg - "Solid":
File:Yuma AI Solid.ogg
- "Gentle":
- Vocal Mode SolfĆØges:
References[]
- ā https://twitter.com/dreamtonics_en/status/1572858237640011776
- ā https://t.bilibili.com/710148915318489107
- ā https://www.ah-soft.com/press/ah-soft/20221007.html
- ā https://dreamtonics.com/en/synthesizer-v-studio-1-8-0b1-update/
- ā https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/
- ā https://twitter.com/ahsoft/status/1595674717200916481/
- ā https://dreamtonics.com/en/synthesizer-v-studio-1-8-1b1-update/
- ā https://twitter.com/dreamtonics_en/status/1622505781265563648
- ā https://dreamtonics.com/synthesizer-v-studio-1-8-1-final-update/
- ā https://twitter.com/dreamtonics_en/status/1626100512675500033
- ā https://dreamtonics.com/synthesizer-v-studio-1-9-0b1-update-rap-cantonese-and-more/
- ā https://twitter.com/dreamtonics_en/status/1648235081608343552
- ā https://dreamtonics.com/synthesizer-v-studio-1-9-0b2-update/
- ā https://twitter.com/dreamtonics_en/status/1660888307482656771
- ā https://dreamtonics.com/synthesizer-v-studio-1-9-0-final-update/
- ā https://twitter.com/dreamtonics_en/status/1671427830629154816
- ā https://twitter.com/dreamtonics_en/status/1686648078571655168
- ā https://t.bilibili.com/825177687051993121
- ā https://dreamtonics.com/synthesizer-v-studio-1-10-0b1-update-enhancing-pitch-generation-with-user-feedback/
- ā https://twitter.com/ahsoft/status/1686653272474738689
- ā https://twitter.com/dreamtonics_en/status/1707304150059639108
- ā https://dreamtonics.com/synthesizer-v-studio-1-10-0b2-update/
- ā https://twitter.com/ahsoft/status/1707304906535956719
- ā https://dreamtonics.com/synthesizer-v-studio-1-10-0-final-update/
- ā https://twitter.com/ahsoft/status/1714919114182181140/photo/1
- ā https://twitter.com/ahsoft/status/1717451110305366047
- ā https://dreamtonics.com/synthesizer-v-studio-1-11-0b2-update/
- ā https://dreamtonics.com/synthesizer-v-studio-1-11-0-update/
- ā https://twitter.com/ahsoft/status/1775800933538320621/photo/4
- ā https://space.bilibili.com/593592382/favlist?fid=1655788882 - These songs were featured in an official bilibili playlist featuring demos and recommended songs. Certain users were invited to create songs using earlier versions of the voice database and release the songs in sequence after the product's release as a complement to official demo tracks. It should also be noted that certain songs may not be involved with the early invitation and were added based on the company's preference. Only songs that feature Yuma as a main vocalist would be added to this demo table.
- ā https://img.alicdn.com/imgextra/i2/54187543/O1CN01GoYjwu25akRc1vuf1_!!54187543.png - Yuma initially did not have a range listed upon release. This was added to his Taobao product page as of March 15, 2024
- ā https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/