This article is about the Synthesizer V Studio software known as a voice database. If you are looking for the Synthesizer V character then click here.
History[]
Originally, Natsuki Karin and Hanakuma Chifuyu's voice synthesizer production announcement was meant to be announced during Koharu Rikka's first live concert, "Koharu Rikka 1st LIVE! First Day of School!", in Fall 2020. However, because the concert was postponed due to the COVID-19 pandemic, the pair's production was unannounced.[1]
2021[]
On May 20, 2021, a silhouette was shown on TOKYO6 ENTERTAINMENT's twitter account. Details were to be released on May 22.[2] This was later revealed to be Hanakuma Chifuyu, a character introduced through a campaign titled "Koharu Rikka x Otaru Collaboration (小春六花×小樽コラボ)". She was confirmed to be a student enrolled at the fictional Otaru Shiokaze High School and was in the same music club as Koharu Rikka.[3][4] Details about Chifuyu as a character were released and she was confirmed to be voiced by Kaya Okuno for a promotional video.[5][6] She was illustrated by Teshima Nari and the logo was created by Hiroaki Watanabe.[7] It was noted in a TOKYO6 ENTERTAINMENT livestream that there were plans to create a voice library for Chifuyu and Natsuki Karin, which were confirmed in June to be Synthesizer V AI and CeVIO AI after TOKYO6 ENTERTAINMENT adjusted their website.[8]
On August 8, due to some concerns regarding business activities related to Synthesizer V, Dreamtonics Co., Ltd. noted that Chifuyu was on the list of "yet-to-be-published" voices and initiatives.[9] For many overseas fans, this was the first time they became aware of these voice databases as there was no official announcement via social media nor newsletter of the productions and website adjustments. Due to language barriers, the livestream featuring the announcement was also overlooked.
On October 3, it was announced that Chifuyu would be the third character in the lineup, meaning that Karin was to be prioritized over her. A crowdfunding campaign for Chifuyu would be launched around June 2022 with details to release in the spring.[10]
On October 26, it was confirmed via livestream that recordings for a test Chifuyu bank had begun and would continue onto the next day. Samples were expected to be provided in the spring.[11]
2022[]
On January 4, 2022, TOKYO6 confirmed that crowdfunding for her Synthesizer V AI voice database and CeVIO AI Talk Song library would start this year and that their production was planned to be finished before the year's end.[12]
On February 16, Chifuyu's official Twitter feed reconfirmed the crowdfund to take place in June, with aims to get both of her CeVIO AI and SynthV AI libraries released in October.[13] During the AHS live broadcast the next day (where TOKYO6 acknowledged their cooperation in the development of VOICEPEAK, AH-Software's new text-to-speech software based on Dreamtonics' Syllaflow AI speech-synthesis engine), her October release month was confirmed at least for her CeVIO AI Talk voice.[14]
On March 28, it was announced that Chifuyu's CeVIO AI and Synthesizer V AI production crowdfund was scheduled to launch on June 26. Details were to come in mid-May.[15]
On April 22, Chifuyu's official Twitter announced that "she" would be performing at "Koharu Rikka 1st LIVE! First Day of School!".[16] At the concert, Kaya Okuno performed "ヒメタルネ" ("Himetaru.NE")[17], a song written by Itsuki Minato, Takapira's keyboardist, that was intended to be a future demo for Chifuyu.[18][19] On May 2, TOKYO6 tweeted that a live broadcast was scheduled for May 20 at 19:30 JST with appearances from Yoshino Aoyama, Miyu Takagi, Kaya Okuno, and Akasako. Discussions about Rikka's birthday festivities, "Koharu Rikka 1st LIVE! First Day of School!", Karin's release commemoration, and Chifuyu's crowdfund outline for June 26 were to be expected.[20] Chifuyu's CeVIO AI Talk Voice and Synthesizer V AI voice database were confirmed to be showcased at the live broadcast.[21]
On May 20, during TOKYO6's livestream, Chifuyu's crowdfunding was announced to begin on June 26 at 9 PM JST during another broadcast and would be hosted on ubgoe. It was scheduled to end on July 26 at 23:59 JST. The first goal, at 6 million yen, included the confirmation of Chifuyu's CeVIO AI Talk Voice and Synthesizer V AI voice database. The second goal, at 8 million yen, included 800 PitaGoe samples. The third goal, at 10 million yen, included a 3D model and an additional demo. Afterwards, for each time 3 million yen was raised, another demo and standing visuals would be added.[22] The crowdfund page was made available on June 20 and was still scheduled to begin on June 26, with an end date of July 26. It was noted that backers would be receiving Chifuyu around nine days prior to her release and it was asked that backers refrain from posting any works using Chifuyu until the day before her release at 20:00 JST.[23] The main crowdfund goal was reached within minutes of launch, and then the final stretch goal was reached after an hour.[24]
On a livestream hosted on June 26, TOKYO6 ENTERTAINMENT mentioned that five Vocal Mode variations were being implemented for Chifuyu and hoped to have them ready by the time she was released. These were confirmed to be called "Kawaii", "Soft", "Rock", "Adult", and "Piano_Ballade".[25][26][27]
On September 25, listings for Chifuyu's physical box were made available for pre-order on Amazon Japan with no prior announcement. According to the listing, she was planned to release on October 20.[28] The listing was later taken down, with TOKYO6 ENTERTAINMENT tweeting that they were making final adjustments with retailers to release Chifuyu's products in mid-October, marking the release date as undecided for the time being.[29] A follow-up tweet was posted to remind crowdfund supporters to adjust their addresses if necessary.[30] On September 30, AH-Software announced that Chifuyu's CeVIO AI and Synthesizer V AI voices would be released on October 20 as physical and digital copies. She was also eligible for the Synthesizer V Studio Pro Starter Pack.[31] According to her AH-Software page, her Lite version would be released in November and she did not support the AI Retakes function at the time.[32][33] Shipment for crowdfund backers was scheduled for October 7.[34]
Due to the additional funds gained from the campaign in June, on September 29, TOKYO6 ENTERTAINMENT announced that there would be four additional standing art (illustrated by MtU, Karei, Niijima Akiichi, and Yume no Owari) and a total of six demos for Chifuyu, which included the previously shown "Himetaru.NE". Half of the demo songs were to be launched on October 19, the day before her release, while the other half were scheduled for February 6, 2023.[35] Some of the demos were confirmed to be: a song produced by Kazawara, a song produced by Minato Itsuki, the full version of "Himetaru.NE", a trio song, and more.[36] Crowdfund rewards, including the voice database, would be shipped on October 7.[37] On October 19, Chifuyu's demos were uploaded and crowdfund backers were invited to post their works with the "#花隈千冬" tag.[38] AH-Software also announced that shipment for Chifuyu's physical CeVIO and Synthesizer V packages was scheduled for the day.[39] Chifuyu released on October 20 as expected. The Lite voice database was released later on November 2, though was momentarily suspended due to problems with functions before being reinstated for download.[40][41][42]
On November 14, after the release of Chifuyu's v102b1 installer, TOKYO6 ENTERTAINMENT released a survey for its feedback.[43] On November 22, the company noted that the beta version would be used as the official update after receiving mostly positive feedback.[44]
Updates[]
Voice Database Information[]
Demonstrations[]
Demonstrations | |
---|---|
| |
ヒメタルネ (Himetaru.NE) ft. Koharu Rikka - Short Version | NicoNico YouTube Twitter |
アレカコニア (Arekakonia) - Short Version | YouTube |
Dancing in the binary - Short Acapella Version; English Cross-lingual Singing Synthesis | YouTube |
远方有星辰 (Yuǎnfāng Yǒu Xīngchén) - Short Acapella Version; Mandarin Chinese Cross-lingual Singing Synthesis | YouTube |
あいにいく (Ai ni Iku) | NicoNico YouTube bilibili |
ツギハギビート (Tsugihagi Beat) | NicoNico YouTube bilibili |
ヒメタルネ (Himetaru.NE) ft. Koharu Rikka - Full Version | NicoNico YouTube bilibili |
季節の交差点 (Kisetsu no Kousaten) ft. Koharu Rikka & Natsuki Karin | NicoNico YouTube bilibili piapro |
SEA you!! ft. Koharu Rikka & Natsuki Karin | NicoNico YouTube bilibili |
モンスターズ (Monsters) | NicoNico YouTube bilibili |
Winter Parade | NicoNico YouTube bilibili |
先生あのね (Sensei Ano ne) | NicoNico YouTube |
Voice Databases[]
- It was noted that Chifuyu's voice type, that being a blasé-like voice with a high breath component, was difficult to reproduce through conventional voice synthesis software.[1]
- The breathiness gives the voice a sweet feel.[1]
- She has a strong lower register that doesn't break when she sings ballads.[1]
- The slight lingering and sadness in her voice when transitioning from low to high notes was considered appealing.[1]
- Initially, upon the publishing of her product page at the time, Chifuyu was not yet compatible with AI retakes, a feature via High Dynamics Voice Model (HDVM). This feature would have allowed Chifuyu to sing more realistically through changes in volume and breath, further enriching singing details, making each singing unique, and providing creators with more options. Through this mode, she could have used AI Retakes to create multiple "takes" of a sung section to find an ideal vocal without the need for "laborious tuning". HDVM was later migrated to Diffusion Probabilistic Models (DPM) per the 1.8.0b1 update on November 10,[68] which Chifuyu was made compatible with via her v102b1. This feature is only available in the Synthesizer V Studio Pro Editor.
- This does not apply to the Lite version.
- Phoneme format: Romaji
- Through Cross-lingual Singing Synthesis, Chifuyu can sing in not only Japanese but also in English and Mandarin Chinese. Since the release of her v103b1 update on June 21, 2023, she can also sing in Cantonese Chinese with this feature; since her v106 update on April 4, 2024, she can also sing in Spanish with this feature. Cross-lingual Singing Synthesis is only available in the Synthesizer V Studio Pro Editor.
- This does not apply to the Lite version, thus restricting the voice database to Japanese only.
- An issue with the initial release of the Lite voice database allowed it to work with the Cross-lingual Singing Synthesis function. This had since been replaced with a new version that prevented it from using the function.[41]
- This does not apply to the Lite version, thus restricting the voice database to Japanese only.
- Downloadable Pitagoe voice files are available for those with Chifuyu's CeVIO AI Talk Voice or Synthesizer V AI voice database after user registration on AH-Software's website. There are over 800 audio files to use for a wide variety of genres.[69]
- List of recorded audio
- The paid version of Hanakuma Chifuyu comes with five variations within the Vocal Mode function:
- "Kawaii"
- "Soft"
- "Rock"
- "Adult"
- "Piano_Ballade"
- An issue with the initial release of the Lite voice database allowed it to work with the Vocal Mode function. This had since been replaced with a new version that prevented it from using the function.[41]
Hardware Requirements:
- CPU:
- Intel Core i3 or higher recommended
- RAM: 2GB or higher
- Disk Space: 1 GB or higher (for installing one voice database)
- The amount of space required depends on the number of voice databases installed.
- Display: 1280 x 800 or higher
Software Requirements:
- Operating System:
- Windows 10/8.1
- Mac OS X: 10.11 or higher
- Linux Ubuntu 20.4 or higher
Other:
- DVD-ROM Drive (physical edition only)
- Sound card
- Internet connection is necessary for activation and obtaining updaters.
- TOKYO6 ENTERTAINMENT's Character Usage Guidelines - Japanese
- AH-Software's End User License Agreement - Japanese
- AH-Software's End User License Agreement - English
- Regarding the Lite version:
- AH-Software does not accept technical inquiries regarding free software nor do they guarantee or support the operation of all free software.
- AH-Software is not liable for any damages (including loss of data) caused by using free software. Users are cautioned to use the free software at their own risk.
- The program may not be transferred, sold, lent, distributed or rented without AH-Software's permission, regardless of whether it is paid or free of charge.
- Reverse engineering, including modification, decompilation, and disassembly, of their program for any purpose is prohibited.
- Hanakuma Chifuyu Lite may not be used commercially in any way
- When using the Lite version of this voice database, "This work uses the Lite version" must be mentioned on any uploads.
- Hanakuma Chifuyu AI Solfège:
- Vocal Mode Solfèges:
- "Kawaii":
- "Soft":
- "Rock":
- "Adult":
- "Piano_Ballade":
- "Kawaii":
- Vocal Mode Solfèges:
- Hanakuma Chifuyu AI Lite Solfège:
References[]
- ↑ 1.0 1.1 1.2 1.3 1.4 https://www.dtmstation.com/archives/60921.html
- ↑ https://twitter.com/tokyo6info/status/1395588323251425283
- ↑ https://twitter.com/tokyo6info/status/1396090971088211973
- ↑ https://twitter.com/tokyo6info/status/1396092229597470723
- ↑ https://twitter.com/tokyo6info/status/1396092229253484545
- ↑ https://note.com/tokyo6/n/nc5e32c933fa1
- ↑ https://twitter.com/tokyo6info/status/1396092480836100103
- ↑ https://www.youtube.com/watch?v=M9wDSETvuzY
- ↑ https://twitter.com/dreamtonics_en/status/1424533859752812545
- ↑ https://twitter.com/tokyo6info/status/1444648429918081026
- ↑ https://www.youtube.com/watch?v=xLcrmYPSpM0
- ↑ https://twitter.com/tokyo6info/status/1478171466361610241
- ↑ https://twitter.com/Chifuyu_Info/status/1493892011271008258
- ↑ https://twitter.com/tokyo6info/status/1494296032750219267
- ↑ https://twitter.com/tokyo6info/status/1508274508536643586
- ↑ https://twitter.com/Chifuyu_Info/status/1517760182486548480
- ↑ https://twitter.com/kaayaataaaan/status/1518219391048896512
- ↑ https://twitter.com/s_akasakov/status/1518268067771744256
- ↑ https://note.com/tokyo6/n/nf413e2ef33cd
- ↑ https://twitter.com/tokyo6info/status/1521058584918114305
- ↑ https://twitter.com/Chifuyu_Info/status/1526738345531183104
- ↑ https://www.youtube.com/watch?v=vvpaI_qIbS4
- ↑ https://twitter.com/tokyo6info/status/1538718530371301377
- ↑ https://twitter.com/tokyo6info/status/1541070939374624768
- ↑ https://www.youtube.com/watch?v=1EM0irCWP_Y
- ↑ https://cdn.discordapp.com/attachments/695380056155095054/990795122641891359/Screenshot_2022-06-26-18-09-48-902_com.google.android.youtube.jpg - Screenshot as of June 26, 2022
- ↑ https://twitter.com/endryu36012867/status/1578579368502493187
- ↑ https://amzn.asia/d/hySylHc
- ↑ https://twitter.com/tokyo6info/status/1574320537035161600
- ↑ https://twitter.com/tokyo6info/status/1574320538494783488
- ↑ https://www.ah-soft.com/press/cevio/20220929.html
- ↑ https://www.ah-soft.com/synth-v/chifuyu/index.html
- ↑ https://cdn.discordapp.com/attachments/695380056943493280/1024906113549877339/unknown.png - Screenshot as of September 30, 2022
- ↑ https://twitter.com/Chifuyu_Info/status/1575326844064129024
- ↑ https://twitter.com/tokyo6info/status/1575391532953190400
- ↑ https://twitter.com/tokyo6info/status/1575391532953190400
- ↑ https://twitter.com/tokyo6info/status/1578194465621434368
- ↑ https://twitter.com/Chifuyu_Info/status/1582237074543247360
- ↑ https://twitter.com/ahsoft/status/1582630849509347329
- ↑ https://twitter.com/ahsoft/status/1587716481793503232
- ↑ 41.0 41.1 41.2 https://twitter.com/ahsoft/status/1587755085915824129
- ↑ https://twitter.com/ahsoft/status/1587770232243773446
- ↑ https://twitter.com/tokyo6info/status/1591981747180163072
- ↑ https://twitter.com/tokyo6info/status/1594852826085494784
- ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0b1-update/
- ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/
- ↑ https://twitter.com/ahsoft/status/1595674717200916481/
- ↑ https://dreamtonics.com/synthesizer-v-studio-1-9-0-final-update/
- ↑ https://twitter.com/dreamtonics_en/status/1671427830629154816
- ↑ https://www.bilibili.com/read/cv24826703/
- ↑ https://twitter.com/ahsoft/status/1676865674898206720
- ↑ https://twitter.com/dreamtonics_en/status/1686648078571655168
- ↑ https://t.bilibili.com/825177687051993121
- ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b1-update-enhancing-pitch-generation-with-user-feedback/
- ↑ https://twitter.com/ahsoft/status/1686653272474738689
- ↑ https://twitter.com/dreamtonics_en/status/1707304150059639108
- ↑ https://dreamtonics.com/synthesizer-v-studio-1-10-0b2-update/
- ↑ https://twitter.com/ahsoft/status/1707304906535956719
- ↑ https://dreamtonics.com/synthesizer-v-studio-1-11-0b1-update/
- ↑ https://twitter.com/ahsoft/status/1727970395691856025
- ↑ https://twitter.com/tokyo6info/status/1727987685288206599
- ↑ https://note.com/tokyo6/n/n742c974716b9 - The main reasoning behind TOKYO6's request to disable RLHF by default (which prevented the release of finalized versions of Koharu Rikka AI v124, Natsuki Karin v110, and Hanakuma Chifuyu v106 and also resulted in the permanent withdrawal of their last respective beta versions) was that the then-current implementation of RLHF learned AI-retake data selected as favorable by various different users of Rikka AI, Karin, and Chifuyu and then reflected it across all installations of their voice databases, thus affecting their overall preference trend; TOKYO6 believed that, due to things like variations in preferred vibrato swing size from user to user, etc., some users would get undesirable results out of their vocals, and in internal beta test results, TOKYO6 noted that the vocals' vibrato tended to be exaggerated and deviating from their character image. TOKYO6 was also concerned about RLHF results automatically affecting the default singing style (with no Vocal Modes applied) to a large extent, resulting in the decision to postpone any further updates to their voice databases until they were given the possibility to disable RLHF by default in the next update.
- ↑ https://twitter.com/tokyo6info/status/1717458061949026415
- ↑ https://dreamtonics.com/synthesizer-v-studio-1-11-0-update/
- ↑ https://twitter.com/ahsoft/status/1775800933538320621/photo/4
- ↑ https://twitter.com/tokyo6info/status/1775804166952403019
- ↑ https://ubgoe.com/projects/200
- ↑ https://dreamtonics.com/en/synthesizer-v-studio-1-8-0-final-update/
- ↑ https://twitter.com/tokyo6info/status/1578194540783337472