Mandarin Singing Voice Synthesis Based on Singing Expression Analysis and Unit Selection

• Main Authors: Ju-chiang Wang, 王如江
• Other Authors: Hung-yan Gu
• Format: Others
• Language: zh-TW
• Published: 2007
• Online Access: http://ndltd.ncl.edu.tw/handle/65cfu2

碩士 === 國立臺灣科技大學 === 資訊工程系 === 95 === In this thesis, we study to analyze the expression parameters of singing voice. Then, the methods of syllable unit selection and HNM(Harmonic plus Noise Model) based signal synthesis are integrated to build a Mandarin singing voice synthesis system. This system can mimic the vocal expression of a human by using the parameters analyzed from his recorded song. We have re-recorded Mandarin triple-syllable utterances, and developed an automatic sub-syllable segment boundary detection system. To analyze the expression parameters of singing voice, we have recorded songs sung by a different person. Then, those songs are analyzed to obtain each note’s parameters such as pitch contour, loudness, duration, and wave envelope. In the synthesis stage, the expression parameters obtained from a source note are used to determine the time positions of consonant, vowel, and ASR (Attack, Sustain, and Release) segments, and plan the pitch contour and wave envelope of a synthesized note. In fact, these expression parameters are taken into the HNM based mechanism to synthesize singing voice signals. In addition, we have done perception tests. The results show that the use of the expression parameters can indeed improve the quality of synthesized singing voice, and the synthesized singing voice can mimic a person’s singing expressions in a high similarity level.