End-to-End Speech Synthesis for Tibetan Multidialect
The research on Tibetan speech synthesis technology has been mainly focusing on single dialect, and thus there is a lack of research on Tibetan multidialect speech synthesis technology. This paper presents an end-to-end Tibetan multidialect speech synthesis model to realize a speech synthesis system...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | Complexity |
| Online Access: | http://dx.doi.org/10.1155/2021/6682871 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832568477974528000 |
|---|---|
| author | Xiaona Xu Li Yang Yue Zhao Hui Wang |
| author_facet | Xiaona Xu Li Yang Yue Zhao Hui Wang |
| author_sort | Xiaona Xu |
| collection | DOAJ |
| description | The research on Tibetan speech synthesis technology has been mainly focusing on single dialect, and thus there is a lack of research on Tibetan multidialect speech synthesis technology. This paper presents an end-to-end Tibetan multidialect speech synthesis model to realize a speech synthesis system which can be used to synthesize different Tibetan dialects. Firstly, Wylie transliteration scheme is used to convert the Tibetan text into the corresponding Latin letters, which effectively reduces the size of training corpus and the workload of front-end text processing. Secondly, a shared feature prediction network with a cyclic sequence-to-sequence structure is built, which maps the Latin transliteration vector of Tibetan character to Mel spectrograms and learns the relevant features of multidialect speech data. Thirdly, two dialect-specific WaveNet vocoders are combined with the feature prediction network, which synthesizes the Mel spectrum of Lhasa-Ü-Tsang and Amdo pastoral dialect into time-domain waveform, respectively. The model avoids using a large number of Tibetan dialect expertise for processing some time-consuming tasks, such as phonetic analysis and phonological annotation. Additionally, it can directly synthesize Lhasa-Ü-Tsang and Amdo pastoral speech on the existing text annotation. The experimental results show that the synthesized speech of Lhasa-Ü-Tsang and Amdo pastoral dialect based on our proposed method has better clarity and naturalness than the Tibetan monolingual model. |
| format | Article |
| id | doaj-art-1ba0499f6b6941e69fa83285b7ff2dbd |
| institution | Kabale University |
| issn | 1076-2787 1099-0526 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Complexity |
| spelling | doaj-art-1ba0499f6b6941e69fa83285b7ff2dbd2025-02-03T00:58:58ZengWileyComplexity1076-27871099-05262021-01-01202110.1155/2021/66828716682871End-to-End Speech Synthesis for Tibetan MultidialectXiaona Xu0Li Yang1Yue Zhao2Hui Wang3School of Information Engineering, Minzu University of China, Beijing 100081, ChinaSchool of Information Engineering, Minzu University of China, Beijing 100081, ChinaSchool of Information Engineering, Minzu University of China, Beijing 100081, ChinaSchool of Information Engineering, Minzu University of China, Beijing 100081, ChinaThe research on Tibetan speech synthesis technology has been mainly focusing on single dialect, and thus there is a lack of research on Tibetan multidialect speech synthesis technology. This paper presents an end-to-end Tibetan multidialect speech synthesis model to realize a speech synthesis system which can be used to synthesize different Tibetan dialects. Firstly, Wylie transliteration scheme is used to convert the Tibetan text into the corresponding Latin letters, which effectively reduces the size of training corpus and the workload of front-end text processing. Secondly, a shared feature prediction network with a cyclic sequence-to-sequence structure is built, which maps the Latin transliteration vector of Tibetan character to Mel spectrograms and learns the relevant features of multidialect speech data. Thirdly, two dialect-specific WaveNet vocoders are combined with the feature prediction network, which synthesizes the Mel spectrum of Lhasa-Ü-Tsang and Amdo pastoral dialect into time-domain waveform, respectively. The model avoids using a large number of Tibetan dialect expertise for processing some time-consuming tasks, such as phonetic analysis and phonological annotation. Additionally, it can directly synthesize Lhasa-Ü-Tsang and Amdo pastoral speech on the existing text annotation. The experimental results show that the synthesized speech of Lhasa-Ü-Tsang and Amdo pastoral dialect based on our proposed method has better clarity and naturalness than the Tibetan monolingual model.http://dx.doi.org/10.1155/2021/6682871 |
| spellingShingle | Xiaona Xu Li Yang Yue Zhao Hui Wang End-to-End Speech Synthesis for Tibetan Multidialect Complexity |
| title | End-to-End Speech Synthesis for Tibetan Multidialect |
| title_full | End-to-End Speech Synthesis for Tibetan Multidialect |
| title_fullStr | End-to-End Speech Synthesis for Tibetan Multidialect |
| title_full_unstemmed | End-to-End Speech Synthesis for Tibetan Multidialect |
| title_short | End-to-End Speech Synthesis for Tibetan Multidialect |
| title_sort | end to end speech synthesis for tibetan multidialect |
| url | http://dx.doi.org/10.1155/2021/6682871 |
| work_keys_str_mv | AT xiaonaxu endtoendspeechsynthesisfortibetanmultidialect AT liyang endtoendspeechsynthesisfortibetanmultidialect AT yuezhao endtoendspeechsynthesisfortibetanmultidialect AT huiwang endtoendspeechsynthesisfortibetanmultidialect |