Summary of the paper
| Title | TTS Evaluation Campaign with a Common Spanish Database |
|---|---|
| Authors | Iñaki Sainz, Eva Navas, Inma Hernáez, Antonio Bonafonte and Francisco Campillo |
| Abstract | This paper describes the first TTS evaluation campaign designed for Spanish. Seven research institutions took part in the evaluation campaign and developed a voice from a common speech database provided by the organisation. Each participating team had a period of seven weeks to generate a voice. Next, a set of sentences were released and each team had to synthesise them within a week period. Finally, some of the synthesised test audio files were subjectively evaluated via an online test according to the following criteria: similarity to the original voice, naturalness and intelligibility. Box-plots, Wilcoxon tests and WER have been generated in order to analyse the results. Two main conclusions can be drawn: On the one hand, there is considerable margin for improvement to reach the quality level of the natural voice. On the other hand, two systems get significantly better results than the rest: one is based on statistical parametric synthesis and the other one is a concatenative system that makes use of a sinusoidal model to modify both prosody and smooth spectral joints. Therefore, it seems that some kind of spectral control is needed when building voices with a medium size database for unrestricted domains. |
| Topics | Speech Synthesis, Evaluation methodologies, Other |
Full paper |
TTS Evaluation Campaign with a Common Spanish Database |
Slides |
- |
| Bibtex | @InProceedings{SAINZ10.456, author = {Iñaki Sainz and Eva Navas and Inma Hernáez and Antonio Bonafonte and Francisco Campillo}, title = {TTS Evaluation Campaign with a Common Spanish Database}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |