Summary of the paper
| Title | TTS Evaluation Campaign with a Common Spanish Database |
|---|---|
| Authors | Iñaki Sainz, Eva Navas, Inma Hernáez, Antonio Bonafonte and Francisco Campillo |
| Abstract | This paper describes the first TTS evaluation campaign designed for Spanish.Seven research institutions took part in the evaluation campaign and developeda voice from a common speech database provided by the organisation. Eachparticipating team had a period of seven weeks to generate a voice. Next, a setof sentences were released and each team had to synthesise them within a weekperiod. Finally, some of the synthesised test audio files were subjectivelyevaluated via an online test according to the following criteria: similarity tothe original voice, naturalness and intelligibility. Box-plots, Wilcoxon testsand WER have been generated in order to analyse the results. Two mainconclusions can be drawn: On the one hand, there is considerable margin forimprovement to reach the quality level of the natural voice. On the other hand,two systems get significantly better results than the rest: one is based onstatistical parametric synthesis and the other one is a concatenative systemthat makes use of a sinusoidal model to modify both prosody and smooth spectraljoints.Therefore, it seems that some kind of spectral control is needed when buildingvoices with a medium size database for unrestricted domains. |
| Language | Other |
| Topics | Speech Synthesis, Evaluation methodologies, Other |
Full paper  |
TTS Evaluation Campaign with a Common Spanish Database |
| Bibtex | @InProceedings{SAINZ10.456, author = {Iñaki Sainz, Eva Navas, Inma Hernáez, Antonio Bonafonte and Francisco Campillo}, title = {TTS Evaluation Campaign with a Common Spanish Database}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |