Summary of the paper
| Title | WEB-Based Listening Test System for Speech Synthesis and Speech Conversion Evaluation |
|---|---|
| Authors | Laurent Blin, Olivier Boeffard and Vincent Barreaud |
| Abstract | In this article, we propose a web based listening test system that can be used with a large range of listeners. Our main goals were to make the configuration of the tests as simple and flexible as possible, to simplify the recruiting of the testees and, of course, to keep track of the results using a relational database. This first version of our system can perform the most widely used listening tests in the speech processing community (AB-BA, ABX and MOS tests). It can also easily evolve and propose other tests implemented by the tester by means of a module interface. This scenario is explored in this article which proposes an implementation of a module for Comparison Mean Opinion Score (CMOS) tests and conduct of such an experiment. This test allowed us to extract from the BREF120 corpus a couple of voices of distinct supra-segmental characteristics. This system is offered to the speech synthesis and speech conversion community under free license. |
| Language | Language-independent |
| Topics | Evaluation methodologies, Tools, systems, applications, Validation of LRs |
Full paper |
WEB-Based Listening Test System for Speech Synthesis and Speech Conversion Evaluation |
Slides |
- |
| Bibtex | @InProceedings{BLIN08.573, author = {Laurent Blin, Olivier Boeffard and Vincent Barreaud}, title = {WEB-Based Listening Test System for Speech Synthesis and Speech Conversion Evaluation}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |