Title |
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation |
Authors |
Marcello Federico, Sebastian Stüker, Luisa Bentivogli, Michael Paul, Mauro Cettolo, Teresa Herrmann, Jan Niehues and Giovanni Moretti |
Abstract |
We report here on the eighth evaluation campaign organized in 2011 by the IWSLT workshop series. That IWSLT 2011 evaluation focused on the automatic translation of public talks and included tracks for speech recognition, speech translation, text translation, and system combination. Unlike in previous years, all data supplied for the evaluation has been publicly released on the workshop website, and is at the disposal of researchers interested in working on our benchmarks and in comparing their results with those published at the workshop. This paper provides an overview of the IWSLT 2011 evaluation campaign, and describes the data supplied, the evaluation infrastructure made available to participants, and the subjective evaluation carried out. |
Topics |
Machine Translation, SpeechToSpeech Translation, Evaluation methodologies, Speech resource/database |
Full paper |
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation |
Bibtex |
@InProceedings{FEDERICO12.1126,
author = {Marcello Federico and Sebastian Stüker and Luisa Bentivogli and Michael Paul and Mauro Cettolo and Teresa Herrmann and Jan Niehues and Giovanni Moretti}, title = {The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |