Summary of the paper
| Title | Towards Heterogeneous Automatic MT Error Analysis |
|---|---|
| Authors | Jesús Giménez and Lluis Màrquez |
| Abstract | This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality. |
| Language | Single language |
| Topics | Evaluation methodologies, Machine Translation, SpeechToSpeech Translation, Tools, systems, applications |
Full paper |
Towards Heterogeneous Automatic MT Error Analysis |
Slides |
Towards Heterogeneous Automatic MT Error Analysis |
| Bibtex | @InProceedings{GIMEACUTENEZ08.483, author = {Jesús Giménez and Lluis Màrquez}, title = {Towards Heterogeneous Automatic MT Error Analysis}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |