Summary of the paper
| Title | Evaluation of Machine Translation Errors in English and Iraqi Arabic |
|---|---|
| Authors | Sherri Condon, Dan Parvaz, John Aberdeen, Christy Doran, Andrew Freeman and Marwan Awad |
| Abstract | Errors in machine translations of English-Iraqi Arabic dialogues were analyzed at two different points in the systems? development using HTER methods to identify errors and human annotations to refine TER annotations. The analyses were performed on approximately 100 translations into each language from 4 translation systems collected at two annual evaluations. Although the frequencies of errors in the more mature systems were lower, the proportions of error types exhibited little change. Results include high frequencies of pronoun errors in translations to English, high frequencies of subject person inflection in translations to Iraqi Arabic, similar frequencies of word order errors in both translation directions, and very low frequencies of polarity errors. The problems with many errors can be generalized as the need to insert lexemes not present in the source or vice versa, which includes errors in multi-word expressions. Discourse context will be required to resolve some problems with deictic elements like pronouns. |
| Topics | Machine Translation, SpeechToSpeech Translation, Evaluation methodologies, Dialogue |
Full paper |
Evaluation of Machine Translation Errors in English and Iraqi Arabic |
Slides |
Evaluation of Machine Translation Errors in English and Iraqi Arabic |
| Bibtex | @InProceedings{CONDON10.106, author = {Sherri Condon and Dan Parvaz and John Aberdeen and Christy Doran and Andrew Freeman and Marwan Awad}, title = {Evaluation of Machine Translation Errors in English and Iraqi Arabic}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |