Summary of the paper
| Title | Eye Tracking as a Tool for Machine Translation Error Analysis |
|---|---|
| Authors | Sara Stymne, Henrik Danielsson, Sofia Bremin, Hongzhan Hu, Johanna Karlsson, Anna Prytz Lillkull and Martin Wester |
| Abstract | We present a preliminary study where we use eye tracking as a complement to machine translation (MT) error analysis, the task of identifying and classifying MT errors. We performed a user study where subjects read short texts translated by three MT systems and one human translation, while we gathered eye tracking data. The subjects were also asked comprehension questions about the text, and were asked to estimate the text quality. We found that there are a longer gaze time and a higher number of fixations on MT errors, than on correct parts. There are also differences in the gaze time of different error types, with word order errors having the longest gaze time. We also found correlations between eye tracking data and human estimates of text quality. Overall our study shows that eye tracking can give complementary information to error analysis, such as aiding in ranking error types for seriousness. |
| Topics | Machine Translation, SpeechToSpeech Translation, Evaluation methodologies, Other |
Full paper  |
Eye Tracking as a Tool for Machine Translation Error Analysis |
| Bibtex | @InProceedings{STYMNE12.192, author = {Sara Stymne and Henrik Danielsson and Sofia Bremin and Hongzhan Hu and Johanna Karlsson and Anna Prytz Lillkull and Martin Wester}, title = {Eye Tracking as a Tool for Machine Translation Error Analysis}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |