Title |
Evaluating the Effects of Interactivity in a Post-Editing Workbench |
Authors |
Nancy Underwood, Bartolomé Mesa-Lao, Mercedes García Martínez, Michael Carl, Vicent Alabau, Jesús González-Rubio, Luis A. Leiva, Germán Sanchis-Trilles, Daniel Ortíz-Martínez and Francisco Casacuberta |
Abstract |
This paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial prototype of the workbench, this second prototype of the workbench includes a number of interactive features designed to improve productivity and user satisfaction. Using CasMaCat's own facilities for logging keystrokes and eye tracking, data were collected from nine post-editors in a professional setting. These data were then used to investigate the effects of the interactive features on productivity, quality, user satisfaction and cognitive load as reflected in the post-editors gaze activity. These quantitative results are combined with the qualitative results derived from user questionnaires and interviews conducted with all the participants. |
Topics |
Machine Translation, SpeechToSpeech Translation, Usability, User Satisfaction |
Full paper |
Evaluating the Effects of Interactivity in a Post-Editing Workbench |
Bibtex |
@InProceedings{UNDERWOOD14.289,
author = {Nancy Underwood and Bartolomé Mesa-Lao and Mercedes García Martínez and Michael Carl and Vicent Alabau and Jesús González-Rubio and Luis A. Leiva and Germán Sanchis-Trilles and Daniel Ortíz-Martínez and Francisco Casacuberta}, title = {Evaluating the Effects of Interactivity in a Post-Editing Workbench}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |