| Title |
End-to-End Evaluation of Machine Interpretation Systems: A Graphical Evaluation Tool |
| Authors |
Jekat Susanne J. (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: jekat@nats.informatik.uni-hamburg.de)
Tessiore Lorenzo (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: lorenzo@nats.informatik.uni-hamburg.de) |
| Keywords |
|
| Session |
Session SP4 - Tools for Evaluation and Processing of Spoken Language Resources |
| Full Paper |
67.ps, 67.pdf |
| Abstract |
VERBMOBIL as a long-term project of the Federal Ministry of Education, Science, Research and Technology aims at developing a mobile translation system for spontaneous speech. The source-language input consists of human speech (English, German or Japanese), the translation (bidirectional English-German and Japanese-German) and target-language output is effected by the VERBMOBIL system. As to the innovative character of the project new methods for end-to-end evaluation had to be developed by a subproject which has been established especially for this purpose. In this paper we present criteria for the evaluation of speech-to-speech translation systems and a tool for judging the translation quality which is called Graphical Evaluation Tool (GET)2 . |
