SUMMARY : Session O5-E Machine Translation and Evaluation
Title | X-Score: Automatic Evaluation of Machine Translation Grammaticality |
---|---|
Authors | O. Hamon, M. Rajman |
Abstract | In this paper we report an experiment of an automated metric used to analyse the grammaticality of machine translation output. The approach (Rajman, Hartley, 2001) is based on the distribution of the linguistic information within a translated text, which is supposed similar between a learning corpus and the translation. This method is quite inexpensive, since it does not need any reference translation. First we describe the experimental method and the different tests we used. Then we show the promising results we obtained on the CESTA data, and how they correlate well with human judgments. |
Keywords | Machine Translation, Fluency, Adequacy, automatic MT evaluation |
Full paper | X-Score: Automatic Evaluation of Machine Translation Grammaticality |