SUMMARY : Session O5-E Machine Translation and Evaluation

 

Title X-Score: Automatic Evaluation of Machine Translation Grammaticality
Authors O. Hamon, M. Rajman
Abstract In this paper we report an experiment of an automated metric used to analyse the grammaticality of machine translation output. The approach (Rajman, Hartley, 2001) is based on the distribution of the linguistic information within a translated text, which is supposed similar between a learning corpus and the translation. This method is quite inexpensive, since it does not need any reference translation. First we describe the experimental method and the different tests we used. Then we show the promising results we obtained on the CESTA data, and how they correlate well with human judgments.
Keywords Machine Translation, Fluency, Adequacy, automatic MT evaluation
Full paper X-Score: Automatic Evaluation of Machine Translation Grammaticality