Summary of the paper
| Title | Two Phase Evaluation for Selecting Machine Translation Services |
|---|---|
| Authors | Chunqi Shi, Donghui Lin, Masahiko Shimada and Toru Ishida |
| Abstract | An increased number of machine translation services are now available. Unfortunately, none of them can provide adequate translation quality for all input sources. This forces the user to select from among the services according to his needs. However, it is tedious and time consuming to perform this manual selection. Our solution, proposed here, is an automatic mechanism that can select the most appropriate machine translation service. Although evaluation methods are available, such as BLEU, NIST, WER, etc., their evaluation results are not unanimous regardless of the translation sources. We proposed a two-phase architecture for selecting translation services. The first phase uses a data-driven classification to allow the most appropriate evaluation method to be selected according to each translation source. The second phase selects the most appropriate machine translation result by the selected evaluation method. We describe the architecture, detail the algorithm, and construct a prototype. Tests show that the proposal yields better translation quality than employing just one machine translation service. |
| Topics | Web Services, Evaluation methodologies, Tools, systems, applications |
Full paper  |
Two Phase Evaluation for Selecting Machine Translation Services |
| Bibtex | @InProceedings{SHI12.802, author = {Chunqi Shi and Donghui Lin and Masahiko Shimada and Toru Ishida}, title = {Two Phase Evaluation for Selecting Machine Translation Services}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |