This paper presents a test designed to automatically evaluate the alignment quality of a bilingual aligned corpus without comparing it to a reference/gold corpus. We justify bypassing a reference corpus and present the advantages of the test, particularly for language pairs where few bilingual aligned corpora exist. The test, which is based on the observation of single-translation words, is demonstrated using three bilingual French-Japanese corpora : a manually, a semi-manually and an automatically aligned corpus. This paper shows that the results achieved validate the proposed evaluation technique.
@InProceedings{BLIN18.23, author = {Raoul Blin}, title = {Automatic Evaluation of Alignments without using a Gold-Corpus - Example with French-Japanese Aligned Corpora}, booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)}, year = {2018}, month = {may}, date = {7-12}, location = {Miyazaki, Japan}, editor = {Kiyoaki Shirai}, publisher = {European Language Resources Association (ELRA)}, address = {Paris, France}, isbn = {979-10-95546-24-5}, language = {english} }
Summary of the paper