Summary of the paper
| Title | Linguistically Motivated Unsupervised Segmentation for Machine Translation |
|---|---|
| Authors | Mark Fishel and Harri Kirik |
| Abstract | In this paper we use statistical machine translation and morphology information from two different morphological analyzers to try to improve translation quality by linguistically motivated segmentation. The morphological analyzers we use are the unsupervised Morfessor morpheme segmentation and analyzer toolkit and the rule-based morphological analyzer T3. Our translations are done using the Moses statistical machine translation toolkit with training on the JRC-Acquis corpora and translating on Estonian to English and English to Estonian language directions. In our work we model such linguistic phenomena as word lemmas and endings and splitting compound words into simpler parts. Also lemma information was used to introduce new factors to the corpora and to use this information for better word alignment or for alternative path back-off translation. From the results we find that even though these methods have shown previously and keep showing promise of improved translation, their success still largely depends on the corpora and language pairs used. |
| Topics | Machine Translation, SpeechToSpeech Translation, Morphology, Knowledge Discovery/Representation |
Full paper |
Linguistically Motivated Unsupervised Segmentation for Machine Translation |
Slides |
- |
| Bibtex | @InProceedings{FISHEL10.604, author = {Mark Fishel and Harri Kirik}, title = {Linguistically Motivated Unsupervised Segmentation for Machine Translation}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |