Title |
Using Movie Subtitles for Creating a Large-Scale Bilingual Corpora |
Authors |
Einav Itamar and Alon Itai |
Abstract |
This paper presents a method for compiling a large-scale bilingual corpus from a database of movie subtitles. To create the corpus, we propose an algorithm based on Gale and Churchs sentence alignment algorithm(1993). However, our algorithm not only relies on character length information, but also uses subtitle-timing information, which is encoded in the subtitle files. Timing is highly correlated between subtitles in different versions (for the same movie), since subtitles that match should be displayed at the same time. However, the absolute time values cant be used for alignment, since the timing is usually specified by frame numbers and not by real time, and converting it to real time values is not always possible, hence we use normalized subtitle duration instead. This results in a significant reduction in the alignment error rate. |
Language |
Multiple languages |
Topics |
Corpus (creation, annotation, etc.), Multilinguality, Machine Translation, SpeechToSpeech Translation |
Full paper |
Using Movie Subtitles for Creating a Large-Scale Bilingual Corpora |
Slides |
Using Movie Subtitles for Creating a Large-Scale Bilingual Corpora |
Bibtex |
@InProceedings{ITAMAR08.76,
author = {Einav Itamar and Alon Itai},
title = {Using Movie Subtitles for Creating a Large-Scale Bilingual Corpora},
booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)},
year = {2008},
month = {may},
date = {28-30},
address = {Marrakech, Morocco},
editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias},
publisher = {European Language Resources Association (ELRA)},
isbn = {2-9517408-4-0},
note = {http://www.lrec-conf.org/proceedings/lrec2008/},
language = {english}
} |