Summary of the paper
| Title | Evaluating Utility of Data Sources in a Large Parallel Czech-English Corpus CzEng 0.9 |
|---|---|
| Authors | Ondřej Bojar, Adam Liška and Zdeněk Žabokrtský |
| Abstract | CzEng 0.9 is the third release of a large parallel corpus of Czech and English. For the current release, CzEng was extended by significant amount of texts from various types of sources, including parallel web pages, electronically available books and subtitles. This paper describes and evaluates filtering techniques employed in the process in order to avoid misaligned or otherwise damaged parallel sentences in the collection. We estimate the precision and recall of two sets of filters. The first set was used to process the data before their inclusion into CzEng. The filters from the second set were newly created to improve the filtering process for future releases of CzEng. Given the overall amount and variance of sources of the data, our experiments illustrate the utility of parallel data sources with respect to extractable parallel segments. As a similar behaviour can be expected for other language pairs, our results can be interpreted as guidelines indicating which sources should other researchers exploit first. |
| Topics | Corpus (creation, annotation, etc.), Evaluation methodologies, Machine Translation, SpeechToSpeech Translation |
Full paper |
Evaluating Utility of Data Sources in a Large Parallel Czech-English Corpus CzEng 0.9 |
Slides |
Evaluating Utility of Data Sources in a Large Parallel Czech-English Corpus CzEng 0.9 |
| Bibtex | @InProceedings{BOJAR10.642, author = {Ondřej Bojar and Adam Liška and Zdeněk Žabokrtský}, title = {Evaluating Utility of Data Sources in a Large Parallel Czech-English Corpus CzEng 0.9}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |