Summary of the paper
| Title | Billions of Parallel Words for Free: Building and Using the EU Bookshop Corpus |
|---|---|
| Authors | Raivis Skadiņš, Jörg Tiedemann, Roberts Rozis and Daiga Deksne |
| Abstract | The European Union is a great source of high quality documents with translations into several languages. Parallel corpora from its publications are frequently used in various tasks, machine translation in particular. A source that has not systematically been explored yet is the EU Bookshop ― an online service and archive of publications from various European institutions. The service contains a large body of publications in the 24 official of the EU. This paper describes our efforts in collecting those publications and converting them to a format that is useful for natural language processing in particular statistical machine translation. We report our procedure of crawling the website and various pre-processing steps that were necessary to clean up the data after the conversion from the original PDF files. Furthermore, we demonstrate the use of this dataset in training SMT models for English, French, German, Spanish, and Latvian. |
| Topics | Machine Translation, SpeechToSpeech Translation, Validation of LRs |
Full paper  |
Billions of Parallel Words for Free: Building and Using the EU Bookshop Corpus |
| Bibtex | @InProceedings{SKADI14.846, author = {Raivis Skadiņš and Jörg Tiedemann and Roberts Rozis and Daiga Deksne}, title = {Billions of Parallel Words for Free: Building and Using the EU Bookshop Corpus}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |