Summary of the paper
| Title | Belgisch Staatsblad Corpus: Retrieving French-Dutch Sentences from Official Documents |
|---|---|
| Authors | Tom Vanallemeersch |
| Abstract | We describe the compilation of a large corpus of French-Dutch sentence pairs from official Belgian documents which are available in the online version of the publication Belgisch Staatsblad/Moniteur belge, and which have been published between 1997 and 2006. After downloading files in batch, we filtered out documents which have no translation in the other language, documents which contain several languages (by checking on discriminating words), and pairs of documents with a substantial difference in length. We segmented the documents into sentences and aligned the latter, which resulted in 5 million sentence pairs (only one-to-one links were included in the parallel corpus); there are 2.4 million unique pairs. Sample-based evaluation of the sentence alignment results indicates a near 100% accuracy, which can be explained by the text genre, the procedure filtering out weakly parallel articles and the restriction to one-to-one links. The corpus is larger than a number of well-known French-Dutch resources. It is made available to the community. Further investigation is needed in order to determine the original language in which documents were written. |
| Topics | Corpus (creation, annotation, etc.), Multilinguality, Language Identification |
Full paper |
Belgisch Staatsblad Corpus: Retrieving French-Dutch Sentences from Official Documents |
Slides |
- |
| Bibtex | @InProceedings{VANALLEMEERSCH10.758, author = {Tom Vanallemeersch}, title = {Belgisch Staatsblad Corpus: Retrieving French-Dutch Sentences from Official Documents}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |