Title |
Mining Naturally-occurring Corrections and Paraphrases from Wikipedias Revision History |
Authors |
Aurélien Max and Guillaume Wisniewski |
Abstract |
Naturally-occurring instances of linguistic phenomena are important both for training and for evaluating automatic text processing. When available in large quantities, they also prove interesting material for linguistic studies. In this article, we present WiCoPaCo (Wikipedia Correction and Paraphrase Corpus), a new freely-available resource built by automatically mining Wikipedias revision history. The WiCoPaCo corpus focuses on local modifications made by human revisors and include various types of corrections (such as spelling error or typographical corrections) and rewritings, which can be categorized broadly into meaning-preserving and meaning-altering revisions. We present an initial hand-built typology of these revisions, but the resource allows for any possible annotation scheme. We discuss the main motivations for building such a resource and describe the main technical details guiding its construction. We also present applications and data analysis on French and report initial results on spelling error correction and morphosyntactic rewriting. The WiCoPaCo corpus can be freely downloaded from http://wicopaco.limsi.fr. |
Topics |
Corpus (creation, annotation, etc.), Textual Entailment and Paraphrasing, Authoring tools, proofing |
Full paper |
Mining Naturally-occurring Corrections and Paraphrases from Wikipedias Revision History |
Slides |
- |
Bibtex |
@InProceedings{MAX10.827,
author = {Aurélien Max and Guillaume Wisniewski}, title = {Mining Naturally-occurring Corrections and Paraphrases from Wikipedias Revision History}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |