Summary of the paper
| Title | Training and Evaluation of POS Taggers on the French MULTITAG Corpus |
|---|---|
| Authors | Alexandre Allauzen and Hélène Bonneau-Maynard |
| Abstract | The explicit introduction of morphosyntactic information into statistical machine translation approaches is receiving an important focus of attention. The current freely available Part of Speech (POS) taggers for the French language are based on a limited tagset which does not account for some flectional particularities. Moreover, there is a lack of a unified framework of training and evaluation for these kinds of linguistic resources. Therefore in this paper, three standard POS taggers (Treetagger, Brill’s tagger and the standard HMM POS tagger) are trained and evaluated in the same conditions on the French MULTITAG corpus. This POS-tagged corpus provides a tagset richer than the usual ones, including gender and number distinctions, for example. Experimental results show significant differences of performance between the taggers. According to the tagging accuracy estimated with a tagset of 300 items, taggers may be ranked as follows: Treetagger (95.7%), Brill’s tagger (94.6%), HMM tagger (93.4%). Examples of translation outputs illustrate how considering gender and number distinctions in the POS tagset can be relevant. |
| Language | Single language |
| Topics | Tagging, Validation of LRs, Machine Translation, SpeechToSpeech Translation |
Full paper |
Training and Evaluation of POS Taggers on the French MULTITAG Corpus |
Slides |
- |
| Bibtex | @InProceedings{ALLAUZEN08.856, author = {Alexandre Allauzen and Hélène Bonneau-Maynard}, title = {Training and Evaluation of POS Taggers on the French MULTITAG Corpus}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |