LREC 2006 - Proceedings sorted by papers

Title	Transferring PoS-tagging and lemmatization tools from spoken to written Dutch corpus development
Authors	A. Bosch, I. Schuurman, V. Vandeghinste
Abstract	We describe a case study in the reuse and transfer of tools in language resource development, from a corpus of spoken Dutch to a corpus of written Dutch. Once tools for a particular language have been developed, it is logical, but not trivial to reuse them for other types or registers of the language than the tools were originally designed for. This paper reviews the decisions and adaptations necessary to make this particular transfer from spoken to written language, focusing on a part-of-speech tagger and a lemmatizer. While the lemmatizer can be transferred fairly straightforwardly, the tagger needs to be adaptated considerably. We show how it can be adapted without starting from scratch. We describe how the part-of-speech tagset was adapted and how the tagger was retrained to deal with written-text phenomena it had not been trained on earlier.
Keywords	PoS tagging, lemmatization, corpus annotation tools, natural languageprocessing, machine learning
Full paper	Transferring PoS-tagging and lemmatization tools from spoken to written Dutch corpus development

Title

Transferring PoS-tagging and lemmatization tools from spoken to written Dutch corpus development

Authors

A. Bosch, I. Schuurman, V. Vandeghinste

Abstract

We describe a case study in the reuse and transfer of tools in language resource development, from a corpus of spoken Dutch to a corpus of written Dutch. Once tools for a particular language have been developed, it is logical, but not trivial to reuse them for other types or registers of the language than the tools were originally designed for. This paper reviews the decisions and adaptations necessary to make this particular transfer from spoken to written language, focusing on a part-of-speech tagger and a lemmatizer. While the lemmatizer can be transferred fairly straightforwardly, the tagger needs to be adaptated considerably. We show how it can be adapted without starting from scratch. We describe how the part-of-speech tagset was adapted and how the tagger was retrained to deal with written-text phenomena it had not been trained on earlier.

Keywords

PoS tagging, lemmatization, corpus annotation tools, natural languageprocessing, machine learning

Full paper

Transferring PoS-tagging and lemmatization tools from spoken to written Dutch corpus development