Summary of the paper
| Title | Influence of Text Type and Text Length on Anaphoric Annotation |
|---|---|
| Authors | Daniela Goecke, Maik Stührenberg and Andreas Witt |
| Abstract | We report the results of a study that investigates the agreement of anaphoric annotations. The study focuses on the influence of the factors text length and text type on a corpus of scientific articles and newspaper texts. In order to measure inter-annotator agreement we compare existing approaches and we propose to measure each step of the annotation process separately instead of measuring the resulting anaphoric relations only. A total amount of 3,642 anaphoric relations has been annotated for a corpus of 53,038 tokens (12,327 markables). The results of the study show that text type has more influence on inter-annotator agreement than text length. Furthermore, the definition of well-defined annotation instructions and coder training is a crucial point in order to receive good annotation results. |
| Language | Single language |
| Topics | Anaphora, Coreference, Corpus (creation, annotation, etc.), Validation of LRs |
Full paper |
Influence of Text Type and Text Length on Anaphoric Annotation |
Slides |
- |
| Bibtex | @InProceedings{GOECKE08.368, author = {Daniela Goecke, Maik Stührenberg and Andreas Witt}, title = {Influence of Text Type and Text Length on Anaphoric Annotation}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |