Summary of the paper

Title Influence of Text Type and Text Length on Anaphoric Annotation
Authors Daniela Goecke, Maik Stührenberg and Andreas Witt
Abstract We report the results of a study that investigates the agreement of anaphoric annotations. The study focuses on the influence of the factors text length and text type on a corpus of scientific articles and newspaper texts. In order to measure inter-annotator agreement we compare existing approaches and we propose to measure each step of the annotation process separately instead of measuring the resulting anaphoric relations only. A total amount of 3,642 anaphoric relations has been annotated for a corpus of 53,038 tokens (12,327 markables). The results of the study show that text type has more influence on inter-annotator agreement than text length. Furthermore, the definition of well-defined annotation instructions and coder training is a crucial point in order to receive good annotation results.
Language Single language
Topics Anaphora, Coreference, Corpus (creation, annotation, etc.), Validation of LRs
Full paper Influence of Text Type and Text Length on Anaphoric Annotation
Slides -
Bibtex @InProceedings{GOECKE08.368,
  author = {Daniela Goecke, Maik Stührenberg and Andreas Witt},
  title = {Influence of Text Type and Text Length on Anaphoric Annotation},
  booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)},
  year = {2008},
  month = {may},
  date = {28-30},
  address = {Marrakech, Morocco},
  editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {2-9517408-4-0},
  note = {http://www.lrec-conf.org/proceedings/lrec2008/},
  language = {english}
  }

Powered by ELDA © 2008 ELDA/ELRA