Title |
Annotating Agreement and Disagreement in Threaded Discussion |
Authors |
Jacob Andreas, Sara Rosenthal and Kathleen McKeown |
Abstract |
We introduce a new corpus of sentence-level agreement and disagreement annotations over LiveJournal and Wikipedia threads. This is the first agreement corpus to offer full-document annotations for threaded discussions. We provide a methodology for coding responses as well as an implemented tool with an interface that facilitates annotation of a specific response while viewing the full context of the thread. Both the results of an annotator questionnaire and high inter-annotator agreement statistics indicate that the annotations collected are of high quality. |
Topics |
Corpus (creation, annotation, etc.), Discourse annotation, representation and processing, Tools, systems, applications |
Full paper |
Annotating Agreement and Disagreement in Threaded Discussion |
Bibtex |
@InProceedings{ANDREAS12.1095,
author = {Jacob Andreas and Sara Rosenthal and Kathleen McKeown}, title = {Annotating Agreement and Disagreement in Threaded Discussion}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |