Summary of the paper
| Title | Constructing a Textual Semantic Relation Corpus Using a Discourse Treebank |
|---|---|
| Authors | Rui Wang and Caroline Sporleder |
| Abstract | In this paper, we present our work on constructing a textual semantic relation corpus by making use of an existing treebank annotated with discourse relations. We extract adjacent text span pairs and group them into six categories according to the different discourse relations between them. After that, we present the details of our annotation scheme, which includes six textual semantic relations, 'backward entailment', 'forward entailment', 'equality', 'contradiction', 'overlapping', and 'independent'. We also discuss some ambiguous examples to show the difficulty of such annotation task, which cannot be easily done by an automatic mapping between discourse relations and semantic relations. We have two annotators and each of them performs the task twice. The basic statistics on the constructed corpus looks promising: we achieve 81.17% of agreement on the six semantic relation annotation with a .718 kappa score, and it increases to 91.21% if we collapse the last two labels with a .775 kappa score. |
| Topics | Textual Entailment and Paraphrasing, Discourse annotation, representation and processing, Corpus (creation, annotation, etc.) |
Full paper |
Constructing a Textual Semantic Relation Corpus Using a Discourse Treebank |
Slides |
- |
| Bibtex | @InProceedings{WANG10.820, author = {Rui Wang and Caroline Sporleder}, title = {Constructing a Textual Semantic Relation Corpus Using a Discourse Treebank}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |