Title |
A Corpus for Studying Full Answer Justification |
Authors |
Arnaud Grappy, Brigitte Grau, Olivier Ferret, Cyril Grouin, Véronique Moriceau, Isabelle Robba, Xavier Tannier, Anne Vilnat and Vincent Barbier |
Abstract |
Question answering (QA) systems aim at retrieving precise information from a large collection of documents. To be considered as reliable by users, a QA system must provide elements to evaluate the answer. This notion of answer justification can also be useful when developping a QA system in order to give criteria for selecting correct answers. An answer justification can be found in a sentence, a passage made of several consecutive sentences or several passages of a document or several documents. Thus, we are interesting in pinpointing the set of information that allows to verify the correctness of the answer in a candidate passage and the question elements that are missing in this passage. Moreover, the relevant information is often given in texts in a different form from the question form: anaphora, paraphrases, synonyms. In order to have a better idea of the importance of all the phenomena we underlined, and to provide enough examples at the QA developer's disposal to study them, we decided to build an annotated corpus. |
Topics |
Corpus (creation, annotation, etc.), Question Answering, Textual Entailment and Paraphrasing |
Full paper |
A Corpus for Studying Full Answer Justification |
Slides |
- |
Bibtex |
@InProceedings{GRAPPY10.529,
author = {Arnaud Grappy and Brigitte Grau and Olivier Ferret and Cyril Grouin and Véronique Moriceau and Isabelle Robba and Xavier Tannier and Anne Vilnat and Vincent Barbier}, title = {A Corpus for Studying Full Answer Justification}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |