Summary of the paper
| Title | Evaluation Metrics for Automatic Temporal Annotation of Texts |
|---|---|
| Authors | Xavier Tannier and Philippe Muller |
| Abstract | Recent years have seen increasing attention in temporal processing of texts as well as a lot of standardization effort of temporal information in natural language. A central part of this information lies in the temporal relations between events described in a text, when their precise times or dates are not known. Reliable human annotation of such information is difficult, and automatic comparisons must follow procedures beyond mere precision-recall of local pieces of information, since a coherent picture can only be considered at a global level. We address the problem of evaluation metrics of such information, aiming at fair comparisons between systems, by proposing some measures taking into account the globality of a text. |
| Language | Single language |
| Topics | Discourse, Evaluation methodologies, Semantics |
Full paper |
Evaluation Metrics for Automatic Temporal Annotation of Texts |
Slides |
Evaluation Metrics for Automatic Temporal Annotation of Texts |
| Bibtex | @InProceedings{TANNIER08.50, author = {Xavier Tannier and Philippe Muller}, title = {Evaluation Metrics for Automatic Temporal Annotation of Texts}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |