Summary of the paper
| Title | Centering Theory for Evaluation of Coherence in Computer-Aided Summaries |
|---|---|
| Authors | Laura Hasler |
| Abstract | This paper investigates a new evaluation method for assessing the coherence of computer-aided summaries, justified by the inappropriacy of existing evaluation methods for this task. It develops a metric for Centering Theory (CT), a theory of local coherence and salience, to measure coherence in pairs of extracts and abstracts produced in a computer-aided summarisation environment. 100 news text summaries (50 pairs of extracts and their corresponding abstracts) are analysed using CT and the metric is applied to obtain a score for each summary; the summary with the higher score out of a pair is considered more coherent. Human judgement is also obtained to allow a comparison with the CT evaluation to assess the validity of the development of CT as a useful evaluation metric in computer-aided summarisation. |
| Language | Single language |
| Topics | Evaluation methodologies, Summarisation, Discourse |
Full paper |
Centering Theory for Evaluation of Coherence in Computer-Aided Summaries |
Slides |
- |
| Bibtex | @InProceedings{HASLER08.676, author = {Laura Hasler}, title = {Centering Theory for Evaluation of Coherence in Computer-Aided Summaries}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |