Summary of the paper
| Title | SINotas: the Evaluation of a NLG Application |
|---|---|
| Authors | Roberto P. A. Araujo, Rafael L. de Oliveira, Eder M. de Novais, Thiago D. Tadeu, Daniel B. Pereira and Ivandré Paraboni |
| Abstract | SINotas is a data-to-text NLG application intended to produce short textual reports on students’ academic performance from a database conveying their grades, weekly attendance rates and related academic information. Although developed primarily as a testbed for Portuguese Natural Language Generation, SINotas generates reports of interest to both students keen to learn how their professors would describe their efforts, and to the professors themselves, who may benefit from an at-a-glance view of the student’s performance. In a traditional machine learning approach, SINotas uses a data-text aligned corpus as training data for decision-tree induction. The current system comprises a series of classifiers that implement major Document Planning subtasks (namely, data interpretation, content selection, within- and between-sentence structuring), and a small surface realisation grammar of Brazilian Portuguese. In this paper we focus on the evaluation work of the system, applying a number of intrinsic and user-based evaluation metrics to a collection of text reports generated from real application data. |
| Topics | Natural Language Generation, Tools, systems, applications, Usability, user satisfaction |
Full paper |
SINotas: the Evaluation of a NLG Application |
Slides |
- |
| Bibtex | @InProceedings{ARAUJO10.593, author = {Roberto P. A. Araujo and Rafael L. de Oliveira and Eder M. de Novais and Thiago D. Tadeu and Daniel B. Pereira and Ivandré Paraboni}, title = {SINotas: the Evaluation of a NLG Application}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |