Summary of the paper
| Title | An Economic View on Human Language Technology Evaluation |
|---|---|
| Authors | Edouard Geoffrois |
| Abstract | This paper analyses some general issues about human language technology evaluation, focusing on economic aspects. It first provides a scientific rationale for the need to organize evaluation in the form of campaigns, by relating this need to some basic characteristics of human language technologies, namely that they involve learning to process information in a way which reproduces human capabilities. It then reviews the benefits and constraints of these evaluation campaigns. Borrowing concepts from the field of economics, it also provides an analysis of the economic incentives to organize evaluation campaigns. It entails from this analysis that fitting evaluation campaigns to the needs of scientific research requires a strong implication in term of research policy and public funding. |
| Language | Language-independent |
| Topics | Evaluation methodologies, LR national/international projects, organizational/policy issues |
Full paper |
An Economic View on Human Language Technology Evaluation |
Slides |
- |
| Bibtex | @InProceedings{GEOFFROIS08.616, author = {Edouard Geoffrois}, title = {An Economic View on Human Language Technology Evaluation}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |