| LREC 2000 2nd International Conference on Language Resources & Evaluation | ||||||
|
|
|
|
|
|
|
| Title | Methods and Metrics for the Evaluation of Dictation Systems: a Case Study |
| Authors | Canelli Maria (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4) Grasso Daniele (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4) King Margaret (TIM/ISSCO, ETI, University of Geneva, 40 blvd du Pont d’Arve, CH-1211 Geneva 4., Margaret.King©issco.unige.ch) |
| Keywords | Dictation Systems, EAGLES, Evaluation, ISO |
| Session | Session SO6 - Recognition |
| Full Paper | 56.ps, 56.pdf |
| Abstract | This paper describes the practical evaluation of two commercial dictation systems in order to assess the potential usefulness of such technology in the specific context of a translation service translating legal text into Italian. The service suffers at times from heavy workload, lengthy documents and short deadlines. Use of dictation systems accepting continuous speech might improve productivity at these times. Design and execution of the evaluation followed the methodology worked out by the EAGLES Evaluation Working Group. The evaluation therefore also constitutes a test bed application of this methodology. |