| LREC 2000 2nd International Conference on Language Resources & Evaluation | ||||||
|
|
|
|
|
|
|
| Title | Issues in the Evaluation of Spoken Dialogue Systems - Experience from the ACCeSS Project |
| Authors | Brey Thomas (University of Regensburg, Universitätsstr. 31, D-93040 Regensburg, Germany, Thomas.Brey@sprachlit.uni-regensburg.de) Hanrieder Gerhard (Temic Speech Processing, Soeflinger Strasse 100, D-89077 Ulm, Germany, Gerhard.Hanrieder@temic.com) Heisterkamp Paul (DaimlerChrysler AG, Wilhelm-Runge Strasse, D-89081 Ulm, Germany, paul.heisterkamp@daimlerchrysler.com) Hitzenberger Ludwig (University of Regensburg, Universitätsstr. 31, D-93040 Regensburg, Germany, Ludwig.Hitzenberger@sprachlit.uni-regensburg.de) Regel-Brietzmann Peter (DaimlerChrysler AG, Wilhelm-Runge Strasse, D-89081 Ulm, Germany, peter.regel-brietzmann@daimlerchrysler.com) |
| Keywords | Call-Center Applications, Concept Accuracy, Evaluation, Metrics, Spoken Language Dialogue Systems, Success Rate |
| Session | Session SO5 - Evaluation of Dialogue |
| Full Paper | 162.ps, 162.pdf |
| Abstract | We describe the framework and present detailed results of an evaluation of 1.500 dialogues recorded during a three-months field-trial of the ACCeSS Dialogue System. The system was routing incoming calls to agents of a call-center and handled about 100 calls per day. |