| Title |
A Methodology for Evaluating Spoken Language Dialogue Systems and Their Components |
| Authors |
Bernsen Niels Ole (Natural Interactive Systems Laboratory, Science Park 10,5230 Odense M,Denmark, nob@nis.sdu.dk)
Dybkjær Laila (Natural Interactive Systems Laboratory, Science Park 10,5230 Odense M,Denmark, laila@nis.sdu.dk) |
| Keywords |
Best Practice, Completeness, Correctness, Evaluation, Spoken Dialogue Systems |
| Session |
Session SO2 - Dialogue Evaluation Methods |
| Full Paper |
135.ps, 135.pdf |
| Abstract |
As spoken language dialogue systems (SLDSs)proliferate in the market place,the issue of SLDS evaluation has come to attract wide interest from research and industry alike.Yet it is only recently that spoken dialogue engineering researchers have come to face SLDSs evaluation in its full complexity.This paper presents results of the European DISC project concerning technical evaluation and usability evaluation of SLDSs and their components.The paper presents a methodology for complete and correct evaluation of SLDSs and components together with a generic evaluation template for describing the evaluation criteria needed. |
