Summary of the paper
| Title | Evaluation of the KomParse Conversational Non-Player Characters in a Commercial Virtual World |
|---|---|
| Authors | Tina Kluewer, Feiyu Xu, Peter Adophs and Hans Uszkoreit |
| Abstract | The paper describes the evaluation of the KomParse system. KomParse is a dialogue system embedded in a 3-D massive multiplayer online game, allowing conversations between non player characters (NPCs) and game users. In a field test with game users, the system was evaluated with respect to acceptability and usability of the overall system as well as task completion, dialogue control and efficiency of three conversational tasks. Furthermore, subjective feedback has been collected for evaluating the single communication components of the system such as natural language understanding. The results are very satisfying and promising. In general, both the usability and acceptability tests show that the tested NPC is useful and well-accepted by the users. Even if the NPC does not always understand the users well and expresses things unexpected, he could still provide appropriate responses to help users to solve their problems or entertain them. |
| Topics | Dialogue, Evaluation methodologies, Tools, systems, applications |
Full paper  |
Evaluation of the KomParse Conversational Non-Player Characters in a Commercial Virtual World |
| Bibtex | @InProceedings{KLUEWER12.721, author = {Tina Kluewer and Feiyu Xu and Peter Adophs and Hans Uszkoreit}, title = {Evaluation of the KomParse Conversational Non-Player Characters in a Commercial Virtual World}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |