Title | Evaluation of Multi-party Virtual Reality Dialogue Interaction |
Author(s) |
David R. Traum, Susan Robinson, Jens Stephan
USC Institute for Creative Technologies, 13274 Fiji Way, Marina del Rey, CA 90292, USA, {traum, robinson, stephan}@ict.usc.edu |
Session | O41-EMS |
Abstract | We describe a dialogue evaluation plan for a multi-character virtual reality training simulation. A multi-component evaluation plan is presented, including user satisfaction, intended task completion, recognition rate, and a new annotation scheme for appropriateness. Preliminary results for formative tests are also presented. |
Keyword(s) | Evaluation, multi-modal, multi-agent, multi-speaker, response appropriateness |
Language(s) | English |
Full Paper | 768.pdf |