Title Evaluation of Multi-party Virtual Reality Dialogue Interaction
Author(s) David R. Traum, Susan Robinson, Jens Stephan

USC Institute for Creative Technologies, 13274 Fiji Way, Marina del Rey, CA 90292, USA, {traum, robinson, stephan}@ict.usc.edu

Session O41-EMS
Abstract We describe a dialogue evaluation plan for a multi-character virtual reality training simulation. A multi-component evaluation plan is presented, including user satisfaction, intended task completion, recognition rate, and a new annotation scheme for appropriateness. Preliminary results for formative tests are also presented.
Keyword(s) Evaluation, multi-modal, multi-agent, multi-speaker, response appropriateness
Language(s) English
Full Paper 768.pdf