| Title |
On the Use of Prosody for On-line Evaluation of Spoken Dialogue Systems |
| Authors |
Swerts Marc (IPO, Center for User-System Interaction, TUE, Eindhoven University of Technology, P.O. Box 513, NL-5600 MB Eindhoven, m.g.j.swerts@tue.nl)
Krahmer Emiel (IPO, Center for User-System Interaction, TUE, Eindhoven University of Technology, P.O. Box 513, NL-5600 MB Eindhoven, e.j.krahmerg@tue.nl) |
| Keywords |
Error-Spotting, On-Line Evaluation, Perception, Prosody, Spoken Dialogue Systems |
| Session |
Session SP4 - Tools for Evaluation and Processing of Spoken Language Resources |
| Full Paper |
43.ps, 43.pdf |
| Abstract |
This paper focuses on the users’ signaling of information status in human-machine interactions, and in particular looks at the role prosody may play in this respect. Using a corpus of interactions with two Dutch spoken dialogue systems, prosodic correlates of users’ discon-firmations
were investigated. In this corpus, disconfirmations may serve as a signal to ‘go on’ in one context and as a signal to ‘go back’ in another. With the data obtained from this corpus an acoustic and a perception experiment have been carried out. The acoustic analysis shows that the difference in signaling function is reflected in the distribution of the various types of disconfirmations as well as in different prosodic variables (pause, duration, intonation contour and pitch range). The perception experiment revealed that subjects are very good at classifying disconfirmations as positive or negative signals (without context), which strongly suggests that the acoustic features have communicative relevance. The implications of these results for human-machine interactions are discussed. |
