Summary of the paper
| Title | Evaluating Appropriateness Of System Responses In A Spoken CALL Game |
|---|---|
| Authors | Manny Rayner, Pierrette Bouillon and Johanna Gerlach |
| Abstract | We describe an experiment carried out using a French version of CALL-SLT, a web-enabled CALL game in which students at each turn are prompted to give a semi-free spoken response which the system then either accepts or rejects. The central question we investigate is whether the response is appropriate; we do this by extracting pairs of utterances where both members of the pair are responses by the same student to the same prompt, and where one response is accepted and one rejected. When the two spoken responses are presented in random order, native speakers show a reasonable degree of agreement in judging that the accepted utterance is better than the rejected one. We discuss the significance of the results and also present a small study supporting the claim that native speakers are nearly always recognised by the system, while non-native speakers are rejected a significant proportion of the time. |
| Topics | Speech Recognition/Understanding, Machine Translation, SpeechToSpeech Translation |
Full paper  |
Evaluating Appropriateness Of System Responses In A Spoken CALL Game |
| Bibtex | @InProceedings{RAYNER12.434, author = {Manny Rayner and Pierrette Bouillon and Johanna Gerlach}, title = {Evaluating Appropriateness Of System Responses In A Spoken CALL Game}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |