Summary of the paper
| Title | WITcHCRafT: A Workbench for Intelligent exploraTion of Human ComputeR conversaTions |
|---|---|
| Authors | Alexander Schmitt, Gregor Bertrand, Tobias Heinroth, Wolfgang Minker and Jackson Liscombe |
| Abstract | We present Witchcraft, an open-source framework for the evaluation of prediction models for spoken dialogue systems based on interaction logs and audio recordings. The use of Witchcraft is two fold: first, it provides an adaptable user interface to easily manage and browse thousands of logged dialogues (e.g. calls). Second, with help of the underlying models and the connected machine learning framework RapidMiner the workbench is able to display at each dialogue turn the probability of the task being completed based on the dialogue history. It estimates the emotional state, gender and age of the user. While browsing through a logged conversation, the user can directly observe the prediction result of the models at each dialogue step. By that, Witchcraft allows for spotting problematic dialogue situations and demonstrates where the current system and the prediction models have design flaws. Witchcraft will be made publically available to the community and will be deployed as open-source project. |
| Topics | Emotion Recognition/Generation, Tools, systems, applications, Statistical and machine learning methods |
Full paper |
WITcHCRafT: A Workbench for Intelligent exploraTion of Human ComputeR conversaTions |
Slides |
WITcHCRafT: A Workbench for Intelligent exploraTion of Human ComputeR conversaTions |
| Bibtex | @InProceedings{SCHMITT10.123, author = {Alexander Schmitt and Gregor Bertrand and Tobias Heinroth and Wolfgang Minker and Jackson Liscombe}, title = {WITcHCRafT: A Workbench for Intelligent exploraTion of Human ComputeR conversaTions}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |