Summary of the paper
| Title | Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data |
|---|---|
| Authors | Volha Petukhova and Harry Bunt |
| Abstract | Recent years witness a growing interest in the use of multimodal data for modelling of communicative behaviour in dialogue. Dybkjaer and Bernsen (2002), point out that coding schemes for multimodal data are used solely by their creators. Standardisation has been achieved to some extent for coding behavioural features for certain nonverbal expressions, e.g. for facial expression, however, for the semantic annotation of such expressions combined with other modalities such as speech there is still a long way to go. The majority of existing dialogue act annotation schemes that are designed to code semantic and pragmatic dialogue information are limited to analysis of spoken modality. This paper investigates the applicability of existing dialogue act annotation schemes to the semantic annotation of multimodal data, and the way a dialogue act annotation scheme can be extended to cover dialogue phenomena from multiple modalities. The general conclusion of our explorative study is that a multidimensional dialogue act taxonomy is usable for this purpose when some adjustments are made. We proposed a solution for adding these aspects to a dialogue act annotation scheme without changing its set of communicative functions, in the form of qualifiers that can be attached to communicative function tags. |
| Topics | Dialogue, Discourse annotation, representation and processing |
Full paper |
Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data |
Slides |
Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data |
| Bibtex | @InProceedings{PETUKHOVA10.195, author = {Volha Petukhova and Harry Bunt}, title = {Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |