Summary of the paper
| Title | The NOMCO Multimodal Nordic Resource - Goals and Characteristics |
|---|---|
| Authors | Patrizia Paggio, Jens Allwood, Elisabeth Ahlsén, Kristiina Jokinen and Costanza Navarretta |
| Abstract | This paper presents the multimodal corpora that are being collected and annotated in the Nordic NOMCO project. The corpora will be used to study communicative phenomena such as feedback, turn management and sequencing. They already include video material for Swedish, Danish, Finnish and Estonian, and several social activities are represented. The data will make it possible to verify empirically how gestures (head movements, facial displays, hand gestures and body postures) and speech interact in all the three mentioned aspects of communication. The data are being annotated following the MUMIN annotation scheme, which provides attributes concerning the shape and the communicative functions of head movements, face expressions, body posture and hand gestures. After having described the corpora, the paper discusses how they will be used to study the way feedback is expressed in speech and gestures, and reports results from two pilot studies where we investigated the function of head gestures ― both single and repeated ― in combination with feedback expressions. The annotated corpora will be valuable sources for research on intercultural communication as well as for interaction in the individual languages. |
| Topics | Corpus (creation, annotation, etc.), Discourse annotation, representation and processing, Multilinguality |
Full paper |
The NOMCO Multimodal Nordic Resource - Goals and Characteristics |
Slides |
- |
| Bibtex | @InProceedings{PAGGIO10.98, author = {Patrizia Paggio and Jens Allwood and Elisabeth Ahlsén and Kristiina Jokinen and Costanza Navarretta}, title = {The NOMCO Multimodal Nordic Resource - Goals and Characteristics}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |