| Title | CoGesT: A Formal Transcription System for Conversational Gesture |
| Author(s) |
Thorsten Trippel (1), Dafydd Gibbon (1), Alexandra Thies (1), Jan-Torsten Milde (2), Karin Looks (1), Benjamin Hell (1), Ulrike
Gut (3)
(1) Universität Bielefeld, Fakultät für Linguistik und Literaturwissenschaft, Computational Linguistics and Spoken Language; (2) Albert-Ludwigs-Universität Freiburg i.Br., Englisches Seminar; (3) Fachhochschule Fulda |
| Session | O46-MW |
| Abstract | In order to create reusable and sustainable multimodal resources a transcription model for hand and arm gestures in conversation is needed. We argue that transcription systems so far developed for sign language transcription and psychological analysis are not suitable for the linguistic analysis of conversational gesture. Such a model must adhere to a strict form-function distinction and be both computationally explicit and compatible with descriptive notations such as feature structures in other areas of computational and descriptive linguistics. We describe the development and evaluation of a suitable formal model using a feature-based transcription system, concentrating as a first step on arm gestures within the context of the development of an annotated video resource and gesture lexicon. |
| Keyword(s) | gesture annotation, transcription system |
| Language(s) | German, Anyi, English |
| Full Paper | 650.pdf |