Summary of the paper
| Title | A Multimodal Infant Behavior Annotation for Developmental Analysis of Demonstrative Expressions |
|---|---|
| Authors | Shigeyoshi Kitazawa, Shinya Kiriyama, Tomohiko Kasami, Shogo Ishikawa, Naofumi Otani, Hiroaki Horiuchi and Yoichi Takebayashi |
| Abstract | We have obtained the valuable findings about the developmental processes of demonstrative expression skills, which is concerned with the fundamental commonsense of human knowledge, such as to get an object and to catch someone’s attention. We have already developed a framework to record genuine spontaneous speech of infants. We are constructing a multimodal infant behavior corpus, which enables us to elucidate human commonsense knowledge and its acquisition mechanism. Based on the observation of the corpus, we proposed a multimodal behavior description for observation of demonstrative expressions. We proved that the proposed model has the nearly 90% coverage in an open test of the behavior description task. The analysis using the model produced many valuable findings from multimodal viewpoints; for example, the change of “line of sight” from “object to person” to “person to object” means that the infant has obtained a better way to catch someone’s attention. Our intention-based analysis provided us with an infant behavior model that may apply to a likely behavior simulation system. |
| Language | Single language |
| Topics | Corpus (creation, annotation, etc.), Multimedia annotation and processing, Speech resource/database |
Full paper |
A Multimodal Infant Behavior Annotation for Developmental Analysis of Demonstrative Expressions |
Slides |
- |
| Bibtex | @InProceedings{KITAZAWA08.238, author = {Shigeyoshi Kitazawa, Shinya Kiriyama, Tomohiko Kasami, Shogo Ishikawa, Naofumi Otani, Hiroaki Horiuchi and Yoichi Takebayashi}, title = {A Multimodal Infant Behavior Annotation for Developmental Analysis of Demonstrative Expressions}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |