Summary of the paper
| Title | Towards Automatic Gesture Stroke Detection |
|---|---|
| Authors | Binyam Gebrekidan Gebre, Peter Wittenburg and Przemyslaw Lenkiewicz |
| Abstract | Automatic annotation of gesture strokes is important for many gesture and sign language researchers. The unpredictable diversity of human gestures and video recording conditions require that we adopt a more adaptive case-by-case annotation model. In this paper, we present a work-in progress annotation model that allows a user to a) track hands/face b) extract features c) distinguish strokes from non-strokes. The hands/face tracking is done with color matching algorithms and is initialized by the user. The initialization process is supported with immediate visual feedback. Sliders are also provided to support a user-friendly adjustment of skin color ranges. After successful initialization, features related to positions, orientations and speeds of tracked hands/face are extracted using unique identifiable features (corners) from a window of frames and are used for training a learning algorithm. Our preliminary results for stroke detection under non-ideal video conditions are promising and show the potential applicability of our methodology. |
| Topics | Statistical and machine learning methods, Usability, user satisfaction, Tools, systems, applications |
Full paper  |
Towards Automatic Gesture Stroke Detection |
| Bibtex | @InProceedings{GEBRE12.454, author = {Binyam Gebrekidan Gebre and Peter Wittenburg and Przemyslaw Lenkiewicz}, title = {Towards Automatic Gesture Stroke Detection}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |