A Trajectory-based Approach for Device Independent Gesture Recognition in Multimodal User Interfaces

Abstract

With the rise of technology in all areas of life new interaction techniques are required. With gestures and voice being the most natural ways to interact, it is a goal to also support this in human-computer interaction. In this paper, we introduce our approach to multimodal interaction in smart home environments and illustrate how device independent gesture recognition can be of great support in this area. We describe a trajectory-based approach that is applied to support device independent dynamic hand gesture recognition from vision systems, accelerometers or pen devices. The recorded data from the different devices is transformed to a common basis (2D-space) and the feature extraction and recognition is done on this basis. In a comprehensive case study we show the feasibility of the recognition and the integration with a multimodal and adaptive home operating system.

BibTeX
 Copy 
@inproceedings{Wilhelm2010,
   author = {Wilhelm, Mathias and Roscher, Dirk and Blumendorf, Marco and Albayrak, Sahin},
   affiliation = {DAI-Labor, TU Berlin, Ernst-Reuter-Platz 7, 10587 Berlin, Germany},
   title = {A Trajectory-Based Approach for Device Independent Gesture Recognition in Multimodal User Interfaces},
   booktitle = {Haptic and Audio Interaction Design},
   series = {Lecture Notes in Computer Science},
   editor = {Nordahl, Rolf and Serafin, Stefania and Fontana, Federico and Brewster, Stephen},
   publisher = {Springer Berlin / Heidelberg},
   isbn = {3-642-15840-4, 978-3-642-15840-7},
   location = {Copenhagen, Denmark},
   pages = {197-206},
   numpages = {10},
   volume = {6306},
   url = {http://dx.doi.org/10.1007/978-3-642-15841-4_21},
   acmid = {1888010},
   note = {10.1007/978-3-642-15841-4_21},
   year = {2010},
   keywords = {device independence, generalized procrustes analysis, gesture recognition, multimodality, trajectory matching}
}
Authors:
Mathias Wilhelm, Marco Blumendorf, Dirk Roscher, Sahin Albayrak
Category:
Conference Paper
Year:
2010
Location:
HAID2010: Proceedings of the fifth International Workshop on Haptic and Audio Interaction Design 2010. Vol. 1, Copenhagen, Denmark