Towards Multimodal Interaction in Smart Home Environments: The Home Operating System


Future homes as smart and interactive environments will include a large and constantly growing number of networked devices that communicate with each other to coordinate activities. In this case the main challenge for developers and designers will be to offer possibilities to simply control this growing network of independent devices for different purposes, embodying complex technology, as well as managing a large number of information flows. In this paper we describe an approach of how to control such environments through the multimodal user interface of a home operating system.

 author = {Weingarten, Florian and Blumendorf, Marco and Albayrak, Sahin},
 title = {Towards multimodal interaction in smart home environments: the home operating system},
 booktitle = {Proceedings of the 8th ACM Conference on Designing Interactive Systems},
 series = {DIS '10},
 year = {2010},
 isbn = {978-1-4503-0103-9},
 location = {Aarhus, Denmark},
 pages = {430--433},
 numpages = {4},
 url = {},
 doi = {},
 acmid = {1858255},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {UI design, human-computer interaction, multimodal interaction, smart environment, smart home, user interface},
Florian Weingarten, Marco Blumendorf, Sahin Albayrak
Demo Paper
DIS 2010, Aarhus, Denmark