Building an intuitive multimodal interface for a smart home: hunting for the Snark.

Brown, John N.A.; Fercher, Anton Josef; Leitner, Gerhard

Abstract

This book describes an innovative approach to the interaction between humans and a smart environment; an attempt to get a smart home to understand intuitive, multi-modal, human-centred communication. State of the art smart homes, like other "smart" technology, tend to demand that the human user must adapt herself to the needs of the system. The hunt for a truly user-centred, truly intuitive system has long proven to be beyond the grasp of current technology. When humans speak with one another, we are multimodal. Our speech is supplemented with gestures, which serve as a parallel stream of information, reinforcing the meaning of our words. Drawing on well-established protocols in engineering and psychology, and with no small amount of inspiration from a particular nonsense poem, we have successfully concluded that hunt. This book describes the efforts, undertaken over several years, to design, implement, and test a model of interaction that allows untrained individuals to intuitively control a complex series of networked and embedded systems. The theoretical concepts are supported by a series of experimental studies, showing the advantages of the novel approach, and pointing towards future work that would facilitate the deployment of this concept in the real world.

Citation

BROWN, J.N.A. 2017. Building an intuitive multimodal interface for a smart home: hunting the Snark. Cham: Springer [online]. Available from: https://doi.org/10.1007/978-3-319-56532-3

• Book Type: Authored Book
• Online Publication Date: May 3, 2017
• Publication Date: May 12, 2017
• Deposit Date: Aug 12, 2025
• Publicly Available Date: Aug 12, 2025
• Publisher: Springer
• Pages: xiii, 78
• Series Title: Human-computer interaction series (HCIS)
• Series ISSN: 1571-5035; 2524-4477
• Book Title: Human–Computer Interaction Series
• ISBN: 9783319565316
• DOI: https://doi.org/10.1007/978-3-319-56532-3
• Keywords: Smart home; UX; Intuitive interaction; Wise home; Anthropology-based computing
• Public URL: https://rgu-repository.worktribe.com/output/2250065
• Additional Information: The file accompanying this record represents an example chapter extracted from the book, which can be purchased from the publishers website: https://doi.org/10.1007/978-3-319-56532-3.