Mappings in the Home: Selecting Home Appliances in 3D Space
Authors: 
Oliver Nowak, Lennart Becker, Sebastian Valentin Pettirsch, 
Jan BorchersAuthors Info & Claims
Oliver Nowak, Lennart Becker, Sebastian Valentin Pettirsch, Jan BorchersAuthors Info & ClaimsArticle No.: 237, Pages 1 - 7
Abstract
Unlike voice assistants, remotes, and smartphones, UIs embedded into furniture and other surfaces offer silent, discreet, and unobtrusive control of smart home appliances. However, as the number of appliances grows, fitting individual controls for each onto the surfaces in our environment becomes impractical, making it necessary to select appliances before controlling them. These appliances are placed in 3D at various heights around the room, while traditional controls are laid out in 2D, complicating control-to-target mapping. We compared six UIs using mappings with spatial analogies that are either absolute or relative to the user’s position and perspective. Participants used each to select 20 targets in a simplified living room, once while looking and once eyes-free. We investigated performance and participants’ ratings for, inter alia, ease of use, mapping comprehensibility, and mental demand. Map-based controllers were most promising, but participants also ranked perspective projection with touch input highly.
Supplemental Material
MP4 File - Video Preview
Video Preview
- Download
- 2.82 MB
- Transcript
MP4 File
Talk Video
- Download
- 22.21 MB
- Transcript
References
[1]
Lea Albaugh, Scott Hudson, and Lining Yao. 2019. Digital Fabrication of Soft Actuated Objects by Machine Knitting. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300414
[2]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS ’10). Association for Computing Machinery, New York, NY, USA, 121–130. https://doi.org/10.1145/1936652.1936676
[3]
Philipp Brauner, Julia van Heek, Martina Ziefle, Nur Al-huda Hamdan, and Jan Borchers. 2017. Interactive FUrniTURE: Evaluation of Smart Interactive Textile Interfaces for Home Environments. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS ’17). Association for Computing Machinery, New York, NY, USA, 151–160. https://doi.org/10.1145/3132272.3134128
[4]
Ben P. Challis and Alistair D.N. Edwards. 2001. Design principles for tactile interaction. In Haptic Human-Computer Interaction, Stephen Brewster and Roderick Murray-Smith (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 17–24.
[5]
Michael Chamunorwa, Mikołaj P. Wozniak, Sarah Vöge, Heiko Müller, and Susanne C.J. Boll. 2022. Interacting with Rigid and Soft Surfaces for Smart-Home Control. Proc. ACM Hum.-Comput. Interact. 6, MHCI, Article 211 (sep 2022), 22 pages. https://doi.org/10.1145/3546746
[6]
Bruno Fruchard, Paul Strohmeier, Roland Bennewitz, and Jürgen Steimle. 2021. Squish This: Force Input on Soft Surfacesfor Visual Targeting Tasks. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 219, 9 pages. https://doi.org/10.1145/3411764.3445623
[7]
Kristian Gohlke, Eva Hornecker, and Wolfgang Sattler. 2016. Pneumatibles: Exploring Soft Robotic Actuators for the Design of User Interfaces with Pneumotactile Feedback. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 308–315. https://doi.org/10.1145/2839462.2839489
[8]
Chris Harrison and Scott E. Hudson. 2009. Providing Dynamically Changeable Physical Buttons on a Visual Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 299–308. https://doi.org/10.1145/1518701.1518749
[9]
Leona Holloway, Kim Marriott, and Matthew Butler. 2018. Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173772
[10]
Sebastian Hueber, Johannes Wilhelm, René Schäfer, Simon Voelker, and Jan Borchers. 2023. User-Aware Rendering: Merging the Strengths of Device- and User-Perspective Rendering in Handheld AR. Proc. ACM Hum.-Comput. Interact. 7, MHCI, Article 231 (sep 2023), 18 pages. https://doi.org/10.1145/3604278
[11]
Kohei Ikeda, Naoya Koizumi, and Takeshi Naemura. 2018. FunCushion: Fabricating Functional Cushion Interfaces with Fluorescent-Pattern Displays. In Advances in Computer Entertainment Technology, Adrian David Cheok, Masahiko Inami, and Teresa Romão (Eds.). Springer International Publishing, Cham, 470–487. https://doi.org/10.1007/978-3-319-76270-8
[12]
David Ledo, Saul Greenberg, Nicolai Marquardt, and Sebastian Boring. 2015. Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 187–198. https://doi.org/10.1145/2785830.2785871
[13]
Fabrizio Leo, Caterina Baccelliere, Aleksander Waszkielewicz, Elena Cocchi, and Luca Brayda. 2018. Tactile Symbol Discrimination on a Small Pin-Array Display. In Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface (Seoul, Republic of Korea) (MAHCI’18). Association for Computing Machinery, New York, NY, USA, 9–15. https://doi.org/10.1145/3264856.3264858
[14]
Yiyue Luo, Kui Wu, Tomás Palacios, and Wojciech Matusik. 2021. KnitUI: Fabricating Interactive and Sensing Textiles with Machine Knitting. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 668, 12 pages. https://doi.org/10.1145/3411764.3445780
[15]
Sara Mlakar and Michael Haller. 2020. Design Investigation of Embroidered Interactive Elements on Non-Wearable Textile Interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376692
[16]
Sachith Muthukumarana, Moritz Alexander Messerschmidt, Denys J.C. Matthies, Jürgen Steimle, Philipp M. Scholl, and Suranga Nanayakkara. 2021. ClothTiles: A Prototyping Platform to Fabricate Customized Actuators on Clothing using 3D Printing and Shape-Memory Alloys. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 510, 12 pages. https://doi.org/10.1145/3411764.3445613
[17]
Donald Arthur Norman. 2013. The Design of Everyday Things: Revised and Expanded Edition (2nd ed.). Basic Books, New York.
[18]
Richard Chulwoo Park, Hyunjae Lee, Hwan Kim, and Woohun Lee. 2014. The previewable switch: a light switch with feedforward. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 191–194. https://doi.org/10.1145/2598510.2600885
[19]
Florian Perteneder, Kathrin Probst, Joanne Leong, Sebastian Gassler, Christian Rendl, Patrick Parzer, Katharina Fluch, Sophie Gahleitner, Sean Follmer, Hideki Koike, and Michael Haller. 2020. Foxels: Build Your Own Smart Furniture. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 111–122. https://doi.org/10.1145/3374920.3374935
[20]
René Schäfer, Oliver Nowak, Lovis Bero Suchmann, Sören Schröder, and Jan Borchers. 2023. What’s That Shape? Investigating Eyes-Free Recognition of Textile Icons. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 580, 12 pages. https://doi.org/10.1145/3544548.3580920
[21]
Philipp Wacker, Oliver Nowak, Simon Voelker, and Jan Borchers. 2019. ARPen: Mid-Air Object Manipulation Techniques for a Bimanual AR System with Pen & Smartphone. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300849
Index Terms
- Mappings in the Home: Selecting Home Appliances in 3D Space
Recommendations
Smart home – digitally engineered domestic life
The purpose of the Smart Home Project is to devise a set of intelligent home appliances that can provide an awareness of the users' needs, providing them with a better home life experience without overpowering them with complex technologies and ...
Ubiquitous reminders to manage timetable in a smart home
iiWAS '16: Proceedings of the 18th International Conference on Information Integration and Web-based Applications and ServicesThe aging of the population will bring changes on home care for elders and gerontechnologies provide alternatives for aging in place. This article presents a concept of a smart home that reminds the resident the activities he has planned on an ...
Selecting home appliances with smart glass based on contextual information
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingWe propose a method for selecting home appliances using a smart glass, which facilitates the control of network-connected appliances in a smart house. Our proposed method is image-based appliance selection and enables smart glass users to easily select ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Data Availability
Video Preview: Video Preview https://dl.acm.org/doi/10.1145/3613905.3650745#3613905.3650745-preview.mp4
Funding Sources
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 75Total Downloads
- Downloads (Last 12 months)75
- Downloads (Last 6 weeks)10
Reflects downloads up to 30 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format