Interaction with a 3D Surface for an Innovative Input Experience on a Central Console
Authors: 
Rahul Bhaumik, 
Kevin F Mwaita, Fabio Solaroli, Aftab Ahmed, Antonella De Angeli, 
Michael HallerAuthors Info & Claims
Rahul Bhaumik, Kevin F Mwaita, Fabio Solaroli, Aftab Ahmed, Antonella De Angeli, Michael HallerAuthors Info & ClaimsPages 136 - 148
Abstract
This paper explores the development of a touch-sensitive interactive 3D central console for vehicles aimed at simplifying access to tasks unrelated to driving, such as adjusting seats and controlling music. We investigated three console designs with front surface angles of 45°, 90° and 135°. The initial study assessed how users interact with these three prototypes. Subsequently, we examined the ease with which users could reach across the different shapes. Additionally, we conducted a gesture elicitation study styled on guessability with the 135° model, focusing on user interaction with four applications: a radial menu, a 2D menu, car seat adjustments, and map navigation. Summarizing, this work aims to create a central console that is ergonomic, minimalist, and utilizes surface gestures, setting a new standard for future car interiors.
References
[1]
Kenneth Majlund Ba H, Mads Gregers Jæger, Mikael B. Skov, and Nils Gram Thomassen. 2008. You can touch, but you can’t look: interacting with in-vehicle systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Florence Italy, 1139–1148. https://doi.org/10.1145/1357054.1357233
[2]
Teo Babic, Harald Reiterer, and Michael Haller. 2017. GestureDrawer demo: one-handed interaction technique for spatial user-defined imaginary interfaces. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, Brighton United Kingdom, 149–149. https://doi.org/10.1145/3131277.3134363
[3]
Melanie Berger, Regina Bernhaupt, and Bastian Pfleging. 2019. A tactile interaction concept for in-car passenger infotainment systems. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. ACM, Utrecht Netherlands, 109–114. https://doi.org/10.1145/3349263.3351914
[4]
Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the functional area of the thumb on mobile touchscreen surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 1991–2000. https://doi.org/10.1145/2556288.2557354
[5]
T. Bieg, M. Reisinger, P. Fröhlich, B. Hametner, and S. Möstl. 2023. Task performance with touchscreen interfaces under conditions of head-down tilt bed rest. CEAS Space Journal (May 2023). https://doi.org/10.1007/s12567-023-00497-w
[6]
Hans Vanhauwaert Bjelland, Thomas Hoff, Cato A. Bjørkli, and Kjell I. Øvergård. 2007. A Case Study of A Touch-Based Interface for In-Car Audio Systems. The Design Journal 10, 1 (March 2007), 24–34. https://doi.org/10.2752/146069207789318054
[7]
Philipp Brauner, Julia Van Heek, Martina Ziefle, Nur Al-huda Hamdan, and Jan Borchers. 2017. Interactive FUrniTURE: Evaluation of Smart Interactive Textile Interfaces for Home Environments. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, Brighton United Kingdom, 151–160. https://doi.org/10.1145/3132272.3134128
[8]
Heiner Bubb, Rainer E. Grünen, and Wolfram Remlinger. 2021. Anthropometric Vehicle Design. In Automotive Ergonomics, Heiner Bubb, Klaus Bengler, Rainer E. Grünen, and Mark Vollrath (Eds.). Springer Fachmedien Wiesbaden, Wiesbaden, 343–468. https://doi.org/10.1007/978-3-658-33941-8_7
[9]
Francesco Cafaro, Leilah Lyons, and Alissa N. Antle. 2018. Framed Guessability: Improving the Discoverability of Gestures and Body Movements for Full-Body Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–12. https://doi.org/10.1145/3173574.3174167
[10]
Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User Elicitation on Single-hand Microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 3403–3414. https://doi.org/10.1145/2858036.2858589
[11]
Eugene Chen, Andrée Woodcock, and Stephen AR Scrivener. [n. d.]. A Designer-Centred Method for Ergonomically-Informed In-Car Device Design. https://dl.designresearchsociety.org/drs-conference-papers/drs2004/researchpapers/98/
[12]
Haoyu Dong. 2019. Disappearing textile interface with inherent feedforwards. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. ACM, Utrecht Netherlands, 489–493. https://doi.org/10.1145/3349263.3349598
[13]
Tanja Döring, Dagmar Kern, Paul Marshall, Max Pfeiffer, Johannes Schöning, Volker Gruhn, and Albrecht Schmidt. 2011. Gestural interaction on the steering wheel: reducing the visual demand. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Vancouver BC Canada, 483–492. https://doi.org/10.1145/1978942.1979010
[14]
Shariff A. M. Faleel, Michael Gammon, Yumiko Sakamoto, Carlo Menon, and Pourang Irani. 2020. User gesture elicitation of common smartphone tasks for hand proximate user interfaces. In Proceedings of the 11th Augmented Human International Conference. ACM, Winnipeg Manitoba Canada, 1–8. https://doi.org/10.1145/3396339.3396363
[15]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement.Journal of Experimental Psychology 47, 6 (1954), 381–391. https://doi.org/10.1037/h0055392
[16]
Martin Fleischer, Arno Hetzenecker, and Klaus Bengler. 2020. Modelling Take-Over Hand Trajectories Using Linear Mixed Effects Models. In Volume 11: DHM2020. 178 – 186. https://ebooks.iospress.nl/volumearticle/55300
[17]
Zhaohui Huang and Xiemin Huang. 2018. A study on the application of voice interaction in automotive human machine interface experience design. Xi’an City, China, 040074. https://doi.org/10.1063/1.5033738
[18]
Suhwan Jung, Jaehyun Park, Jungchul Park, Mungyeong Choe, Taehun Kim, Myungbin Choi, and Seunghwan Lee. 2021. Effect of Touch Button Interface on In-Vehicle Information Systems Usability. International Journal of Human–Computer Interaction 37, 15 (Sept. 2021), 1404–1422. https://doi.org/10.1080/10447318.2021.1886484
[19]
Pouya M Khorsandi, Lee Jones, Vandad Davoodnia, Timothy J Lampen, Aliya Conrad, Ali Etemad, and Sara Nabil. 2023. FabriCar: Enriching the User Experience of In-Car Media Interactions with Ubiquitous Vehicle Interiors using E-textile Sensors. In Proceedings of the 2023 ACM Designing Interactive Systems Conference. ACM, Pittsburgh PA USA, 1438–1456. https://doi.org/10.1145/3563657.3595988
[20]
Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018. Fingers’ Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–12. https://doi.org/10.1145/3173574.3173605
[21]
Sang Hun Lee, Se-One Yoon, and Jae Hoon Shin. 2015. On-wheel finger gesture control for in-vehicle systems on central consoles. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Nottingham United Kingdom, 94–99. https://doi.org/10.1145/2809730.2809739
[22]
Keenan R. May, Thomas M. Gable, and Bruce N. Walker. 2017. Designing an In-Vehicle Air Gesture Set Using Elicitation Methods. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Oldenburg Germany, 74–83. https://doi.org/10.1145/3122986.3123015
[23]
Gerrit Meixner, Carina Häcker, Björn Decker, Simon Gerlach, Anne Hess, Konstantin Holl, Alexander Klaus, Daniel Lüddecke, Daniel Mauser, Marius Orfgen, Mark Poguntke, Nadine Walter, and Ran Zhang. 2017. Retrospective and Future Automotive Infotainment Systems—100 Years of User Interface Evolution. In Automotive User Interfaces, Gerrit Meixner and Christian Müller (Eds.). Springer International Publishing, Cham, 3–53. https://doi.org/10.1007/978-3-319-49448-7_1 Series Title: Human–Computer Interaction Series.
[24]
Alexander Meschtscherjakov. 2017. The Steering Wheel: A Design Space Exploration. In Automotive User Interfaces, Gerrit Meixner and Christian Müller (Eds.). Springer International Publishing, Cham, 349–373. https://doi.org/10.1007/978-3-319-49448-7_13 Series Title: Human–Computer Interaction Series.
[25]
Vijayakumar Nanjappan, Rongkai Shi, Hai-Ning Liang, Kim King-Tong Lau, Yong Yue, and Katie Atkinson. 2019. Towards a Taxonomy for In-Vehicle Interactions Using Wearable Smart Textiles: Insights from a User-Elicitation Study. Multimodal Technologies and Interaction 3, 2 (May 2019), 33. https://doi.org/10.3390/mti3020033
[26]
Masahiro Okamoto and Kazuya Murao. 2021. Multi-Touch Interaction Generation Device by Spatiotemporally Switching Electrodes. Electronics 10, 12 (June 2021), 1475. https://doi.org/10.3390/electronics10121475
[27]
Saumil Patel, Yi Liu, Ruobing Zhao, Xinyu Liu, and Yueqing Li. 2022. Inspection of In-Vehicle Touchscreen Infotainment Display for Different Screen Locations, Menu Types, and Positions. In HCI in Mobility, Transport, and Automotive Systems, Heidi Krömker (Ed.). Vol. 13335. Springer International Publishing, Cham, 258–279. https://doi.org/10.1007/978-3-031-04987-3_18 Series Title: Lecture Notes in Computer Science.
[28]
Bastian Pfleging and Albrecht Schmidt. 2015. (Non-) Driving-Related Activities in the Car: Defining Driver Activities for Manual and Automated Driving. In Workshop on Experiencing Autonomous Vehicles: Crossing the Boundaries between a Drive and a Ride at CHI’15. ACM, Seoul, Korea. https://www.medien.ifi.lmu.de/pubdb/publications/pub/pfleging2015ndra/pfleging2015ndra.pdf
[29]
Bastian Pfleging, Stefan Schneegass, and Albrecht Schmidt. 2012. Multimodal interaction in the car: combining speech and gestures on the steering wheel. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Portsmouth New Hampshire, 155–162. https://doi.org/10.1145/2390256.2390282
[30]
Christian Rendl, Patrick Greindl, Kathrin Probst, Martin Behrens, and Michael Haller. 2014. Presstures: exploring pressure-sensitive multi-touch gestures on trackpads. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 431–434. https://doi.org/10.1145/2556288.2557146
[31]
Haoyuan Song. 2021. The Necessity Analysis of Car Center Console in Car Based on Virtual Technology. In 2021 International Conference on Computer, Internet of Things and Control Engineering (CITCE). IEEE, Guangzhou, China, 171–176. https://doi.org/10.1109/CITCE54390.2021.00041
[32]
Roland Spies, Andreas Blattner, Christian Lange, Martin Wohlfarter, Klaus Bengler, and Werner Hamberger. 2011. Measurement of Driver’s Distraction for an Early Prove of Concepts in Automotive Industry at the Example of the Development of a Haptic Touchpad. In Human-Computer Interaction. Interaction Techniques and Environments, Julie A. Jacko (Ed.). Vol. 6762. Springer Berlin Heidelberg, Berlin, Heidelberg, 125–132. https://doi.org/10.1007/978-3-642-21605-3_14 Series Title: Lecture Notes in Computer Science.
[33]
Ercan Tunca, Ingo Zoller, and Peter Lotz. 2018. An Investigation into Glance-free Operation of a Touchscreen With and Without Haptic Support in the Driving Simulator. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Toronto ON Canada, 332–340. https://doi.org/10.1145/3239060.3239077
[34]
Santiago Villarreal-Narvaez, Jean Vanderdonckt, Radu-Daniel Vatavu, and Jacob O. Wobbrock. 2020. A Systematic Review of Gesture Elicitation Studies: What Can We Learn from 216 Studies?. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. ACM, Eindhoven Netherlands, 855–872. https://doi.org/10.1145/3357236.3395511
[35]
Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2018. Gesture Elicitation Studies for Mid-Air Interaction: A Review. Multimodal Technologies and Interaction 2, 4 (Sept. 2018), 65. https://doi.org/10.3390/mti2040065
[36]
Florian Weidner and Wolfgang Broll. 2019. Interact with your car: a user-elicited gesture set to inform future in-car user interfaces. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia. ACM, Pisa Italy, 1–12. https://doi.org/10.1145/3365610.3365625
[37]
Walter W. Wierwille and L Tijerina. 1996. An analysis of driving accident narratives as a means of determining problems caused by in-vehicle visual allocation and visual workload. Elsevier, GLASGOW, 79–86. https://trid.trb.org/view/577021
[38]
Hao Yang, Ying Zhao, and Sida Hou. 2019. Elderly-Oriented Design for the Instrument Panel and Central Console of Intelligent Passengercars. In Cross-Cultural Design. Culture and Society, Pei-Luen Patrick Rau (Ed.). Vol. 11577. Springer International Publishing, Cham, 382–393. https://doi.org/10.1007/978-3-030-22580-3_28 Series Title: Lecture Notes in Computer Science.
[39]
Hyunjin Yoo, Jungwon Yoon, and Hyunsoo Ji. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, Copenhagen Denmark, 803–810. https://doi.org/10.1145/2786567.2793704
[40]
Fang You, Yaru Li, Preben Hansen, Liping Li, Mengting Fu, Yifan Yang, Xin Jin, and Jianmin Wang. 2021. Interface Color Design of Intelligent Vehicle Central Console. In Advances in Usability, User Experience, Wearable and Assistive Technology, Tareq Z. Ahram and Christianne S. Falcão (Eds.). Vol. 275. Springer International Publishing, Cham, 784–792. https://doi.org/10.1007/978-3-030-80091-8_93 Series Title: Lecture Notes in Networks and Systems.
[41]
Fang You, Yifan Yang, Mengting Fu, Jifang Wang, Xiaojun Luo, Liping Li, Preben Hansen, and Jianmin Wang. 2020. Icon Design Recommendations for Central Consoles of Intelligent Vehicles. In Human Interaction, Emerging Technologies and Future Applications II, Tareq Ahram, Redha Taiar, Vincent Gremeaux-Bader, and Kamiar Aminian (Eds.). Vol. 1152. Springer International Publishing, Cham, 285–291. https://doi.org/10.1007/978-3-030-44267-5_43 Series Title: Advances in Intelligent Systems and Computing.
[42]
Hongrui Zhang, Jiajun Ren, Aifeng Li, and Jing Zhao. 2020. Design of Central Console in Large Mining Excavator Based on Ergonomics. In Man–Machine–Environment System Engineering, Shengzhao Long and Balbir S. Dhillon (Eds.). Vol. 576. Springer Singapore, Singapore, 591–598. https://doi.org/10.1007/978-981-13-8779-1_67 Series Title: Lecture Notes in Electrical Engineering.
[43]
Ning Zhang, Wei-Xing Wang, Si-Yuan Huang, and Rui-Ming Luo. 2022. Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing. SN Applied Sciences 4, 4 (March 2022), 109. https://doi.org/10.1007/s42452-022-04992-3
[44]
Piotr Łuka and Andrzej Urban. 2019. Diagnosis of the Optimum Location of the Police Vehicle Central Console — Oculometric Tests. Internal Security 10, 2 (Sept. 2019), 9–17. https://doi.org/10.5604/01.3001.0013.4205
[45]
Piotr Łuka and Andrzej Urban. 2019. Standardization of the Central Console in Police Vehicles. In Proceedings of the 2019 3rd International Conference on Graphics and Signal Processing. ACM, Hong Kong Hong Kong, 86–89. https://doi.org/10.1145/3338472.3338494
Index Terms
- Interaction with a 3D Surface for an Innovative Input Experience on a Central Console
Recommendations
The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IIIThe rising popularity of digital table surfaces has spawned considerable interest in new interaction techniques. Most interactions fall into one of two modalities: 1) direct touch and multi-touch (by hand and by tangibles) directly on the surface, and 2)...
Multi-finger gestural interaction with 3D volumetric displays
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersVolumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Multi-finger gestural interaction with 3D volumetric displays
Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Comments
Information & Contributors
Information
Published In
September 2024
438 pages
ISBN:9798400705106
DOI:10.1145/3640792
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- European Union Next-Generation EU (Piano Nazionale di Ripresa e Resilienza (PNRR))
- BMW Group
Conference
AutomotiveUI '24
Sponsor:
AutomotiveUI '24: 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 22 - 25, 2024
CA, Stanford, USA
Acceptance Rates
Overall Acceptance Rate 248 of 566 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 133Total Downloads
- Downloads (Last 12 months)133
- Downloads (Last 6 weeks)39
Reflects downloads up to 22 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in