Expanding V2X with V2DUIs: Distributed User Interfaces for Media Consumption in the Vehicle-to-Everything Era
Pages 394 - 401
Abstract
Modern in-vehicle infotainment systems connect to drivers’ personal digital devices, such as smartphones, to facilitate calls, notifications delivery, and access to online media and resources while driving. This communications process facilitates distributed user interfaces (DUIs) and allows casual in-vehicle interactions. However, such functionalities of modern vehicles still lack the extensive capabilities of state-of-the-art DUIs, which can offer a variety of interaction opportunities through features such as migration, redirection, adaptation, and granularity, among others. In this work, we explore DUIs in the specific context of smart vehicles, and introduce V2DUIs (Vehicle-to-DUIs) as a new addition to the V2X (Vehicle-to-Everything) family of smart vehicle concepts.
References
[1]
Adrian Aiordăchioae, Radu-Daniel Vatavu, and Dorin-Mircea Popovici. 2019. A Design Space for Vehicular Lifelogging to Support Creation of Digital Content in Connected Cars. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems(EICS ’19). ACM, New York, NY, USA, Article 9, 6 pages. https://doi.org/10.1145/3319499.3328234
[2]
Ammar Al-Taie, Graham Wilson, Frank Pollick, and Stephen Anthony Brewster. 2023. Pimp My Ride: Designing Versatile EHMIs for Cyclists. In Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’23). ACM, New York, NY, USA, 213–223. https://doi.org/10.1145/3580585.3607161
[3]
Wael Alsafery, Omer Rana, and Charith Perera. 2023. Sensing within Smart Buildings: A Survey. ACM Comput. Surv. 55, 13s, Article 297 (jul 2023), 35 pages. https://doi.org/10.1145/3596600
[4]
Leonardo Angelini, Jürgen Baumgartner, Francesco Carrino, Stefano Carrino, Maurizio Caon, Omar Abou Khaled, Jürgen Sauer, Denis Lalanne, Elena Mugellini, and Andreas Sonderegger. 2016. Comparing Gesture, Speech and Touch Interaction Modalities for In-Vehicle Infotainment Systems. In Actes de la 28ième Conference Francophone sur l’Interaction Homme-Machine(IHM ’16). ACM, New York, NY, USA, 188–196. https://doi.org/10.1145/3004107.3004118
[5]
Leonardo Angelini, Francesco Carrino, Stefano Carrino, Maurizio Caon, Omar Abou Khaled, Jürgen Baumgartner, Andreas Sonderegger, Denis Lalanne, and Elena Mugellini. 2014. Gesturing on the Steering Wheel: A User-Elicited Taxonomy. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’14). ACM, New York, NY, USA, 1–8. https://doi.org/10.1145/2667317.2667414
[6]
Laura-Bianca Bilius. 2020. A Smartwatch-based User Interface for In-Vehicle Interactions. In Proceedings of the 15th International Conference on Development and Application Systems(DAS ’20). IEEE, USA, 169–172. https://doi.org/10.1109/DAS49615.2020.9108911
[7]
Laura-Bianca Bilius, Alexandru-Tudor Andrei, and Radu-Daniel Vatavu. 2024. From Smart Buildings to Smart Vehicles: Mobile User Interfaces for Multi-Environment Interactions. In Proceedings of the 17th International Conference on Development and Application Systems(DAS ’24). IEEE, USA, 4 pages.
[8]
Laura-Bianca Bilius and Radu-Daniel Vatavu. 2020. A Synopsis of Input Modalities for In-Vehicle Infotainment and Consumption of Interactive Media. In Proceedings of the ACM International Conference on Interactive Media Experiences(IMX ’20). ACM, New York, NY, USA, 195–199. https://doi.org/10.1145/3391614.3399400
[9]
Laura-Bianca Bilius and Radu-Daniel Vatavu. 2021. A Multistudy Investigation of Drivers and Passengers’ Gesture and Voice Input Preferences for In-Vehicle Interactions. Journal of Intelligent Transportation Systems 25 (2021), 197–220. https://doi.org/10.1080/15472450.2020.1846127
[10]
Laura-Bianca Bilius, Radu-Daniel Vatavu, and Nicolai Marquardt. 2021. Exploring Application Opportunities for Smart Vehicles in the Continuous Interaction Space Inside and Outside the Vehicle. In Human-Computer Interaction(INTERACT ’21), Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 140–149. http://dx.doi.org/10.1007/978-3-030-85616-8_10
[11]
Laura-Bianca Bilius, Radu-Daniel Vatavu, and Nicolai Marquardt. 2021. Smart Vehicle Proxemics: A Conceptual Framework Operationalizing Proxemics in the Context of Outside-the-Vehicle Interactions. In Human-Computer Interaction(INTERACT ’21), Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 150–171. http://dx.doi.org/10.1007/978-3-030-85616-8_11
[12]
Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, 28 pages. https://doi.org/10.1145/3290605.3300792
[13]
John L. Campbell, Zachary R. Doerzaph, Christian M. Richard, and L. Paige Bacon. 2014. Human Factors Design Principles for the Driver-Vehicle Interface (DVI). In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’14). ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/2667239.2667305
[14]
Ashley Colley, Jonna Häkkilä, Bastian Pfleging, and Florian Alt. 2017. A Design Space for External Displays on Cars. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct(AutomotiveUI ’17). ACM, New York, NY, USA, 146–151. https://doi.org/10.1145/3131726.3131760
[15]
Joost de Winter and Dimitra Dodou. 2022. External Human–Machine Interfaces: Gimmick or Necessity?Transportation Research Interdisciplinary Perspectives 15 (2022), 100643. https://doi.org/10.1016/j.trip.2022.100643
[16]
Alexandre Demeure, Jean-Sébastien Sottet, Gaëlle Calvary, Joëlle Coutaz, Vincent Ganneau, and Jean Vanderdonckt. 2008. The 4C Reference Model for Distributed User Interfaces. In Proceedings of the 4th Int. Conference on Autonomic and Autonomous Systems. IEEE, USA, 61–69. http://dx.doi.org/10.1109/ICAS.2008.34
[17]
Henrik Detjen, Sarah Faltaous, Bastian Pfleging, Stefan Geisler, and Stefan Schneegass. 2021. How to Increase Automated Vehicles’ Acceptance through In-Vehicle Interaction Design: A Review. International Journal of Human–Computer Interaction 37, 4 (2021), 308–330. https://doi.org/10.1080/10447318.2020.1860517
[18]
Rob Dunne, Tim Morris, and Simon Harper. 2021. A Survey of Ambient Intelligence. ACM Comput. Surv. 54, 4, Article 73 (may 2021), 27 pages. https://doi.org/10.1145/3447242
[19]
Ronald Ecker, Verena Broy, Andreas Butz, and Alexander De Luca. 2009. PieTouch: A Direct Touch Gesture Interface for Interacting with in-Vehicle Information Systems. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’09). ACM, New York, NY, USA, Article 22, 10 pages. https://doi.org/10.1145/1613858.1613887
[20]
Niklas Elmqvist. 2011. Distributed User Interfaces: State of the Art. In Distributed User Interfaces: Designing Interfaces for the Distributed Ecosystem, José A. Gallud, Ricardo Tesoriero, and Victor M.R. Penichet (Eds.). Human-Computer Interaction Series. Springer, London, 1–12. https://doi.org/10.1007/978-1-4471-2271-5_1
[21]
European Telecommunications Standards Institute (ETSI). 2020. LTE; Service requirements for V2X services (3GPP TS 22.185 version 16.0.0 Release 16). Technical Report. European Telecommunications Standards Institute. https://www.etsi.org/deliver/etsi_ts/122100_122199/122185/16.00.00_60/ts_122185v160000p.pdf
[22]
Bogdan-Florin Gheran and Radu-Daniel Vatavu. 2020. From Controls on the Steering Wheel to Controls on the Finger: Using Smart Rings for In-Vehicle Interactions. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference(DIS’ 20 Companion). ACM, New York, NY, USA, 299–304. https://doi.org/10.1145/3393914.3395851
[23]
IEEE. 2010. IEEE 802.11p-2010 - IEEE Standard for Information technology– Local and metropolitan area networks– Specific requirements– Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications Amendment 6: Wireless Access in Vehicular Environments. https://standards.ieee.org/standard/802_11p-2010.html
[24]
Dagmar Kern and Albrecht Schmidt. 2009. Design Space for Driver-Based Automotive User Interfaces. In Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’09). ACM, New York, NY, USA, 3–10. https://doi.org/10.1145/1620509.1620511
[25]
B. Kirthika, M. Saiswathika, and G. Nivya Sree. 2016. A Review on Smart Watch. International Journal of Trend in Research and Development (IJTRD) 3 (2016), 3 pages. Issue 3. http://www.ijtrd.com/ViewFullText.aspx?Id=3949
[26]
Andrew L. Kun, W. Thomas Miller, and William H. Lenharth. 2004. Computers in Police Cruisers. IEEE Pervasive Computing 3, 4 (2004), 34–41. https://doi.org/10.1109/MPRV.2004.3
[27]
Sang Hun Lee, Se-One Yoon, and Jae Hoon Shin. 2015. On-Wheel Finger Gesture Control for in-Vehicle Systems on Central Consoles. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’15). ACM, New York, NY, USA, 94–99. https://doi.org/10.1145/2809730.2809739
[28]
Sophie Lepreux, Jean Vanderdonckt, and Benjamin Michotte. 2006. Visual Design of User Interfaces by (De)composition. In Proceedings of the 13th International Workshop on Interactive Systems. Design, Specification, and Verification(Lecture Notes in Computer Science, Vol. 4323). Springer, Berlin, Heidelberg, 157–170. https://doi.org/10.1007/978-3-540-69554-7_13
[29]
Ning Lu, Nan Cheng, Ning Zhang, Xuemin Shen, and Jon W. Mark. 2014. Connected Vehicles: Solutions and Challenges. IEEE Internet of Things Journal 1, 4 (2014), 289–299. https://doi.org/10.1109/JIOT.2014.2327587
[30]
Jérémie Melchior, Jean Vanderdonckt, and Peter Van Roy. 2011. Distribution Primitives for Distributed User Interfaces. In Distributed User Interfaces - Designing Interfaces for the Distributed Ecosystem. Springer, London, 23–31. https://doi.org/10.1007/978-1-4471-2271-5_3
[31]
Jérémie Melchior, Jean Vanderdonckt, and Peter Van Roy. 2011. A Model-Based Approach for Distributed User Interfaces. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems(EICS ’11). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/1996461.1996488
[32]
Eshed Ohn-Bar, Cuong Tran, and Mohan Trivedi. 2012. Hand Gesture-Based Visual User Interface for Infotainment. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’12). ACM, New York, NY, USA, 111–115. https://doi.org/10.1145/2390256.2390274
[33]
Fabio Paternò and Carmen Santoro. 2012. A Logical Framework for Multi-Device User Interfaces. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems(EICS ’12). ACM, USA, 45–50. https://doi.org/10.1145/2305484.2305494
[34]
A. Peñalver, J.J. López-Espín, J.A. Gallud, E. Lazcorreta, and F. Botella. 2011. Distributed User Interfaces: Specification of Essential Properties. In Distributed User Interfaces, J. Gallud, R. Tesoriero, and V. Penichet (Eds.). Springer, London, 13–21. https://doi.org/10.1007/978-1-4471-2271-5_2
[35]
Ken Pfeuffer and Hans Gellersen. 2016. Gaze and Touch Interaction on Tablets. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16). ACM, New York, NY, USA, 301–311. https://doi.org/10.1145/2984511.2984514
[36]
Audrey Sanctorum and Beat Signer. 2019. Towards End-User Development of Distributed User Interfaces. Universal Access in the Information Society 18 (2019), 785–799. https://doi.org/10.1007/s10209-017-0601-5
[37]
Ovidiu-Andrei Schipor and Radu-Daniel Vatavu. 2021. Empirical Results for High-definition Video and Augmented Reality Content Delivery in Hyper-connected Cars. Interacting with Computers 33, 1 (2021), 3–16. https://doi.org/10.1093/iwcomp/iwaa025
[38]
Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, and Jean Vanderdonckt. 2019. Euphoria: A Scalable, Event-Driven Architecture for Designing Interactions Across Heterogeneous Devices in Smart Environments. Information and Software Technology 109 (2019), 43–59. https://doi.org/10.1016/j.infsof.2019.01.006
[39]
Gurdit Singh, Divya Bansal, and Sanjeev Sofat. 2017. A Smartphone Based Technique to Monitor Driving Behavior Using DTW and Crowdsensing. Perv. Mob. Comp. 40 (2017), 56–70. https://doi.org/10.1016/j.pmcj.2017.06.003
[40]
Moustafa Tabbarah, Yusheng Cao, Ahmad Abu Shamat, Ziming Fang, Lingyu Li, and Myounghoon Jeon. 2023. Novel In-Vehicle Gesture Interactions: Design and Evaluation of Auditory Displays and Menu Generation Interfaces. In Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’23). ACM, New York, NY, USA, 224–233. https://doi.org/10.1145/3580585.3607164
[41]
M. Tonnis, V. Broy, and G. Klinker. 2006. A Survey of Challenges Related to the Design of 3D User Interfaces for Car Drivers. In Proceedings of 3D User Interfaces(3DUI ’06). IEEE, USA, 127–134. https://doi.org/10.1109/VR.2006.19
[42]
Jean Vanderdonckt. 2010. Distributed User Interfaces: How to Distribute User Interface Elements across Users, Platforms, and Environments. In Proc. of the 11th Congreso Internacional de Interacción Persona-Ordenador Interacción. AIPO, Valencia, 20–32. http://www.usixml.org/en/vanderdonckt-j-distributed-user-interfaces-how-to-distribute-user-interface-elements-across-users-platforms-and-environm.html?IDC=465&IDD=1433
[43]
Radu-Daniel Vatavu. 2022. Are Ambient Intelligence and Augmented Reality Two Sides of the Same Coin? Implications for Human-Computer Interaction. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). ACM, New York, NY, USA, Article 362, 8 pages. https://doi.org/10.1145/3491101.3519710
[44]
Radu-Daniel Vatavu, Laura-Bianca Bilius, Alexandru-Tudor Andrei, Mihail Terenti, Adrian-Vasile Catană, and Alexandru-Ionuţ Şiean. 2024. ChairMX: On-Chair Input for Interactive Media Consumption Experiences for Everyone, Everywhere. In Proceedings of the ACM International Conference on Interactive Media Experiences(IMX ’24). ACM, New York, NY, USA, 5 pages. https://doi.org/10.1145/3639701.3661090
[45]
Santiago Villarreal-Narvaez, Arthur Sluÿters, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2024. Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies. ACM Comput. Surv. 56, 5, Article 128 (jan 2024), 55 pages. https://doi.org/10.1145/3636458
[46]
Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376836
[47]
Li Zhao, Jiayi Fang, Jinling Hu, Yuanyuan Li, Lin Lin, Yan Shi, and Chenxin Li. 2018. The Performance Comparison of LTE-V2X and IEEE 802.11p. In Proceedings of the IEEE 87th Vehicular Technology Conference (VTC Spring). IEEE, USA, 1–5. https://doi.org/10.1109/VTCSpring.2018.8417813
Index Terms
- Expanding V2X with V2DUIs: Distributed User Interfaces for Media Consumption in the Vehicle-to-Everything Era
Recommendations
Smart Vehicle Proxemics: A Conceptual Framework Operationalizing Proxemics in the Context of Outside-the-Vehicle Interactions
Human-Computer Interaction – INTERACT 2021AbstractWe introduce smart vehicle proxemics, a conceptual framework for interactive vehicular applications that operationalizes proxemics to outside-the-vehicle interactions. We identify four zones around the vehicle affording different kinds of ...
Exploring Application Opportunities for Smart Vehicles in the Continuous Interaction Space Inside and Outside the Vehicle
Human-Computer Interaction – INTERACT 2021AbstractWe describe applications that implement interactions between the driver and their smart vehicle in a continuous interaction space characterized by the physical distance to the vehicle and by the smart devices that implement those interactions. ...
Vehicle-to-Everything (V2X) Communication Scenarios for Vehicular Ad-hoc Networking (VANET): An Overview
Computational Science and Its Applications – ICCSA 2021AbstractNowadays both sciences and technology, including Intelligent Transportation Systems, are involved in improving current approaches. Overview studies give you fast, comprehensive, and easy access to all of the existing approaches in the field. With ...
Comments
Information & Contributors
Information
Published In
June 2024
465 pages
ISBN:9798400705038
DOI:10.1145/3639701
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 June 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
- European Union - NextGenerationEU and Romanian Government
Conference
IMX '24: ACM International Conference on Interactive Media Experiences
June 12 - 14, 2024
Stockholm, Sweden
Acceptance Rates
Overall Acceptance Rate 69 of 245 submissions, 28%
Upcoming Conference
IMX '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 54Total Downloads
- Downloads (Last 12 months)54
- Downloads (Last 6 weeks)3
Reflects downloads up to 28 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format