In-Car Office: Can HMD-Based AR Alleviate Passenger Motion Sickness?
Authors: 
Markus Sasalovici, 
Stephan Leenders, 
Robin Connor Schramm, Jann Philipp Freiwald, Hannes Frederic Botzet, Daniel Keßelheim, Thomas Krach, Christian WinklerAuthors Info & Claims
Markus Sasalovici, Stephan Leenders, Robin Connor Schramm, Jann Philipp Freiwald, Hannes Frederic Botzet, Daniel Keßelheim, Thomas Krach, Christian WinklerAuthors Info & ClaimsPages 133 - 138
Abstract
Performing non-driving-related tasks as car passenger reduces visual perception of surroundings, which may cause a conflict with the human vestibular system and thus lead to motion sickness. Augmented reality head-mounted displays offer a possible solution to this phenomenon by presenting digital content at head level as opposed to common displays placed on one’s lap, keeping the peripheral vision intact. However, technical limitations such as end-to-end latency of video see-through devices may counteract this advantage. Therefore, we investigated a mobile office scenario by comparing video see-through augmented reality to a traditional laptop setup with regard to motion sickness and task performance in a moving car. Our results suggest similar responses to motion sickness between conditions, with limited effects on task performance and improved ergonomics when using augmented reality.
References
[1]
AUDI AG. 2022. holoride: Virtual Reality meets the real world. https://www.audi.com/en/innovation/development/holoride-virtual-reality-meets-the-real-world.html Accessed: 29.03.2023.
[2]
Deborah Bach. 2022. With their HoloLens 2 project, Microsoft and Volkswagen collaborate to put augmented reality glasses in motion. https://news.microsoft.com/source/features/digital-transformation/with-their-hololens-2-project-microsoft-and-volkswagen-collaborate-to-put-augmented-reality-glasses-in-motion/ Accessed: 29.03.2023.
[3]
Jelte E. Bos, Scott N. MacKinnon, and Anthony Patterson. 2005. Motion sickness symptoms in a ship motion simulator: effects of inside, outside, and no view. Aviation, Space, and Environmental Medicine 76, 12 (dec 2005), 1111–1118.
[4]
Hyung-Jun Cho and Gerard J. Kim. 2022. RideVR: Reducing Sickness for In-Car Virtual Reality by Mixed-in Presentation of Motion Flow Information. IEEE Access 10 (2022), 34003–34011. https://doi.org/10.1109/ACCESS.2022.3162221
[5]
Jacob Cohen. 1988. Statistical power analysis for the behavioral sciences (2. ed. ed.). Erlbaum, Hillsdale, NJ.
[6]
Abhraneil Dam and Myounghoon Jeon. 2021. A Review of Motion Sickness in Automated Vehicles. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 39–48. https://doi.org/10.1145/3409118.3475146
[7]
Cyriel Diels and Jelte E. Bos. 2016. Self-driving carsickness. Applied Ergonomics 53 (2016), 374–382. https://doi.org/10.1016/j.apergo.2015.09.009 Transport in the 21st Century: The Application of Human Factors to Future User Needs.
[8]
Lori A. Fos, Kevin W. Greve, Marne B. South, Charles Mathias, and Hope Benefield. 2000. Paced Visual Serial Addition Test: An Alternative Measure of Information Processing Speed. Applied Neuropsychology 7, 3 (2000), 140–146. https://doi.org/10.1207/S15324826AN0703_4
[9]
Jann Philipp Freiwald, Nicholas Katzakis, and Frank Steinicke. 2018. Camera Time Warp: Compensating Latency in Video See-through Head-Mounted-Displays for Reduced Cybersickness Effects. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 9, 7 pages. https://doi.org/10.1145/3281505.3281521
[10]
Florin-Timotei Ghiurãu, Mehmet Aydın Baytaş, and Casper Wickman. 2020. ARCAR: On-Road Driving in Mixed Reality by Volvo Cars. In Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 62–64. https://doi.org/10.1145/3379350.3416186
[11]
Peter J. Gianaros, Eric R. Muth, J. Toby Mordkoff, Max E. Levine, and Robert M. Stern. 2001. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviation, space, and environmental medicine 72, 2 (2001), 115–119. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2910410/
[12]
BMW M GmbH. 2022. M MIXED REALITY. Drive the change – change the drive.https://www.bmw-m.com/en/topics/magazine-article-pool/m-mixed-reality.html Accessed: 29.03.2023.
[13]
David Goedicke, Alexandra W.D. Bremers, Sam Lee, Fanjun Bu, Hiroshi Yasuda, and Wendy Ju. 2022. XR-OOM: MiXed Reality Driving Simulation with Real Cars for Research and Design(CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 107, 13 pages. https://doi.org/10.1145/3491102.3517704
[14]
Jonas Haeling, Christian Winkler, Stephan Leenders, Daniel Keßelheim, Axel Hildebrand, and Marc Necker. 2018. In-Car 6-DoF Mixed Reality for Rear-Seat and Co-Driver Entertainment. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 757–758. https://doi.org/10.1109/VR.2018.8446461
[15]
Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9 (2006), 904–908. https://doi.org/10.1177/154193120605000909
[16]
Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665
[17]
Monica Lynn Haumann Jones, Kathleen Sienko, Sheila Ebert-Hamilton, Catherine Kinnaird, Carl Miller, Brian Lin, Byoung-Keon Park, John Sullivan, Matthew Reed, and James Sayer. 2018. Development of a Vehicle-Based Experimental Platform for Quantifying Passenger Motion Sickness during Test Track Operations. In WCX World Congress Experience. SAE International. https://doi.org/10.4271/2018-01-0028
[18]
Ouren X. Kuiper, Jelte E. Bos, and Cyriel Diels. 2018. Looking forward: In-vehicle auxiliary display positioning affects carsickness. Applied Ergonomics 68 (2018), 169–175. https://doi.org/10.1016/j.apergo.2017.11.002
[19]
Joseph J. LaViola. 2000. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 32, 1 (jan 2000), 47–56. https://doi.org/10.1145/333329.333344
[20]
Jingyi Li, Agnes Reda, and Andreas Butz. 2021. Queasy Rider: How Head Movements Influence Motion Sickness in Passenger Use of Head-Mounted Displays. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 28–38. https://doi.org/10.1145/3409118.3475137
[21]
Lesley-Ann Mathis, Harald Widlroither, and Nico Traub. 2021. Towards Future Interior Concepts: User Perception and Requirements for the Use Case Working in the Autonomou Car. In Advances in Human Aspects of Transportation, Neville Stanton (Ed.). Lecture Notes in Networks and Systems, Vol. 270. Springer International Publishing, Cham, 315–322. https://doi.org/10.1007/978-3-030-80012-3_37
[22]
Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5655–5668. https://doi.org/10.1145/3025453.3026046
[23]
Alexander Meschtscherjakov, Sebastian Strumegger, and Sandra Trösterer. 2019. Bubble Margin: Motion Sickness Prevention While Reading on Smartphones in Vehicles. In Human-Computer Interaction – INTERACT 2019, David Lamas, Fernando Loizides, Lennart Nacke, Helen Petrie, Marco Winckler, and Panayiotis Zaphiris (Eds.). Lecture Notes in Computer Science, Vol. 11747. Springer International Publishing, Cham, 660–677. https://doi.org/10.1007/978-3-030-29384-0_39
[24]
Dominik Mühlbacher, Markus Tomzig, Katharina Reinmüller, and Lena Rittger. 2020. Methodological Considerations Concerning Motion Sickness Investigations during Automated Driving. Information 11, 5 (2020). https://doi.org/10.3390/info11050265
[25]
Leonardo Pavanatto, Chris North, Doug A. Bowman, Carmen Badea, and Richard Stoakley. 2021. Do we still need physical monitors? An evaluation of the usability of AR virtual monitors for productivity work. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 759–767. https://doi.org/10.1109/VR50410.2021.00103
[26]
Klaus Petersen. 2019. LPVR Middleware a Full Solution for AR / VR. https://lp-research.com/middleware-full-solution-ar-vr/ Accessed: 01.11.2022.
[27]
Joseph Smyth, Paul Jennings, Alex Mouzakitis, and Stewart Birrell. 2018. Too Sick to Drive: How Motion Sickness Severity Impacts Human Performance. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC). 1787–1793. https://doi.org/10.1109/ITSC.2018.8569572
[28]
Tessa M.W. Talsma, Omar Hassanain, Riender Happee, and Ksander N. de Winkel. 2023. Validation of a moving base driving simulator for motion sickness research. Applied Ergonomics 106 (2023), 103897. https://doi.org/10.1016/j.apergo.2022.103897
[29]
Varjo Technologies. 2022. Varjo XR-3 - The industry’s highest resolution XR headset. https://varjo.com/products/xr-3/ Accessed: 12.10.2022.
[30]
E. H. C. Woo, P. White, and C. W. K. Lai. 2016. Ergonomics standards and guidelines for computer workstation design and the impact on users’ health – a review. Ergonomics 59, 3 (2016), 464–475. https://doi.org/10.1080/00140139.2015.1076528 arXiv:https://doi.org/10.1080/00140139.2015.1076528PMID: 26224145.
[31]
Dohyeon Yeo, Gwangbin Kim, and SeungJun Kim. 2019. MAXIM: Mixed-reality Automotive Driving XIMulation. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 460–464. https://doi.org/10.1109/ISMAR-Adjunct.2019.00124
Index Terms
- In-Car Office: Can HMD-Based AR Alleviate Passenger Motion Sickness?
Recommendations
I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsThis paper explores the use of VR Head Mounted Displays (HMDs) in-car and in-motion for the first time. Immersive HMDs are becoming everyday consumer items and, as they offer new possibilities for entertainment and productivity, people will want to use ...
How Visual Motion Cues Can Influence Sickness For In-Car VR
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing SystemsThis video demonstrates our research into the use of VR Head Mounted Displays (HMDs) in-car and in-motion. Immersive HMDs offer new possibilities for entertainment and productivity during travel. However, their use is confounded by motion sickness, ...
Challenges in passenger use of mixed reality headsets in cars and other transportation
AbstractThis paper examines key challenges in supporting passenger use of augmented and virtual reality headsets in transit. These headsets will allow passengers to break free from the restraints of physical displays placed in constrained environments ...
Comments
Information & Contributors
Information
Published In
September 2023
382 pages
ISBN:9798400701122
DOI:10.1145/3581961
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 September 2023
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
AutomotiveUI '23
Sponsor:
AutomotiveUI '23: 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 18 - 22, 2023
Ingolstadt, Germany
Acceptance Rates
Overall Acceptance Rate 248 of 566 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 255Total Downloads
- Downloads (Last 12 months)214
- Downloads (Last 6 weeks)8
Reflects downloads up to 15 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format