research-article

Manipulating the Orientation of Planar 2D Content in VR as an Implicit Visual Cue for Mitigating Passenger Motion Sickness

Authors:

Katharina Margareta Theresa Pöhlmann,

Stephen Anthony BrewsterAuthors Info & Claims

AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 1 - 10

https://doi.org/10.1145/3580585.3607157

Published: 18 September 2023 Publication History

Abstract

The use of Virtual Reality technology in vehicles is poised to bring about a new era of transport experiences, but its use can cause or enhance motion sickness. However, with careful design, VR devices have the potential to mitigate motion sickness and provide immersive experiences while travelling. We propose a novel implicit motion cue for manipulating a virtual display presented in Virtual and Extended Reality. Our design mitigates motion sickness by providing awareness of physical orientation changes through changes in the visual orientation of the virtual planar content. We performed two experiments on a rotating chair, testing mitigation properties of different levels of rotational gain applied to the display. Our results showed that the technique significantly reduced motion sickness, without negatively affecting task performance. Our findings show that we can subtly interleave motion cues in existing spatial content like planar displays and this can contribute to lessening motion sickness experienced.

References

[1]

2022. Adding thrill to every ride. https://www.holoride.com/en

[2]

Mustufa Abidi, Abdulaziz El-Tamimi, and Abdulrahman Al-Ahmari. 2012. Virtual reality: Next generation tool for distance education. International Journal of Advanced Science and Engineering Technology 2, 2 (2012), 95–100.

[3]

Lynna J Ausburn and Floyd B Ausburn. 2008. Effects of desktop virtual reality on learner performance and confidence in environment mastery: Opening a line of inquiry. Journal of STEM Teacher Education 45, 1 (2008), 6.

[4]

Lynna J Ausburn and Floyd B Ausburn. 2014. Technical perspectives on theory in screen-based virtual reality environments: Leading from the future in VHRD. Advances in Developing Human Resources 16, 3 (2014), 371–390.

[5]

Sonic HY Chan, Reik V Donner, and Stefan Lämmer. 2011. Urban road networks—spatial networks with universal geometric features? A case study on Germany’s largest cities. The European Physical Journal B 84 (2011), 563–577.

[6]

Hyung-Jun Cho and Gerard J Kim. 2020. Roadvr: Mitigating the effect of vection and sickness by distortion of pathways for in-car virtual reality. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology. 1–3.

Digital Library

[7]

Hyung-jun Cho and Gerard J Kim. 2020. Roadvr: Mitigating the effect of vection and sickness by distortion of pathways for in-car virtual reality. In 26th ACM Symposium on Virtual Reality Software and Technology. 1–3.

[8]

Hyung-Jun Cho and Gerard J Kim. 2022. RideVR: Reducing Sickness for In-Car Virtual Reality by Mixed-in Presentation of Motion Flow Information. IEEE Access 10 (2022), 34003–34011.

[9]

Burcu Cinaz, Roberto La Marca, Bert Arnrich, Gerhard Tröster, 2010. Monitoring of mental workload levels. (2010).

[10]

Mary Czerwinski, Greg Smith, Tim Regan, Brian Meyers, George G Robertson, and Gary K Starkweather. 2003. Toward characterizing the productivity benefits of very large displays. In Interact, Vol. 3. 9–16.

[11]

Ksander N de Winkel, Paolo Pretto, Suzanne AE Nooij, Iris Cohen, and Heinrich H Bülthoff. 2021. Efficacy of augmented visual environments for reducing sickness in autonomous vehicles. Applied Ergonomics 90 (2021), 103282.

[12]

Cyriel Diels, Jelte E Bos, Katharina Hottelart, and Patrice Reilhac. 2016. The impact of display position on motion sickness in automated vehicles: an on-road study. In Automated vehicle symposium, San Francisco. 19–21.

[13]

Cyriel Diels, Jelte E Bos, Katharina Hottelart, and Patrice Reilhac. 2016. Motion sickness in automated vehicles: the elephant in the room. Road Vehicle Automation 3 (2016), 121–129.

[14]

F Thomas Eggemeier and Glenn F Wilson. 2020. Performance-based and subjective assessment of workload in multi-task environments. Multiple-task performance (2020), 217–278.

[15]

John F Golding, W Bles, JE Bos, Tamika Haynes, and Michael A Gresty. 2003. Motion sickness and tilts of the inertial force environment: active suspension systems vs. active passengers. Aviation, space, and environmental medicine 74, 3 (2003), 220–227.

[16]

Michael J Griffin and Maria M Newman. 2004. Visual field effects on motion sickness in cars. Aviation, space, and environmental medicine 75, 9 (2004), 739–748.

[17]

Evan Hanau and Voicu Popescu. 2017. MotionReader: Visual Acceleration Cues for Alleviating Passenger E-Reader Motion Sickness. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct (Oldenburg, Germany) (AutomotiveUI ’17). Association for Computing Machinery, New York, NY, USA, 72–76. https://doi.org/10.1145/3131726.3131741

Digital Library

[18]

Wanja Hemmerich, Behrang Keshavarz, and Heiko Hecht. 2020. Visually induced motion sickness on the horizon. Frontiers in Virtual Reality 1 (2020), 582095.

[19]

Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665

Digital Library

[20]

Alex D Hwang, Eli Peli, and Jae-Hyun Jung. 2023. Development of virtual reality walking collision detection test on head-mounted display. In Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) IV, Vol. 12449. SPIE, 281–289.

[21]

Julie Iskander, Mohammed Attia, Khaled Saleh, Darius Nahavandi, Ahmed Abobakr, Shady Mohamed, Houshyar Asadi, Abbas Khosravi, Chee Peng Lim, and Mohammed Hossny. 2019. From car sickness to autonomous car sickness: A review. Transportation research part F: traffic psychology and behaviour 62 (2019), 716–726.

[22]

Naoki Isu, Takuya Hasegawa, Ichiro Takeuchi, and Akihiro Morimoto. 2014. Quantitative analysis of time-course development of motion sickness caused by in-vehicle video watching. Displays 35, 2 (2014), 90–97.

[23]

David M Johnson. 2005. Introduction to and review of simulator sickness research. (2005).

[24]

Su-min Jung and Taeg-kuen Whangbo. 2017. Study on inspecting VR motion sickness inducing factors. In 2017 4th International Conference on Computer Applications and Information Processing Technology (CAIPT). IEEE, 1–5.

[25]

Juffrizal Karjanto, Nidzamuddin Md Yusof, Chao Wang, Jacques Terken, Frank Delbressine, and Matthias Rauterberg. 2018. The effect of peripheral visual feedforward system in enhancing situation awareness and mitigating motion sickness in fully automated driving. Transportation research part F: traffic psychology and behaviour 58 (2018), 678–692.

[26]

Kazuhito Kato and Satoshi Kitazaki. 2006. A study for understanding carsickness based on the sensory conflict theory. SAE technical paper 1 (2006), 0096.

[27]

Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.

[28]

Lars Kooijman, Saeid Nahavandi, Houshyar Asadi, and Shady Mohamed. 2022. Does A Secondary Task Inhibit Vection in Virtual Reality?. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 1057–1064.

[29]

Ouren X Kuiper, Jelte E Bos, and Cyriel Diels. 2018. Looking forward: In-vehicle auxiliary display positioning affects carsickness. Applied Ergonomics 68 (2018), 169–175.

[30]

Ouren X Kuiper, Jelte E Bos, Eike A Schmidt, Cyriel Diels, and Stefan Wolter. 2020. knowing what’s coming: unpredictable motion causes more motion sickness. Human factors 62, 8 (2020), 1339–1348.

[31]

Jingyi Li, Agnes Reda, and Andreas Butz. 2021. Queasy rider: How head movements influence motion sickness in passenger use of head-mounted displays. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 28–38.

Digital Library

[32]

Jingyi Li, Agnes Reda, and Andreas Butz. 2021. Queasy rider: How head movements influence motion sickness in passenger use of head-mounted displays. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 28–38.

Digital Library

[33]

Wei Li, Xiaobo Lu, YiShen Zhang, and Huiya Zhao. 2019. How the Cognitive Styles Affect the Immersive Experience: A Study of Video-Watching Experience in VR. In Design, User Experience, and Usability. User Experience in Advanced Technological Environments: 8th International Conference, DUXU 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings, Part II 21. Springer, 163–177.

Digital Library

[34]

Mark McGill and Stephen Brewster. 2019. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 434–441.

[35]

Mark Mcgill, Aidan Kehoe, Euan Freeman, and Stephen Brewster. 2020. Expanding the Bounds of Seated Virtual Workspaces. ACM Trans. Comput.-Hum. Interact. 27, 3, Article 13 (may 2020), 40 pages. https://doi.org/10.1145/3380959

Digital Library

[36]

Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I am the passenger: how visual motion cues can influence sickness for in-car VR. In Proceedings of the 2017 chi conference on human factors in computing systems. 5655–5668.

Digital Library

[37]

Mark McGill, Graham Wilson, Daniel Medeiros, and Stephen Anthony Brewster. 2022. PassengXR: A Low Cost Platform for Any-Car, Multi-User, Motion-Based Passenger XR Experiences. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–15.

Digital Library

[38]

Nidzamuddin Md. Yusof, Juffrizal Karjanto, Shivam Kapoor, Jacques Terken, Frank Delbressine, and Matthias Rauterberg. 2017. Experimental setup of motion sickness and situation awareness in automated vehicle riding experience. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct. 104–109.

[39]

Daniel Medeiros, Mark McGill, Alexander Ng, Robert McDermid, Nadia Pantidi, Julie Williamson, and Stephen Brewster. 2022. From Shielding to Avoidance: Passenger Augmented Reality and the Layout of Virtual Displays for Productivity in Shared Transit. IEEE Transactions on Visualization and Computer Graphics 28, 11 (2022), 3640–3650.

[40]

Alexander Meschtscherjakov, Sebastian Strumegger, and Sandra Trösterer. 2019. Bubble margin: Motion sickness prevention while reading on smartphones in vehicles. In Human-Computer Interaction–INTERACT 2019: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2–6, 2019, Proceedings, Part II 17. Springer, 660–677.

Digital Library

[41]

Markus Miksch, Martin Steiner, Michael Miksch, and Alexander Meschtscherjakov. 2016. Motion Sickness Prevention System (MSPS) Reading Between the Lines. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 147–152.

[42]

Akihiro Morimoto, Naoki Isu, Tomohiro Okumura, Yusuke Araki, Atsuo Kawai, and Fumito Masui. 2008. Image rendering for reducing carsickness in watching onboard video display. In 2008 Digest of Technical Papers-International Conference on Consumer Electronics. IEEE, 1–2.

[43]

Louisa Murdin, John Golding, and Adolfo Bronstein. 2011. Managing motion sickness. Bmj 343 (2011).

[44]

Eyal Ofek, Jens Grubert, Michel Pahud, Mark Phillips, and Per Ola Kristensson. 2020. Towards a practical virtual office for mobile knowledge workers. arXiv preprint arXiv:2009.02947 (2020).

[45]

Eli Peli. 1998. The visual effects of head-mounted display (HMD) are not distinguishable from those of desk-top computer display. Vision research 38, 13 (1998), 2053–2066.

[46]

Kenneth A. Perrine, Kara M. Kockelman, and Yantao Huang. 2020. Anticipating long-distance travel shifts due to self-driving vehicles. Journal of Transport Geography (2020).

[47]

Kenneth A Perrine, Kara M Kockelman, and Yantao Huang. 2020. Anticipating long-distance travel shifts due to self-driving vehicles. Journal of Transport Geography 82 (2020), 102547.

[48]

Amâncio da Costa Pinto. 1991. Reading rates and digit span in bilinguals: The superiority of mother tongue. International Journal of Psychology 26, 4 (1991), 471–483.

[49]

Katharina Margareta Theresa Pöhlmann, Marc Stephan Kurt Auf Der Heyde, Gang Li, Frans Verstraten, Stephen Anthony Brewster, and Mark McGill. 2022. Can Visual Motion Presented in a VR Headset Reduce Motion Sickness for Vehicle Passengers?. In Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 114–118. https://doi.org/10.1145/3544999.3552488

Digital Library

[50]

Katharina Margareta Theresa Pöhlmann, Gang Li, Mark Mcgill, Reuben Markoff, and Stephen Anthony Brewster. 2023. You spin me right round, baby, right round: Examining the Impact of Multi-Sensory Self-Motion Cues on Motion Sickness During a VR Reading Task. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.

Digital Library

[51]

James T Reason and Joseph John Brand. 1975. Motion sickness.Academic press.

[52]

Arnon Rolnick and RE Lubow. 1991. Why is the driver rarely motion sick? The role of controllability in motion sickness. Ergonomics 34, 7 (1991), 867–879.

[53]

Taishi Sawabe, Masayuki Kanbara, and Norihiro Hagita. 2016. Diminished reality for acceleration—Motion sickness reduction with vection for autonomous driving. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). IEEE, 297–299.

[54]

Jason Thompson, Mark Stevenson, Jasper S Wijnands, Kerry A Nice, Gideon DPA Aschwanden, Jeremy Silver, Mark Nieuwenhuijsen, Peter Rayner, Robyn Schofield, Rohit Hariharan, 2020. A global analysis of urban design types and road transport injury: an image processing study. The Lancet Planetary Health 4, 1 (2020), e32–e42.

[55]

Takahiro Wada, Satoru Fujisawa, and Shunichi Doi. 2018. Analysis of driver’s head tilt using a mathematical model of motion sickness. International Journal of Industrial Ergonomics 63 (2018), 89–97.

[56]

Takahiro Wada, Satoru Fujisawa, Katsuya Imaizumi, Norimasa Kamiji, and Shun’ichi Doi. 2010. Effect of driver’s head tilt strategy on motion sickness incidence. IFAC Proceedings Volumes 43, 13 (2010), 192–197.

[57]

Takahiro Wada, Hiroyuki Konno, Satoru Fujisawa, and Shun’ichi Doi. 2012. Can passengers’ active head tilt decrease the severity of carsickness? Effect of head tilt on severity of motion sickness in a lateral acceleration environment. Human factors 54, 2 (2012), 226–234.

[58]

Takahiro Wada and Keigo Yoshida. 2016. Effect of passengers’ active head tilt and opening/closure of eyes on motion sickness in lateral acceleration environment of cars. Ergonomics 59, 8 (2016), 1050–1059.

[59]

Alexander D Walker, Eric R Muth, Fred S Switzer, and Adam Hoover. 2010. Head movements and simulator sickness generated by a virtual environment. Aviation, space, and environmental medicine 81, 10 (2010), 929–934.

[60]

Carolin Wienrich and Kristina Schindler. 2019. Challenges and requirements of immersive media in autonomous car: Exploring the feasibility of virtual entertainment applications. i-com 18, 2 (2019), 105–125.

[61]

Robert Xiao and Hrvoje Benko. 2016. Augmenting the field-of-view of head-mounted displays with sparse peripheral displays. In Proceedings of the 2016 CHI conference on human factors in computing systems. 1221–1232.

Digital Library

[62]

Li-Li Zhang, Jun-Qin Wang, Rui-Rui Qi, Lei-Lei Pan, Min Li, and Yi-Ling Cai. 2016. Motion sickness: current knowledge and recent advance. CNS neuroscience & therapeutics 22, 1 (2016), 15–24.

Cited By

Qiu ZMcGill MPöhlmann KBrewster S(2024)Augmenting Virtual Spatial UIs with Physics- and Direction-Based Visual Motion Cues to Non-Disruptively Mitigate Motion SicknessProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682079(1-10)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682079
Qiu ZMcGill MPöhlmann KBrewster S(2024)Acceleration instead of Speed: Acceleration Visual Cues in VR for Reduced Motion Sickness in Linear MotionAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685023(56-61)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685023
Gim BKang SKim GYeo DHwang SKim S(2024)Curving the Virtual Route: Applying Redirected Steering Gains for Active Locomotion in In-Car VRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650746(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650746
Show More Cited By

Index Terms

Manipulating the Orientation of Planar 2D Content in VR as an Implicit Visual Cue for Mitigating Passenger Motion Sickness
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Can Visual Motion Presented in a VR Headset Reduce Motion Sickness for Vehicle Passengers?
AutomotiveUI '22: Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

To make the rise of automated vehicles possible and to allow for their mass adoption, one major problem still needs to be solved: Motion sickness. Automated vehicles lead to increased motion sickness partly caused by an occlusion of the outside world (...
How Visual Motion Cues Can Influence Sickness For In-Car VR
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

This video demonstrates our research into the use of VR Head Mounted Displays (HMDs) in-car and in-motion. Immersive HMDs offer new possibilities for entertainment and productivity during travel. However, their use is confounded by motion sickness, ...
Investigating motion sickness techniques for immersive virtual environments
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Motion sickness is one of important issues in immersive virtual environments. In some cases it may last for hours after participation in the virtual experience. Reducing the amount of motion sickness in healthcare applications is of great importance. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2023

352 pages

ISBN:9798400701054

DOI:10.1145/3580585

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

European Research Council (ERC)

Conference

AutomotiveUI '23

Sponsor:

SIGCHI

AutomotiveUI '23: 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 18 - 22, 2023

Ingolstadt, Germany

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
283
Total Downloads

Downloads (Last 12 months)214
Downloads (Last 6 weeks)17

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qiu ZMcGill MPöhlmann KBrewster S(2024)Augmenting Virtual Spatial UIs with Physics- and Direction-Based Visual Motion Cues to Non-Disruptively Mitigate Motion SicknessProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682079(1-10)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682079
Qiu ZMcGill MPöhlmann KBrewster S(2024)Acceleration instead of Speed: Acceleration Visual Cues in VR for Reduced Motion Sickness in Linear MotionAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685023(56-61)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685023
Gim BKang SKim GYeo DHwang SKim S(2024)Curving the Virtual Route: Applying Redirected Steering Gains for Active Locomotion in In-Car VRExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650746(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650746
Medeiros DWilson GBrewster SMcGill M(2024)The Social Impact of Extended Reality Spatial Productivity in Constrained, Public and Passenger Spaces2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00129(659-661)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00129
Mittelstaedt JHuelmann GMarggraf-Micheel CSchiller ASeehof CStelling D(2024)Cybersickness with passenger VR in the aircraft: Influence of turbulence and VR contentVirtual Reality10.1007/s10055-024-01008-w28:2Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1007/s10055-024-01008-w

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents