Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3409120.3410662acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

A Wizard of Oz Field Study to Understand Non-Driving-Related Activities, Trust, and Acceptance of Automated Vehicles

Published: 20 September 2020 Publication History

Abstract

Understanding user needs and behavior in automated vehicles (AVs) while traveling is essential for future in-vehicle interface and service design. Since AVs are not yet market-ready, current knowledge about AV use and perception is based on observations in other transportation modes, interviews, or surveys about the hypothetical situation. In this paper, we close this gap by presenting real-world insights into the attitude towards highly automated driving and non-driving-related activities (NDRAs). Using a Wizard of Oz AV, we conducted a real-world driving study (N = 12) with six rides per participant during multiple days. We provide insights into the users’ perceptions and behavior. We found that (1) the users’ trust a human driver more than a system, (2) safety is the main acceptance factor, and (3) the most popular NDRAs were being idle and the use of the smartphone.

References

[1]
Florian Alt, Dagmar Kern, Fabian Schulte, Bastian Pfleging, Alireza Sahami Shirazi, and Albrecht Schmidt. 2010. Enabling Micro-Entertainment in Vehicles Based on Context Information. In Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Pittsburgh, Pennsylvania) (AutomotiveUI ’10). Association for Computing Machinery, New York, NY, USA, 117–124. https://doi.org/10.1145/1969773.1969794
[2]
Sonia Baltodano, Srinath Sibi, Nikolas Martelaro, Nikhil Gowda, and Wendy Ju. 2015. The RRADS Platform: A Real Road Autonomous Driving Simulator. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Nottingham, United Kingdom) (AutomotiveUI ’15). Association for Computing Machinery, New York, NY, USA, 281–288. https://doi.org/10.1145/2799250.2799288
[3]
Tobias Benz, Matthias Gerdts, Thomas Rottmann, and Lewis L. Chuang. 2019. The automated vehicle in the loop - A test platform for future driving. https://ubisys.org/chi19ws-automation/wp-content/uploads/sites/2/2019/05/8-benz-vehicle-in-the-loop.pdf
[4]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa
[5]
Barry Brown and Eric Laurier. 2017. The Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 416–429. https://doi.org/10.1145/3025453.3025462
[6]
Heiner Bubb. 2003. Fahrerassistenz - primär ein Beitrag zum Komfort oder fuer die Sicherheit?. In Der Fahrer im 21. Jahrhundert : Anforderungen, Anwendungen, Aspekte für Mensch-Maschine-Systeme; Tagung Braunschweig, 2. und 3. Juni 2003(VDI-Berichte 1768). VDI-Verlag, Düsseldorf, Germany, 25–44.
[7]
John Millar Carroll. 1991. Designing Interaction: Psychology at the Human-Computer Interface. Cambridge University Press, New York, NY, USA.
[8]
John M. Carroll, Wendy A. Kellogg, and Mary Beth Rosson. 1991. The Task-Artifact Cycle. Cambridge University Press, USA, 74–102.
[9]
Jong Kyu Choi and Yong Gu Ji. 2015. Investigating the Importance of Trust on Adopting an Autonomous Vehicle. International Journal of Human-Computer Interaction 31, 10(2015), 692–702. https://doi.org/10.1080/10447318.2015.1070549
[10]
Rita Cyganski, Eva Fraedrich, and Barbara Lenz. 2015. Travel-time valuation for automated driving: A use-case-driven study. https://elib.dlr.de/95260/
[11]
Murat Dikmen and Catherine M. Burns. 2016. Autonomous Driving in the Real World: Experiences with Tesla Autopilot and Summon. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (Automotive’UI 16). Association for Computing Machinery, New York, NY, USA, 225–228. https://doi.org/10.1145/3003715.3005465
[12]
EUR-Lex. 2016. General Data Protection Regulation. https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A02016R0679-20160504
[13]
Thomas Franke, Christiane Attig, and Daniel Wessel. 2019. A Personal Resource for Technology Interaction: Development and Validation of the Affinity for Technology Interaction (ATI) Scale. International Journal of Human–Computer Interaction 35, 6(2019), 456–467. https://doi.org/10.1080/10447318.2018.1456150
[14]
Anna-Katharina Frison, Philipp Wintersberger, Tianjia Liu, and Andreas Riener. 2019. Why Do You Like to Drive Automated?: A Context-dependent Analysis of Highly Automated Driving to Elaborate Requirements for Intelligent User Interfaces. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 528–537. https://doi.org/10.1145/3301275.3302331
[15]
Michael A. Gerber, Ronald Schroeter, and Julia Vehns. 2019. A Video-Based Automated Driving Simulator for Automotive UI Prototyping, UX and Behaviour Research. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 14–23. https://doi.org/10.1145/3342197.3344533
[16]
David Goedicke, Jamy Li, Vanessa Evers, and Wendy Ju. 2018. VR-OOM: Virtual Reality On-ROad Driving SiMulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, Article 165, 11 pages. https://doi.org/10.1145/3173574.3173739
[17]
Tobias Hecht, Anna Feldhütter, Kathrin Draeger, and Klaus Bengler. 2020. What Do You Do? An Analysis of Non-driving Related Activities During a 60 Minutes Conditionally Automated Highway Drive. In Human Interaction and Emerging Technologies, Tareq Ahram, Redha Taiar, Serge Colson, and Arnaud Choplin (Eds.). Springer International Publishing, Cham, Germany, 28–34. https://doi.org/10.1007/978-3-030-25629-6_5
[18]
Charlie Hewitt, Ioannis Politis, Theocharis Amanatidis, and Advait Sarkar. 2019. Assessing Public Perception of Self-driving Cars: The Autonomous Vehicle Acceptance Model. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 518–527. https://doi.org/10.1145/3301275.3302268
[19]
Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665
[20]
Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust. Human Factors 57, 3 (2015), 407–434. https://doi.org/10.1177/0018720814547570 25875432.
[21]
SAE International. 2018. J3016-201806 Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. https://www.sae.org/standards/content/j3016_201806/
[22]
Oliver Jarosch, Svenja Paradies, Daniel Feiner, and Klaus Bengler. 2019. Effects of non-driving related tasks in prolonged conditional automated driving – A Wizard of Oz on-road approach in real traffic environment. Transportation Research Part F: Traffic Psychology and Behaviour 65 (2019), 292 – 305. https://doi.org/10.1016/j.trf.2019.07.023
[23]
Jiun-Yin Jian, Ann M. Bisantz, and Colin G. Drury. 2000. Foundations for an Empirically Determined Scale of Trust in Automated Systems. International Journal of Cognitive Ergonomics 4, 1 (2000), 53–71. https://doi.org/10.1207/S15327566IJCE0401_04
[24]
Juffrizal Karjanto, Nidzamuddin Md. Yusof, Jacques Terken, Frank Delbressine, Matthias Rauterberg, and Muhammad Zahir Hassan. 2018. Development of On-Road Automated Vehicle Simulator for Motion Sickness Studies. International Journal of Driving Science 1, 1 (2018), 2:1–2:12. https://doi.org/10.5334/ijds.8
[25]
A. L. Kun, S. Boll, and A. Schmidt. 2016. Shifting Gears: User Interfaces in the Age of Autonomous Driving. IEEE Pervasive Computing 15, 1 (Jan 2016), 32–38. https://doi.org/10.1109/MPRV.2016.14
[26]
David R. Large, Kyle Harrington, Gary Burnett, Jacob Luton, Peter Thomas, and Pete Bennett. 2019. To Please in a Pod: Employing an Anthropomorphic Agent-Interlocutor to Enhance Trust and User Experience in an Autonomous, Self-Driving Vehicle. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 49–59. https://doi.org/10.1145/3342197.3344545
[27]
John D. Lee and Katrina A. See. 2004. Trust in Automation: Designing for Appropriate Reliance. Human Factors 46, 1 (2004), 50–80. https://doi.org/10.1518/hfes.46.1.50_30392 arXiv:https://doi.org/10.1518/hfes.46.1.50_30392PMID: 15151155.
[28]
Frederik Naujoks, Christian Purucker, Katharina Wiedemann, and Claus Marberger. 2019. Noncritical State Transitions During Conditionally Automated Driving on German Freeways: Effects of Non–Driving Related Tasks on Takeover Time and Takeover Quality. Human Factors 61, 4 (2019), 596–613. https://doi.org/10.1177/0018720818824002 arXiv:https://doi.org/10.1177/0018720818824002PMID: 30689440.
[29]
Sebastian Osswald, Daniela Wurhofer, Sandra Trösterer, Elke Beck, and Manfred Tscheligi. 2012. Predicting Information Technology Usage in the Car: Towards a Car Technology Acceptance Model. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(Portsmouth, New Hampshire) (AutomotiveUI ’12). Association for Computing Machinery, New York, NY, USA, 51–58. https://doi.org/10.1145/2390256.2390264
[30]
Jacek Pawlak. 2020. Travel-based multitasking: review of the role of digital activities and connectivity. Transport Reviews 40, 4 (2020), 429–456. https://doi.org/10.1080/01441647.2020.1728418
[31]
William Payre, Julien Cestac, and Patricia Delhomme. 2014. Intention to use a fully automated car: Attitudes and a priori acceptability. Transportation Research Part F: Traffic Psychology and Behaviour 27 (2014), 252 – 263. https://doi.org/10.1016/j.trf.2014.04.009
[32]
Nicole Perterer, Christiane Moser, Alexander Meschtscherjakov, Alina Krischkowsky, and Manfred Tscheligi. 2016. Activities and Technology Usage While Driving: A Field Study with Private Short-Distance Car Commuters. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 41, 10 pages. https://doi.org/10.1145/2971485.2971556
[33]
Bastian Pfleging. 2017. Automotive User Interfaces for the Support of Non-Driving-Related Activities. Ph.D. Dissertation. Universität Stuttgart. https://doi.org/10.18419/opus-9090
[34]
Bastian Pfleging, Maurice Rang, and Nora Broy. 2016. Investigating User Needs for Non-driving-related Activities During Automated Driving. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (Rovaniemi, Finland) (MUM ’16). Association for Computing Machinery, New York, NY, USA, 91–99. https://doi.org/10.1145/3012709.3012735
[35]
Bastian Pfleging and Albrecht Schmidt. 2015. (Non-)Driving-Related Activities in the Car: Defining Driver Activities for Manual and Automated Driving. http://www.hcilab.org/wp-content/uploads/chi15-ws-nondriving-activities.pdf
[36]
Laurel D. Riek. 2012. Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines. J. Hum.-Robot Interact. 1, 1 (July 2012), 119–136. https://doi.org/10.5898/JHRI.1.1.Riek
[37]
Christina Rödel, Susanne Stadler, Alexander Meschtscherjakov, and Manfred Tscheligi. 2014. Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seattle, WA, USA) (AutomotiveUI ’14). Association for Computing Machinery, New York, NY, USA, Article 11, 8 pages. https://doi.org/10.1145/2667317.2667330
[38]
Marie Russell, Rachel Price, Louise Signal, James Stanley, Zachery Gerring, and Jacqueline Cumming. 2011. What do passengers do during travel time? Structured observations on buses and trains. Journal of Public Transportation 14, 3 (2011), 7. https://doi.org/10.5038/2375-0901.14.3.7
[39]
Patrick A. Singleton. 2019. Discussing the “positive utilities” of autonomous vehicles: will travellers really use their time productively?Transport Reviews 39, 1 (2019), 50–65. https://doi.org/10.1080/01441647.2018.1470584
[40]
Patrick A. Singleton. 2019. Multimodal travel-based multitasking during the commute: Who does what?International Journal of Sustainable Transportation 14, 2(2019), 150–162. https://doi.org/10.1080/15568318.2018.1536237
[41]
Roy A Sorensen. 1998. Thought experiments. Oxford University Press on Demand, Oxford.
[42]
Gunnar Stevens, Paul Bossauer, Stephanie Vonholdt, and Christina Pakusch. 2019. Using Time and Space Efficiently in Driverless Cars: Findings of a Co-Design Study. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, Article 405, 14 pages. https://doi.org/10.1145/3290605.3300635
[43]
Gunnar Stevens, Johanna Meurer, Christina Pakusch, and Paul Bossauer. 2019. Investigating Car Futures from Different Angles. In Mensch und Computer 2019 - Workshopband. Gesellschaft für Informatik e.V., Bonn, 400–409. https://doi.org/10.18420/muc2019-ws-453
[44]
Waymo Team. 2019. Android users: Download the Waymo app and sign up to ride. Waymo. https://medium.com/waymo/android-users-download-the-waymo-app-and-sign-up-to-ride-fa0ec2319744
[45]
Viswanath Venkatesh and Fred D Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science 46, 2 (2000), 186–204. https://doi.org/10.1287/mnsc.46.2.186.11926
[46]
Viswanath Venkatesh, Michael G Morris, Gordon B Davis, and Fred D Davis. 2003. User acceptance of information technology: Toward a unified view. MIS quarterly 27, 3 (2003), 425–478. https://doi.org/10.2307/30036540
[47]
Peter Wang, Srinath Sibi, Brian Mok, and Wendy Ju. 2017. Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (Vienna, Austria) (HRI ’17). Association for Computing Machinery, New York, NY, USA, 234–243. https://doi.org/10.1145/2909824.3020256
[48]
Veronika Weinbeer, Tobias Muhr, and Klaus Bengler. 2019. Automated Driving: The Potential of Non-driving-Related Tasks to Manage Driver Drowsiness. In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018), Sebastiano Bagnara, Riccardo Tartaglia, Sara Albolino, Thomas Alexander, and Yushi Fujita(Eds.). Springer International Publishing, Cham, Germany, 179–188. https://doi.org/10.1007/978-3-319-96074-6_19
[49]
Yucheng Yang, Martin Fleischer, and Klaus Bengler. 2020. Chicken or Egg Problem? New Challenges and Proposals of Digital Human Modeling and Interior Development of Automated Vehicles. In Advances in Additive Manufacturing, Modeling Systems and 3D Prototyping, Massimo Di Nicolantonio, Emilio Rossi, and Thomas Alexander(Eds.). Springer International Publishing, Cham, Germany, 453–463. https://doi.org/10.1007/978-3-030-20216-3_42

Cited By

View all
  • (2024)Changes in Non-Driving-Related Activities from Conditional to Full Automation and Their Implications for Interior Design: A Systematic Review and Meta-AnalysisApplied Sciences10.3390/app1420944214:20(9442)Online publication date: 16-Oct-2024
  • (2024)An Exploration of Users’ Trust in and Willingness to Pay for Fully Driverless Vehicles After Their First RideProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324127551468:1(861-865)Online publication date: 30-Aug-2024
  • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 2020
300 pages
ISBN:9781450380652
DOI:10.1145/3409120
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Automation Trust.
  2. Autonomous Vehicles
  3. Field Study
  4. Highly Automated Driving
  5. Non-Driving-Related Activities
  6. Real-World Driving
  7. Robo-Taxis
  8. Travel Time Use
  9. Travel-Based Multitasking
  10. User Acceptance
  11. Wizard of Oz Experiment

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

AutomotiveUI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)145
  • Downloads (Last 6 weeks)9
Reflects downloads up to 31 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Changes in Non-Driving-Related Activities from Conditional to Full Automation and Their Implications for Interior Design: A Systematic Review and Meta-AnalysisApplied Sciences10.3390/app1420944214:20(9442)Online publication date: 16-Oct-2024
  • (2024)An Exploration of Users’ Trust in and Willingness to Pay for Fully Driverless Vehicles After Their First RideProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324127551468:1(861-865)Online publication date: 30-Aug-2024
  • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
  • (2024)Examining Psychological Conflict-Handling Strategies for Highly Automated Vehicles to Resolve Legal User-Vehicle ConflictsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785118:3(1-25)Online publication date: 9-Sep-2024
  • (2024)Deriving Non-Driving-Related Activities in Highly Automated Driving via an Autoethnographic Approach by Traveling Canada in a Recreational VehicleProceedings of Mensch und Computer 202410.1145/3670653.3670663(279-287)Online publication date: 1-Sep-2024
  • (2024)Designing HMI for BVI Users in Fully Automated Vehicles: A Participatory and In-the-field ApproachProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688507(1-5)Online publication date: 27-Oct-2024
  • (2024)Hey, What's Going On?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596188:2(1-24)Online publication date: 15-May-2024
  • (2024)Development and translation of human-AI interaction models into working prototypes for clinical decision-makingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660697(1607-1619)Online publication date: 1-Jul-2024
  • (2024)Only Trust a Hidden Wizard: Investigating the Effects of Wizard Visibility in Automotive Wizard of Oz StudiesProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675738(74-82)Online publication date: 22-Sep-2024
  • (2024)Exploring Passenger-Automated Vehicle Negotiation Utilizing Large Language Models for Natural InteractionProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675725(350-362)Online publication date: 22-Sep-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media