research-article

Capturing Passenger Experience in a Ride-Sharing Autonomous Vehicle: The Role of Digital Assistants in User Interface Design

Authors:

Benjamin S. Alpers,

Lauren E. Feitzinger,

Daniel Joseph Hills-Bunnell,

Kaustubh Deshpande,

Lauren Aquino ShluzasAuthors Info & Claims

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Pages 83 - 93

https://doi.org/10.1145/3409120.3410639

Published: 20 September 2020 Publication History

Abstract

Autonomous ride-sharing services have the potential to disrupt future transportation ecosystems. It is critical to understand factors that influence user experience in autonomous vehicles (AVs) to design for widespread adoption. We conducted an on-road driving study in a mock AV to examine how the amount of information provided by an in-vehicle digital assistant, and the manner in which information is delivered, can impact one's overall AV experience. Passengers were divided into two cohorts, based on their assigned in-vehicle digital assistant (Lilly vs. Julie). Through a mixed-methods analysis, the data showed that quantity and quality of information presented via the digital assistant had a significant impact on one's confidence in an AV's driving capability and willingness to ride again. These findings highlight that although the two cohorts were identical with respect to the actual vehicle driven, differences in in-vehicle digital assistant design can alter passengers’ perceptions of their overall AV experience.

References

[1]

McKinsey & Company. 2019. How shared autonomous vehicles will reinvent mobility | McKinsey. (June 2019). Retrieved April 16, 2020 from https://www.mckinsey.com/industries/automotive-and-assembly/our-insights/change-vehicles-how-robo-taxis-and-shuttles-will-reinvent-mobility (Archive: http://archive.vn/wip/De3UJ)

[2]

J. F. Kelley. 1984. An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Information Systems (TOIS)2, 1 (January 1984), 26–41.

[3]

Laurel Riek. 2012. Wizard of Oz Studies in HRI: A Systematic Review and New Reporting Guidelines. Journal of Human-Robot Interaction (August 2012), 119–136.

Digital Library

[4]

N. Dahlbäck, A. Jönsson, and L. Ahrenberg. 1993. Wizard of Oz studies - why and how. Knowledge-Based Systems 6, 4 (December 1993), 258–266.

[5]

Nikolas Martelaro and Wendy Ju. 2017. The needfinding machine. In ACM/IEEE International Conference on Human-Robot Interaction, IEEE Computer Society, New York, New York, USA, 355–356.

Digital Library

[6]

Large, 2019. To Please in a Pod: Employing an anthropomorphic agent-interlocutor to enhance trust and user experience in an autonomous, self-driving vehicle. In Proceedings of AutomotiveUI '19, September 21–25, Utrecht, Netherlands. https://doi.org/10.1145/3342197.3344545.

Digital Library

[7]

V. Antrobus, G. Burnett and D. Large. 2018. “Trust me–I'm AutoCAB: Using natural language interfaces to improve the trust and acceptance of level 4/5 autonomous vehicles,” In The 6th HUMANIST Conference, The Hague.

[8]

Malte Risto, Colleen Emmenegger, Erik Vinkhuyzen, Melissa Cefkin, and Jim Hollan. 2017. Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination. The University of Iowa, 186–192.

[9]

Dirk Rothenbucher, Jamy Li, David Sirkin, Brian Mok, and Wendy Ju. 2016. Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles. In25th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2016, Institute of Electrical and Electronics Engineers Inc., 795–802.

[10]

Peter Wang, Srinath Sibi, Brian Mok, and Wendy Ju. 2017. Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies. In ACM/IEEE International Conference on Human-Robot Interaction, IEEE Computer Society, New York, New York, USA, 234–243.

Digital Library

[11]

Sonia Baltodano, Srinath Sibi, Nikolas Martelaro, Nikhil Gowda, and Wendy Ju. 2015. The RRADS platform. Association for Computing Machinery (ACM), 281–288.

[12]

John Sherry, Richard Beckwith, Asli Arslan Esme, and Cagri Tanriover. 2018. Getting things done in an autonomous vehicle. In Social Robots in the Wild Workshop, 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2018).

[13]

Juffrizal Karjanto, Nidzamuddin Md. Yusof, Jacques Terken, Frank Delbressine, Matthias Rauterberg, and Muhammad Zahir Hassan. 2018. Development of On-Road Automated Vehicle Simulator for Motion Sickness Studies. International Journal of Driving Science 1, 1 (November 2018).

[14]

Clifford Nass and Youngme Moon. 2000. Machines and Mindlessness: Social Responses to Computers. Journal of Social Issues 56, 1 (2000), 81–103.

[15]

Adam Waytz, Joy Heafner, and Nicholas Epley. 2014. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology 52, (May 2014), 113–117.

[16]

Jae-Gil Lee, Ki Joon Kim, Sangwon Lee, and Dong-Hee Shin. 2015. Can Autonomous Vehicles Be Safe and Trustworthy? Effects of Appearance and Autonomy of Unmanned Driving Systems. International Journal of Human-Computer Interaction 31, 10 (October 2015), 682–691.

[17]

Ioannis Politis, Stephen Brewster, and Frank Pollick. 2015. Language-based multimodal displays for the handover of control in autonomous cars. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’15), Association for Computing Machinery, Nottingham, United Kingdom, 3–10.

Digital Library

[18]

David R. Large, Kyle Harrington, Gary Burnett, Jacob Luton, Peter Thomas, and Pete Bennett. 2019. To Please in a Pod: Employing an Anthropomorphic Agent-Interlocutor to Enhance Trust and User Experience in an Autonomous, Self-Driving Vehicle. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’19), Association for Computing Machinery, Utrecht, Netherlands, 49–59.

Digital Library

[19]

Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing 9, 4 (November 2015), 269–275.

[20]

G Lugano. 2017. Virtual assistants and self-driving cars. In2017 15th International Conference on ITS Telecommunications (ITST), 1–5.

[21]

Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining (KDD ’04). Association for Computing Machinery, New York, NY, USA, 168–177.

Digital Library

[22]

Nadim Nachar. 2008. The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution. Tutorials in Quantitative Methods for Psychology 4, (March 2008).

[23]

Nigel King and Joanna Brooks. 2017. Template Analysis for Business and Management Students. (Mastering Business Research Methods). SAGE Publications Ltd.

[24]

Elias Vyzas. 1999. Recognition of emotional and cognitive states using physiological data. Master's thesis. Massachusetts Institute of Technology, Cambridge, Massachusetts. Retrieved April 23, 2020 from https://dspace.mit.edu/handle/1721.1/9795

[25]

Jennifer Anne Healey. 2000. Wearable and automotive systems for affect recognition from physiology.

[26]

Ph.D. dissertation. Massachusetts Institute of Technology, Cambridge, Massachusetts. UMI order number: AAI 0801928. Retrieved April 23, 2020 from https://dspace.mit.edu/handle/1721.1/9067

Cited By

Kettle LHerrera KPithayarungsarit PSimpson KLee Y(2023)A Framework of Vehicle-Human Communication Features at Traffic Intersections to Enhance Trust and Situation AwarenessProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/2169506723119292767:1(1154-1160)Online publication date: 25-Oct-2023
https://doi.org/10.1177/21695067231192927
Asha ASharlin E(2023)Designing Inclusive Interaction with Autonomous Vehicles for Older PassengersProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596045(2138-2154)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596045
Zheng QHuang Y(2023)"Begin with the End in Mind": Incorporating UX Evaluation Metrics into Design Materials of Participatory DesignExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585664(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585664
Show More Cited By

Capturing Passenger Experience in a Ride-Sharing Autonomous Vehicle: The Role of Digital Assistants in User Interface Design
1. Human-centered computing

Recommendations

Ghost driver: a platform for investigating interactions between pedestrians and driverless vehicles
AutomotiveUI '15: Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

How will pedestrians and cyclists interact with self-driving cars when there is no human driver? To find answers to this question we need a secure experimental design in which pedestrians can interact with a car that appears to drive on its own. In ...
Motion planning of autonomous vehicles in a non-autonomous vehicle environment without speed lanes

Planning is one of the key problems for autonomous vehicles operating in road scenarios. Present planning algorithms operate with the assumption that traffic is organised in predefined speed lanes, which makes it impossible to allow autonomous vehicles ...
Visualizing implicit eHMI for autonomous vehicles
AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings

Autonomous vehicles' (AVs) interactions with pedestrians remain an ongoing uncertainty. Studies claim the need for explicit external human-machine interfaces (eHMI) such as lights to replace the lack of eye contact with and explicit gestures from ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 2020

300 pages

ISBN:9781450380652

DOI:10.1145/3409120

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AutomotiveUI '20

Sponsor:

SIGCHI

AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 21 - 22, 2020

DC, Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
716
Total Downloads

Downloads (Last 12 months)139
Downloads (Last 6 weeks)8

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kettle LHerrera KPithayarungsarit PSimpson KLee Y(2023)A Framework of Vehicle-Human Communication Features at Traffic Intersections to Enhance Trust and Situation AwarenessProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/2169506723119292767:1(1154-1160)Online publication date: 25-Oct-2023
https://doi.org/10.1177/21695067231192927
Asha ASharlin E(2023)Designing Inclusive Interaction with Autonomous Vehicles for Older PassengersProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596045(2138-2154)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596045
Zheng QHuang Y(2023)"Begin with the End in Mind": Incorporating UX Evaluation Metrics into Design Materials of Participatory DesignExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585664(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585664
Karas VSchuller DSchuller B(2023)Audiovisual Affect Recognition for Autonomous Vehicles: Applications and Future AgendasIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.333374925:6(4918-4932)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TITS.2023.3333749
Park DLee YKim Y(2023)Effects of Autonomous Driving Context and Anthropomorphism of in-Vehicle Voice Agents on Intimacy, Trust, and Intention to UseInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2262271(1-14)Online publication date: 4-Oct-2023
https://doi.org/10.1080/10447318.2023.2262271
Zheng YRen X(2022)Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous VehiclesMultimodal Technologies and Interaction10.3390/mti60900846:9(84)Online publication date: 18-Sep-2022
https://doi.org/10.3390/mti6090084
Zheng QTang YLiu YLiu WHuang Y(2022)UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital LibraryProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501855(1-24)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501855
Huff ETucker NGrady SBrinkley J(2022)What Can My Car Tell Me? Consumer Perceptions of Transparency in Self-Driving Vehicles2022 IEEE 3rd International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS56717.2022.9980645(1-10)Online publication date: 17-Nov-2022
https://doi.org/10.1109/ICHMS56717.2022.9980645
Phinnemore RCimolino GSarkar PEtemad AGraham T(2021)Happy Driver: Investigating the Effect of Mood on Preferred Style of Driving in Self-Driving CarsProceedings of the 9th International Conference on Human-Agent Interaction10.1145/3472307.3484169(139-147)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3472307.3484169
Kim MHeo JLee J(2021)In-Vehicle Information Design to Enhance the Experience of Passengers in Autonomous Public BusesHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-030-78358-7_28(408-424)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78358-7_28

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents