Work in Progress

"Why did this voice agent not understand me?": error recovery strategy for in-vehicle voice user interface

Authors:

AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings

Pages 146 - 150

https://doi.org/10.1145/3349263.3351513

Published: 21 September 2019 Publication History

Get Access

Abstract

We aimed at investigating the effects of error recovery strategy that could enable the drivers to recover from the non-understanding error when interacting with the in-vehicle voice user interface (VUI). An experiment using a driving simulator was conducted with forty-seven participants who performed driving tasks with the VUI. One of three different error recovery strategies (ask repeat, re-prompt, and you can say) was suggested to recover from the non-understanding errors. A subjective questionnaire and semi-structured interviews were used to collect the participants' workload, perceived reasons for errors, and preference. Results showed participants felt that 'you can say' was more difficult than the 're-prompt' condition. However, preferences of 'ask repeat' and 'you can say' were significantly higher than 're-prompt' because the perceived reason for the non-understanding was 'input error' when the system used the 're-prompt' method. These findings provide insights into the design of the VUI in the context of driving.

References

[1]

Dan Bohus and AIexander Rudnicky. 2005. Sorry, I Didn't Catch That! - An Investigation of Non-understanding Errors and Recovery Strategies. 6th SIGdial Workshop on Discourse and Dialogue. http://www.iscaspeech.org/archive

Google Scholar

[2]

Julie Goldberg, Mari Ostendorf, and Katrin Kirchhoff. 2003. The Impact of Response Wording in Error Correction Subdialogs. In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems. http://www.isca-speech.org/archive

Google Scholar

[3]

Hwan Hwangbo, Seul Chan Lee, and Yong Gu Ji. 2016. Complexity Overloaded in Smart Car: How to Measure Complexity of In-vehicle Displays and Controls? Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: 81--86.

Digital Library

Google Scholar

[4]

Dasom Lee, Young June Sah, and Sangwon Lee. 2018. Improving Usability Perception of Error-Prone AI Speakers: Elaborated Feedback Mitigates Negative Consequences of Errors. International Journal of Human-Computer Interaction.

Crossref

Google Scholar

[5]

John D. Lee, Daniel V. McGehee, Timothy L. Brown, and Michelle L. Reyes. 2005. Collision Warning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator. Human Factors: The Journal of the Human Factors and Ergonomics Society 44, 2: 314--334.

Crossref

Google Scholar

[6]

Seul Chan Lee and Yong Gu Ji. 2019. Complexity of In-Vehicle Controllers and Their Effect on Task Performance. International Journal of Human-Computer Interaction 35, 1: 65--74.

Crossref

Google Scholar

[7]

Susan Mcroy. 1998. Preface: Detecting, repairing and preventing human --- machine miscommunication. International Journal of Human-Computer Studies 48, 5: 547--552.

Digital Library

Google Scholar

[8]

Chelsea Myers, Anushay Furqan, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for How Users Overcome Obstacles in Voice User Interfaces. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, January: 1--7.

Digital Library

Google Scholar

[9]

David L Strayer, Jonna Turrill, James R Coleman, Emily V Ortiz, and Joel M Cooper. 2014. Measuring Cognitive Distraction in the Automobile II: Assessing In-Vehicle Voice-Based Interactive Technologies. Retrieved from http://web.csulb.edu/~rfritz/aaa-driving-study.pdf

Google Scholar

[10]

Amazon Web Services. 2019, Amazon Polly. Retrieved May 10, 2019 from https://aws.amazon.com/polly

Google Scholar

Cited By

View all

Oh JKim NYan YLee S(2024)VOICON: Geometric Motion-Based Visual Feedback in Voice User InterfaceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660741(102-115)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660741
Phukon MShrivastava A(2024)Effect of Speech Entrainment in Human-Computer Conversation: A ReviewIntelligent Human Computer Interaction10.1007/978-3-031-53827-8_4(32-43)Online publication date: 29-Feb-2024
https://doi.org/10.1007/978-3-031-53827-8_4
Motta IQuaresma M(2023)Increasing Transparency to Design Inclusive Conversational Agents (CAs): Perspectives and Open IssuesProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3604304(1-4)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3604304
Show More Cited By

Index Terms

"Why did this voice agent not understand me?": error recovery strategy for in-vehicle voice user interface
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

Interacting with the News Through Voice User Interfaces
Chatbot Research and Design
Abstract
A key application area for voice user interfaces (VUIs) is news consumption, and there is a need to explore how such interactions are performed in practice. This paper presents a study exploring how novice users navigate the news through VUIs and ...
Understanding Differences between Heavy Users and Light Users in Difficulties with Voice User Interfaces
CUI '20: Proceedings of the 2nd Conference on Conversational User Interfaces

Voice user interfaces (VUIs) are growing in popularity. At this stage of VUIs adoption, distinctions between heavy users and light users are becoming emerging challenge. Some studies have focused on investigating how general users interact with VUIs; ...
Qualitative Approaches to Voice UX
Voice is a natural mode of expression offered by modern computer-based systems. Qualitative perspectives on voice-based user experiences (voice UX) offer rich descriptions of complex interactions that numbers alone cannot fully represent. We conducted a ...

Comments

Information & Contributors

Information

Published In

AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings

September 2019

524 pages

ISBN:9781450369206

DOI:10.1145/3349263

General Chairs:
Christian P. Janssen
Utrecht University, The Netherlands
,
Stella F. Donker
Utrecht University, The Netherlands
,
Program Chairs:
Lewis L. Chuang
LMU Munich, Germany
,
Wendy Ju
Cornell Tech

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2019

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

AutomotiveUI '19

Sponsor:

SIGCHI

AutomotiveUI '19: 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

September 21 - 25, 2019

Utrecht, Netherlands

Acceptance Rates

Overall Acceptance Rate 248 of 566 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
520
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Oh JKim NYan YLee S(2024)VOICON: Geometric Motion-Based Visual Feedback in Voice User InterfaceProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660741(102-115)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660741
Phukon MShrivastava A(2024)Effect of Speech Entrainment in Human-Computer Conversation: A ReviewIntelligent Human Computer Interaction10.1007/978-3-031-53827-8_4(32-43)Online publication date: 29-Feb-2024
https://doi.org/10.1007/978-3-031-53827-8_4
Motta IQuaresma M(2023)Increasing Transparency to Design Inclusive Conversational Agents (CAs): Perspectives and Open IssuesProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3604304(1-4)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3604304
Ma RZou XTao PTu Y(2023)Research on Error Handling Techniques for Speech Interaction2023 IEEE 3rd International Conference on Computer Systems (ICCS)10.1109/ICCS59700.2023.10335595(16-20)Online publication date: 22-Sep-2023
https://doi.org/10.1109/ICCS59700.2023.10335595
Meck ADraxler CVogt T(2023)Failing with Grace: Exploring the Role of Repair Costs in Conversational Breakdowns with in-Car Voice AssistantsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226679140:22(7574-7592)Online publication date: 11-Oct-2023
https://doi.org/10.1080/10447318.2023.2266791
Cha MJi Y(2023)Context Matters: Understanding the Effect of Usage Contexts on Users’ Modality Selection in Multimodal SystemsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.225060640:20(6287-6302)Online publication date: 29-Aug-2023
https://doi.org/10.1080/10447318.2023.2250606
Cha MKim HJi Y(2023)The Unit and Size of Information Supporting Auditory Feedback for Voice User InterfaceInternational Journal of Human–Computer Interaction10.1080/10447318.2023.217921440:12(3071-3080)Online publication date: 19-Feb-2023
https://doi.org/10.1080/10447318.2023.2179214
Park SLee SWang MHock PBaumann MJeon MJi YJeon M(2022)What Do You Want for In-Vehicle Agents? One Fits All vs. Multiple Specialized AgentsAdjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3544999.3550153(199-200)Online publication date: 17-Sep-2022
https://dl.acm.org/doi/10.1145/3544999.3550153
Jansen PColley MRukzio E(2022)A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature ReviewProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346176:2(1-51)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534617
Pan LYu CLi JHuang TBi XShi Y(2022)Automatically Generating and Improving Voice Command Interface from Operation Sequences on SmartphonesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517459(1-21)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517459
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Interacting with the News Through Voice User Interfaces

Understanding Differences between Heavy Users and Light Users in Difficulties with Voice User Interfaces

Qualitative Approaches to Voice UX

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations