opinion

Free access

Overtrust in the robotic age

Authors:

Alan R. Wagner,

Jason Borenstein,

Ayanna HowardAuthors Info & Claims

Communications of the ACM, Volume 61, Issue 9

Pages 22 - 24

https://doi.org/10.1145/3241365

Published: 22 August 2018 Publication History

All formats PDF

Abstract

A contemporary ethical challenge.

References

[1]

Booth, S. et al. Piggybacking robots: Human-robot overtrust in university dormitory security. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, HRI '17, ACM, New York, NY, USA, 2017, 426--434.

Digital Library

Google Scholar

[2]

Borenstein, J., Howard, A., and Wagner, A.R. Pediatric robotics and ethics: The robot is ready to see you now but should it be trusted?" Robot Ethics 2.0, P. Lin, K. Abney, G. Bekey, Eds., Oxford University Press, 2017.

Google Scholar

[3]

Boudette, N.E. Tesla's self-driving system cleared in deadly crash. The New York Times (Jan. 2017).

Google Scholar

[4]

Gunning, D. Explainable artificial intelligence (XAI). Defense Advanced Research Projects agency; https://bit.ly/2x2sS3P

Google Scholar

[5]

Lee, T.B. Car companies' vision of a gradual transition to self-driving cars has a big problem. Vox (July 5, 2017); https://bit.ly/2tLUAzp

Google Scholar

[6]

Mosier, K.L., Palmer, E.A., and Degani, A. Electronic checklists: Implications for decision making. In Proceedings of the Human Factors Society 36<sup>th</sup> Annual Meeting, Human Factors Society, Santa Monica, CA, 1992, 7--11.

Crossref

Google Scholar

[7]

Parasuraman, R. and Riley, V. Humans and automation: Use, misuse, disuse, abuse. Human Factors 39, 2 (Feb. 1997), 230--253.

Crossref

Google Scholar

[8]

Plummer, L. Tesla could stop you using autopilot in its cars---But only if you take your hands off the wheel. Mirror (Aug. 30, 2016); https://bit.ly/2uJb3D6

Google Scholar

[9]

Robinette, P., Howard, A. and Wagner, A.R. A conceptualizing overtrust in robots: Why do people trust a robot that previously failed? In Autonomy and Artificial Intelligence, W. Lawless, R. Mittu, D. Sofge, and S. Russell, Eds., Springer, 2017.

Google Scholar

[10]

Schneider, D. Robin Murphy: Roboticist to the rescue. IEEE Spectrum (Feb. 1, 2009); https://bit.ly/2L74Z2a

Digital Library

Google Scholar

[11]

SoftBank Robotics. Who is Pepper?; https://bit.ly/2wZzGzZ

Google Scholar

Cited By

View all

Bursell MRoumbanis L(2024)After the algorithms: A study of meta-algorithmic judgments and diversity in the hiring process at a large multisite companyBig Data & Society10.1177/2053951723122175811:1Online publication date: 30-Jan-2024
https://doi.org/10.1177/20539517231221758
Judkins JHwang YKim S(2024)Human-AI interaction: Augmenting decision-making for IT leader's project selectionInformation Development10.1177/02666669241249744Online publication date: 21-May-2024
https://doi.org/10.1177/02666669241249744
Zhang YSun JFeng LYao CFan MZhang LWang QGeng XRui Y(2024)See Widely, Think Wisely: Toward Designing a Generative Multi-agent System to Burst Filter BubblesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642545(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642545
Show More Cited By

Index Terms

Overtrust in the robotic age
1. Computer systems organization
  1. Embedded and cyber-physical systems

Recommendations

Toward overtrust-free advanced driver assistance systems
Special Issue on Human-automation Coagency

Avoiding human overtrust in machines is a vital issue to establish a socially acceptable advanced driver assistance system (ADAS). However, research has not clarified the effective way of designing an ADAS to prevent driver overtrust in the system. It ...
Reducing overtrust in failing robotic systems
HRI '19: Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction

In general, people tend to place too much trust in robotic systems, also in emergency situations. Our study attempts to discover ways of reducing this overtrust, by adding vocal warnings of error from a robot that guides participants blindfolded through ...
Unmanned Vehicles Come of Age: The DARPA Grand Challenge

While the DARPA Grand Challenge has revitalized interest in intelligent highway systems, autonomous vehicles, and sensing technology, a host of other novel issues afford interesting design and computer-engineering challenges for the future.

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 61, Issue 9

September 2018

94 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/3271489

Editor:
Andrew A. Chien
Association for Computing Machinery, New York, NY

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2018

Published in CACM Volume 61, Issue 9

Check for updates

Qualifiers

Opinion
Popular
Un-reviewed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

61
Total Citations
View Citations
2,958
Total Downloads

Downloads (Last 12 months)420
Downloads (Last 6 weeks)61

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bursell MRoumbanis L(2024)After the algorithms: A study of meta-algorithmic judgments and diversity in the hiring process at a large multisite companyBig Data & Society10.1177/2053951723122175811:1Online publication date: 30-Jan-2024
Judkins JHwang YKim S(2024)Human-AI interaction: Augmenting decision-making for IT leader's project selectionInformation Development10.1177/02666669241249744Online publication date: 21-May-2024
Zhang YSun JFeng LYao CFan MZhang LWang QGeng XRui Y(2024)See Widely, Think Wisely: Toward Designing a Generative Multi-agent System to Burst Filter BubblesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642545(1-24)Online publication date: 11-May-2024
Schoenherr JThomson R(2024)When AI Fails, Who Do We Blame? Attributing Responsibility in Human–AI InteractionsIEEE Transactions on Technology and Society10.1109/TTS.2024.33700955:1(61-70)Online publication date: Mar-2024
Holbrook CHolman DClingo JWagner A(2024)Overtrust in AI Recommendations About Whether or Not to Kill: Evidence from Two Human-Robot Interaction StudiesScientific Reports10.1038/s41598-024-69771-z14:1Online publication date: 4-Sep-2024
Srivastava DLilly JFeigh K(2024)Exploring the role of judgement and shared situation awareness when working with AI recommender systemsCognition, Technology & Work10.1007/s10111-024-00771-9Online publication date: 26-Jul-2024
Myers B(2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
Li XZhang JLong HChen YZhang A(2023)Optimization of Digital Information Management of Financial Services Based on Artificial Intelligence in the Digital Financial EnvironmentJournal of Organizational and End User Computing10.4018/JOEUC.31847835:3(1-17)Online publication date: 24-Feb-2023
Adithya B. (f51844e1-5690-4bbc-afd8-22e81de10298 Santhi G. (a711be60-0dcf-43de-a46b-b0de7a16eb7e (2023)Fundamentals of DNA Computation in the Domain of CryptosystemsInternational Journal of Information Systems and Social Change10.4018/IJISSC.32239514:1(1-19)Online publication date: 9-May-2023
Dickey AWasko M(2023)Digital Disparities in Patient Adoption of TelemedicineInternational Journal of Healthcare Information Systems and Informatics10.4018/IJHISI.31804318:1(1-21)Online publication date: 10-Feb-2023
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Toward overtrust-free advanced driver assistance systems

Reducing overtrust in failing robotic systems

Unmanned Vehicles Come of Age: The DARPA Grand Challenge

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations