Modeling the Interplay between Human Trust and Monitoring
Pages 1119 - 1123
Abstract
In this work, we investigate and model how human trust affects monitoring. We present a web-based human subject study in which the robot is a worker and the human plays the role of a supervisor. First, we evaluate the correlation between the human trust and monitoring by using statistical tests, and then we learn probabilistic models of the behavioral data collected through our user studies. These models can provide us with the likelihood of a human user monitoring a system given their level of trust. Such models can be leveraged in many systems including the ones designed to be resilient to automation bias and complacency.
References
[1]
Kumar Akash, Wan-Lin Hu, Tahira Reid, and Neera Jain. Dynamic modeling of trust in human-machine interactions. In 2017 American Control Conference (ACC), pages 1542--1548. IEEE, 2017.
[2]
Indu P Bodala, Bing Cai Kok, Weicong Sng, and Harold Soh. Modeling the interplay of trust and attention in hri: An autonomous vehicle study. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, pages 145--147, 2020.
[3]
Ashley Cain. Trust and complacency in cyber security. Master's thesis, Department of Psychology, San José State University, 2016.
[4]
Min Chen, Stefanos Nikolaidis, Harold Soh, David Hsu, and Siddhartha Srinivasa. Trust-aware decision making for human-robot collaboration: Model learning and planning. ACM Transactions on Human-Robot Interaction (THRI), 9(2):1--23, 2020.
[5]
Ronald Hurst and Leslie R Hurst. Pilot error: The human factors. New York: Jason Aronson, 1982.
[6]
Nicole D Karpinsky, Eric T Chancey, Dakota B Palmer, and Yusuke Yamani. Automation trust and attention allocation in multitasking workspace. Applied ergonomics, 70:194--201, 2018.
[7]
Anagha Kulkarni, Sarath Sreedharan, Sarah Keren, Tathagata Chakraborti, David E Smith, and Subbarao Kambhampati. Design for interpretability. In ICAPS Workshop on Explainable AI Planning (XAIP), 2019.
[8]
John D Lee and Katrina A See. Trust in automation: Designing for appropriate reliance. Human factors, 46(1):50--80, 2004.
[9]
Bonnie M Muir. Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37(11):1905--1922, 1994.
[10]
Raja Parasuraman and Dietrich H Manzey. Complacency and bias in human use of automation: An attentional integration. Human factors, 52(3):381--410, 2010.
[11]
John Salvatier, Thomas V Wiecki, and Christopher Fonnesbeck. Probabilistic programming in python using pymc3. PeerJ Computer Science, 2:e55, 2016.
[12]
Sailik Sengupta, Zahra Zahedi, and Subbarao Kambhampati. To monitor or to trust: observing robot's behavior based on a game-theoretic model of trust. In Proceedings of the Trust Workshop at AAMAS, 2019.
[13]
Claire Textor and Richard Pak. Paying attention to trust: Exploring the relationship between attention control and trust in automation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 65, pages 817--821. SAGE Publications Sage CA: Los Angeles, CA, 2021.
[14]
Christopher D Wickens, Benjamin A Clegg, Alex Z Vieane, and Angelia L Sebok. Complacency and automation bias in the use of imperfect automation. Human factors, 57(5):728--739, 2015.
[15]
EL Wiener. Complacency: Is the term useful for air safety. In Proceedings of the 26th corporate aviation safety seminar, volume 117, pages 116--125, 1981.
[16]
Zahra Zahedi, Mudit Verma, Sarath Sreedharan, and Subbarao Kambhampati. Trust-aware planning: Modeling trust evolution in longitudinal human-robot interaction. XAIP and PlanRob workshops at ICAPS, 2021.
Index Terms
- Modeling the Interplay between Human Trust and Monitoring
Recommendations
Modelling trust in human-like technologies
IndiaHCI '18: Proceedings of the 9th Indian Conference on Human-Computer InteractionTrust is an important decision-making construct helping users to adopt and continually use a system. Despite its importance, past research has mainly focused on studying and researching it in technology mediated interactions. As nature of technical ...
Toward an Understanding of Trust Repair in Human-Robot Interaction: Current Research and Future Directions
Gone are the days of robots solely operating in isolation, without direct interaction with people. Rather, robots are increasingly being deployed in environments and roles that require complex social interaction with humans. The implementation of human-...
Comments
Information & Contributors
Information
Published In
March 2022
1353 pages
- General Chairs:
- Daisuke Sakamoto,
- Astrid Weiss,
- Program Chairs:
- Laura M Hiatt,
- Masahiro Shiomi
Sponsors
Publisher
IEEE Press
Publication History
Published: 07 March 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- ONR grants
- DARPA SAIL-ON grant
- AFOSR grants
Conference
HRI '22: ACM/IEEE International Conference on Human-Robot Interaction
March 7 - 10, 2022
Hokkaido, Sapporo, Japan
Acceptance Rates
Overall Acceptance Rate 268 of 1,124 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 105Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in