Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

A Classification Model for Sensing Human Trust in Machines Using EEG and GSR

Published: 16 November 2018 Publication History

Abstract

Today, intelligent machines interact and collaborate with humans in a way that demands a greater level of trust between human and machine. A first step toward building intelligent machines that are capable of building and maintaining trust with humans is the design of a sensor that will enable machines to estimate human trust level in real time. In this article, two approaches for developing classifier-based empirical trust-sensor models are presented that specifically use electroencephalography and galvanic skin response measurements. Human subject data collected from 45 participants is used for feature extraction, feature selection, classifier training, and model validation. The first approach considers a general set of psychophysiological features across all participants as the input variables and trains a classifier-based model for each participant, resulting in a trust-sensor model based on the general feature set (i.e., a “general trust-sensor model”). The second approach considers a customized feature set for each individual and trains a classifier-based model using that feature set, resulting in improved mean accuracy but at the expense of an increase in training time. This work represents the first use of real-time psychophysiological measurements for the development of a human trust sensor. Implications of the work, in the context of trust management algorithm design for intelligent machines, are also discussed.

Supplementary Material

JPG File (a27-akash.jpg)
MP4 File (a27-akash.mp4)

References

[1]
Kumar Akash, Wan-Lin Hu, Tahira Reid, and Neera Jain. 2017. Dynamic modeling of trust in human-machine interactions. In Proceedings of the American Control Conference.
[2]
Amazon. 2005. Amazon Mechanical Turk. Retrieved from https://www.mturk.com/.
[3]
Hafeez Ullah Amin, Aamir Saeed Malik, Rana Fayyaz Ahmad, Nasreen Badruddin, Nidal Kamel, Muhammad Hussain, and Weng-Tink Chooi. 2015. Feature extraction and classification for EEG signals using wavelet transform and machine learning techniques. Austral. Phys. Eng. Sci. Med. 38, 1 (2015), 139--149.
[4]
Mathias Benedek and Christian Kaernbach. 2010. A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190, 1 (2010), 80--91.
[5]
Chris Berka, Daniel J. Levendowski, Michelle N. Lumicao, Alan Yau, Gene Davis, Vladimir T. Zivkovic, Richard E. Olmstead, Patrice D. Tremoulet, and Patrick L. Craven. 2007. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviat. Space Environ. Med. 78, 5 (2007), B231--B244.
[6]
Herman Blinchikoff and Helen Krause. 1976. Filtering in the Time and Frequency Domains. Noble Publishing.
[7]
Cheryl Boudreau, Mathew D. McCubbins, and Seana Coulson. 2008. Knowing when to trust others: An ERP study of decision making after receiving information from unknown people. Soc. Cogn. Affect. Neurosci. 4, 1 (Nov. 2008), 23--34.
[8]
Fang Chen, Natalie Ruiz, Eric Choi, Julien Epps, M. Asif Khawaja, Ronnie Taib, Bo Yin, and Yang Wang. 2012. Multimodal behavior and interaction as indicators of cognitive load. ACM Trans. Interact. Intell. Syst. 2, 4 (Dec. 2012), 1--36.
[9]
Caroline Dussault, Jean-Claude Jouanin, Matthieu Philippe, and Charles-Yannick Guezennec. 2005. EEG and ECG changes during simulator operation reflect mental workload and vigilance. Aviat. Space Environ. Med. 76, 4 (2005).
[10]
Todd C. Handy. 2005. Event-related Potentials: A Methods Handbook. MIT Press.
[11]
Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition. Springer, New York.
[12]
Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Hum. Fact.: J. Hum. Fact. Ergonom. Soc. 57, 3 (2015), 407--434.
[13]
Wan-Lin Hu, Kumar Akash, Neera Jain, and Tahira Reid. 2016. Real-time sensing of trust in human-machine interactions. In Proceedings of the 1st IFAC Conference on Cyber-Physical 8 Human-Systems.
[14]
Toshiaki Isotani, Hideaki Tanaka, Dietrich Lehmann, Roberto D. Pascual-Marqui, Kieko Kochi, Naomi Saito, Takami Yagyu, Toshihiko Kinoshita, and Kyohei Sasada. 2001. Source localization of EEG activity during hypnotically induced anxiety and relaxation. Int. J. Psychophysiol. 41, 2 (2001), 143--153.
[15]
Sue C. Jacobs, Richard Friedman, John D. Parker, Geoffrey H. Tofler, Alfredo H. Jimenez, James E. Muller, Herbert Benson, and Peter H. Stone. 1994. Use of skin conductance changes during mental stress testing as an index of autonomic arousal in cardiovascular research. Amer. Heart J. 128, 6 (1994), 1170--1177.
[16]
Norbert Jaušovec and Ksenija Jaušovec. 2000. EEG activity during the performance of complex mental problems. Int. J. Psychophysiol. 36, 1 (2000), 73--88.
[17]
Nicholas R. Jennings, Luc Moreau, David Nicholson, Sarvapali Ramchurn, Stephen Roberts, Tom Rodden, and Alex Rogers. 2014. Human-agent collectives. Commun. ACM 57, 12 (Nov. 2014), 80--88.
[18]
Catholijn M. Jonker and Jan Treur. 1999. Formal Analysis of Models for the Dynamics of Trust Based on Experiences. Springer, Berlin, 221--231.
[19]
Ahmad Khawaji, Jianlong Zhou, Fang Chen, and Nadine Marcus. 2015. Using galvanic skin response (GSR) to measure trust and cognitive load in the text--chat environment. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM Press, 1989--1994.
[20]
Kenji Kira and Larry A. Rendell. 1992. A practical approach to feature selection. In Proceedings of the 9th International Workshop on Machine Learning. 249--256.
[21]
Ron Kohavi and George H. John. 1997. Wrappers for feature subset selection. Artific. Intell. 97, 1 (1997), 273--324.
[22]
Igor Kononenko, Edvard Šimec, and Marko Robnik-Šikonja. 1997. Overcoming the myopia of inductive learning algorithms with RELIEFF. Appl. Intell. 7, 1 (1997), 39--55.
[23]
John Lee and Neville Moray. 1992. Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35, 10 (1992), 1243--1270.
[24]
John D. Lee and Katrina A. See. 2004. Trust in automation: Designing for appropriate reliance. Hum. Fact.: J. Hum. Fact. Ergonom. Soc. 46, 1 (2004), 50--80.
[25]
W. J. Levy. 1987. Effect of epoch length on power spectrum analysis of the EEG. Anesthesiology 66, 4 (Apr. 1987), 489--495.
[26]
Christophe Leys, Christophe Ley, Olivier Klein, Philippe Bernard, and Laurent Licata. 2013. Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. J. Exp. Soc. Psychol. 49, 4 (2013), 764--766.
[27]
Yun Long, Xiaoming Jiang, and Xiaolin Zhou. 2012. To believe or not to believe: Trust choice modulates brain responses in outcome evaluation. Neuroscience 200 (2012), 50--58.
[28]
F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi. 2007. A review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 4, 2 (2007), R1.
[29]
Qingguo Ma, Liang Meng, and Qiang Shen. 2015. You have my word: Reciprocity expectation modulates feedback-related negativity in the trust game. PLoS One 10, 2 (Feb. 2015), 1--10.
[30]
Mathworks. 2016. Statistics and Machine Learning Toolbox: User’s Guide. Retrieved from https://www.mathworks.com/help/pdf_doc/stats/stats.pdf.
[31]
Dennis J. McFarland, Charles W. Anderson, K. Muller, Alois Schlogl, and Dean J. Krusienski. 2006. BCI meeting 2005-workshop on BCI signal processing: Feature extraction and translation. IEEE Trans. Neural Syst. Rehab. Eng. 14, 2 (2006), 135.
[32]
Bonnie M. Muir. 1987. Trust between humans and machines, and the design of decision aids. Int. J. Man-Mach. Studies 27, 5--6 (1987), 527--539.
[33]
Reiner Nikula. 1991. Psychological correlates of nonspecific skin conductance responses. Psychophysiology 28, 1 (1991), 86--90.
[34]
William D. Penny, Stephen J. Roberts, Eleanor A. Curran, and Maria J. Stokes. 2000. EEG-based communication: A pattern recognition approach. IEEE Trans. Rehab. Eng. 8, 2 (2000), 214--215.
[35]
Gert Pfurtscheller, Doris Flotzinger, and Joachim Kalcher. 1993. Brain-computer interface—A new communication device for handicapped persons. J. Microcomput. Appl. 16, 3 (1993), 293--299.
[36]
P. Pudil, J. Novovičová, and J. Kittler. 1994. Floating search methods in feature selection. Pattern Recogn. Lett. 15, 11 (1994), 1119--1125.
[37]
William J. Ray and Harry W. Cole. 1985. EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Science 228, 4700 (1985), 750--752.
[38]
René Riedl, Marco Hubert, and Peter Kenning. 2010. Are there neural gender differences in online trust? An fMRI study on the perceived trustworthiness of eBay offers. Manage. Info. Syst. Quart. 34, 2 (2010), 397--428.
[39]
René Riedl and Andrija Javor. 2012. The biology of trust: Integrating evidence from genetics, endocrinology, and functional brain imaging.J. Neurosci. Psychol. Econ. 5, 2 (2012), 63.
[40]
Stefania Righi, Luciano Mecacci, and Maria P. Viggiano. 2009. Anxiety, cognitive self--evaluation and performance: ERP correlates. J. Anxiety Disord. 23, 8 (2009), 1132--1138.
[41]
Thomas B. Sheridan and Raja Parasuraman. 2005. Human-automation interaction. Rev. Hum. Fact. Ergonom. 1, 1 (2005), 89--129.
[42]
D. Sundararajan. 2016. Discrete Wavelet Transform: A Signal Processing Approach. Wiley.
[43]
Yue Wang and Fumin Zhang. 2017. Trends in Control and Decision-Making for Human--Robot Collaboration Systems. Springer.
[44]
Jianlong Zhou, Jinjun Sun, Fang Chen, Yang Wang, Ronnie Taib, Ahmad Khawaji, and Zhidong Li. 2015. Measurable decision making with GSR and pupillary analysis for intelligent user interface. ACM Trans. Comput.-Hum. Interact. 21, 6, Article 33 (Jan. 2015).

Cited By

View all
  • (2025)Bridging the gap: understanding the factors affecting pedestrian safety perceptions in the age of driverless vehiclesTraffic Safety Research10.55329/pjax71959(e000080)Online publication date: 1-Jan-2025
  • (2025)Assessing Physiological Signal Utility and Sensor Burden in Estimating Trust, Situation Awareness, and Mental WorkloadJournal of Cognitive Engineering and Decision Making10.1177/15553434241310084Online publication date: 4-Jan-2025
  • (2024)Modelling and Measuring Trust in Human–Robot CollaborationApplied Sciences10.3390/app1405191914:5(1919)Online publication date: 26-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems
ACM Transactions on Interactive Intelligent Systems  Volume 8, Issue 4
December 2018
159 pages
ISSN:2160-6455
EISSN:2160-6463
DOI:10.1145/3292532
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2018
Accepted: 01 July 2017
Revised: 01 June 2017
Received: 01 December 2016
Published in TIIS Volume 8, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. EEG
  2. GSR
  3. Trust in automation
  4. classifiers
  5. human-machine interaction
  6. intelligent system
  7. modeling
  8. psychophysiological measurement

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)684
  • Downloads (Last 6 weeks)85
Reflects downloads up to 16 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Bridging the gap: understanding the factors affecting pedestrian safety perceptions in the age of driverless vehiclesTraffic Safety Research10.55329/pjax71959(e000080)Online publication date: 1-Jan-2025
  • (2025)Assessing Physiological Signal Utility and Sensor Burden in Estimating Trust, Situation Awareness, and Mental WorkloadJournal of Cognitive Engineering and Decision Making10.1177/15553434241310084Online publication date: 4-Jan-2025
  • (2024)Modelling and Measuring Trust in Human–Robot CollaborationApplied Sciences10.3390/app1405191914:5(1919)Online publication date: 26-Feb-2024
  • (2024)Implementing social and affective touch to enhance user experience in human-robot interactionFrontiers in Robotics and AI10.3389/frobt.2024.140367911Online publication date: 12-Aug-2024
  • (2024)A survey of communicating robot learning during human-robot interactionThe International Journal of Robotics Research10.1177/02783649241281369Online publication date: 7-Oct-2024
  • (2024)"Uh, This One?": Leveraging Behavioral Signals for Detecting Confusion during Physical TasksProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685727(194-203)Online publication date: 4-Nov-2024
  • (2024)Do Humans Trust Robots that Violate Moral Trust?ACM Transactions on Human-Robot Interaction10.1145/365199213:2(1-30)Online publication date: 14-Jun-2024
  • (2024)Operationally Realistic Human-Autonomy Teaming Task Simulation to Study Multi-Dimensional TrustCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640693(1028-1032)Online publication date: 11-Mar-2024
  • (2024)DualTake: Predicting Takeovers across Mobilities for Future Personalized Mobility ServicesCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640610(1194-1198)Online publication date: 11-Mar-2024
  • (2024) Investigating Electrodermal Activity for Trust Assessment in Industrial Human-Robot Collaboration * 2024 21st International Conference on Ubiquitous Robots (UR)10.1109/UR61395.2024.10597471(880-885)Online publication date: 24-Jun-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media