Article

A Supervisor Αgent-Based on the Markovian Decision Process Framework to Optimize the Behavior of a Highly Automated System

Authors:

M. Karimshoushtari,

F. TangoAuthors Info & Claims

Augmented Cognition: 15th International Conference, AC 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings

Pages 351 - 368

https://doi.org/10.1007/978-3-030-78114-9_24

Published: 24 July 2021 Publication History

Abstract

In this paper, we explore how MDP can be used as the framework to design and develop an Intelligent Decision Support System/Recommender System, in order to extend human perception and overcome human senses limitations (because covered by the ADS), by augmenting human cognition, emphasizing human judgement and intuition, as well as supporting him/her to take the proper decision in the right terms and time.

Moreover, we develop Human-Machine Interaction (HMI) strategies able to make “transparent” the decision-making/recommendation process. This is strongly needed, since the adoption of partial automated systems is not only connected to the effectiveness of the decision and control processes, but also relies on how these processes are communicated and “explained” to the human driver, in order to achieve his/her trust.

References

[1]

Rasmussen J Human errors. A taxonomy for describing human malfunction in industrial installations J. Occup. Accid. 1982 4 2–4 311-333

[2]

Siau K and Wang W Building trust in artificial intelligence, machine learning, and robotics Cutter Bus. Technol. J. 2018 31 2 47-53

[3]

Puterman ML Markov Decision Processes. Discrete Stochastic Dynamic Programming 2005 Chichester Wiley

[4]

Jean Piaget’s Theory and Stages of Cognitive Development, by Saul McLeod, Simply Psychology. Accessed 2018

[5]

Michon JA Evans L and Schwing RC A critical view of driver behavior models: what do we know, what should we do? Human Behavior and Traffic Safety 1986 Boston, MA Springer US 485-524

[6]

Tango F, Aras R, and Pietquin O Cacciabue PC, Hjälmdahl Magnus, Luedtke Andreas, and Riccioli Costanza Learning Optimal Control Strategies from Interactions with a PADAS Human Modelling in Assisted Transportation 2011 Milano Springer Milan 119-127

[7]

Ricci F, Rokach L, and Shapira B Ricci F, Rokach L, Shapira B, and Kantor PB Introduction to recommender systems handbook Recommender Systems Handbook 2011 Boston, MA Springer 1-35

[8]

Fayyaz Z, Ebrahimian M, Nawara D, Ibrahim A, and Kashef R Recommendation systems: algorithms, challenges, metrics, and business opportunities Appl. Sci. 2020 10 21 7748

[9]

Beel, J., Langer, S., Genzmehr, M., Gipp, B., Breitinger, C., Nürnberger, A.: Research paper recommender system evaluation: a quantitative literature survey. In: Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation, Hong Kong, China, 12 October (2013), pp. 15–22 (2013)

[10]

Carsten O and Martens MH How can humans understand their automated cars? HMI principles, problems and solutions Cogn. Technol. Work 2018 21 1 3-20

[11]

Sharma A et al. Is an informed driver a better decision maker? a grouped random parameter with heterogeneity-in-means approach to investigate the impact of the connected environment on driving behavior in safety-critical situations Anal. Meth. Accid. Res. 2020 27 100127

[12]

Castellano, A., et al.: Is your request just this? New automation paradigm to reduce the requests of transition without increasing the effort of the driver. In: 25th ITS World Congress. Copenhagen, Denmark, vol. 17 (2018)

[13]

Gowda, N., Ju, W., Kohler, K.: Dashboard design for an autonomous car. In: Adjunct Proceedings of the 6th International Conference on Automotive user Interfaces and Interactive Vehicular Applications (2014)

[14]

Ju W The design of implicit interactions Synth. Lect. Hum.-Centered Inf. 2015 8 2 1-93

[15]

Findeisen, R., Allgower, F., Biegel, L.: Assessment and future directions of nonlinear model predictive control. In: Lecture Notes in Control and Information Sciences. Springer (2007).

[16]

Grune, L., Pannek, J.: Nonlinear model predictive control - theory and algorithms. In: Communications and control engineering. Springer (2011)

Cited By

Maiuri CKarimshoushtari MTango FNovara C(2023)Application of Reinforcement Learning for Intelligent Support Decision System: A Paradigm Towards Safety and ExplainabilityArtificial Intelligence in HCI10.1007/978-3-031-35891-3_15(243-261)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35891-3_15

Recommendations

Percentiles and markovian decision processes

In a Markovian Decision Process in which the rewards are ordinal rather than cardinal, the decision-maker may be interested in a policy attaining desirable outcomes 'sufficiently' often. Here we define such policies more precisely and point out that ...
Decision making process: typology, intelligence, and optimization

Decision making is concerned with evaluating and/or ranking possible alternatives of action. In this paper, we develop a model for the process of decision making. Understanding the decision process can provide insights into how humans make decisions, ...
Assessing the Impact of Alerts on the Human Supervisor’s Decision-Making Performance in Multi-Robot Missions
Multi-robot teams can be very useful in a wide variety of search and rescue missions in challenging environments. In a mission with considerable uncertainty due to intermittent communications, degraded information flow, and failures, humans need to assess ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

Augmented Cognition: 15th International Conference, AC 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings

Jul 2021

495 pages

ISBN:978-3-030-78113-2

DOI:10.1007/978-3-030-78114-9

Editors:
Dylan D. Schmorrow
Soar Technology Inc., Orlando, FL, USA
,
Cali M. Fidopiastis
Design Interactive, Inc., Orlando, FL, USA

© Springer Nature Switzerland AG 2021.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 24 July 2021

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Maiuri CKarimshoushtari MTango FNovara C(2023)Application of Reinforcement Learning for Intelligent Support Decision System: A Paradigm Towards Safety and ExplainabilityArtificial Intelligence in HCI10.1007/978-3-031-35891-3_15(243-261)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35891-3_15

View Options

View options

Media

Figures

Other

Tables

View Table of Contents