Abstract
Ethics in decision-making reflects traits such as transparency, equity, and trust. However, when considering ethics in the decision-making process of autonomous agents, the significant challenge is how autonomous agents should interact to reach an agreement, knowing that their ethical preferences may differ. On that account, this study explores two fields to propose an approach to ethical decision-making: automated negotiation, the field concerning interaction among multiple agents to reach an agreement, and machine ethics, the field concerned with adding or ensuring moral behaviors from agents. Although agents can negotiate and decide on a solution automatically, whether they can propose an ethically correct decision is still a subject matter. To this end, this study proposes the concept of introducing ethics in the decision-making process of intelligent agents for ethical decision-making. In particular, we propose a research framework that addresses how user ethical preferences can be converted into quantifiable measures and further used by autonomous agents during negotiation for ethical decision-making.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Alfieri, C., Donati, D., Gozzano, S., Greco, L., Segala, M.: Ethical preferences in the digital world: the EXOSOUL questionnaire. In: HHAI 2023: Augmenting Human Intellect, pp. 290–299. IOS Press (2023)
Alfieri, C., Inverardi, P., Migliarini, P., Palmiero, M.: Exosoul: ethical profiling in the digital world. In: HHAI2022: Augmenting Human Intellect, pp. 128–142. IOS Press (2022)
Autili, M., Ruscio, D.D., Inverardi, P., Pelliccione, P., Tivoli, M.: A software exoskeleton to protect and support citizen’s ethics and privacy in the digital world. IEEE Access 7, 62011–62021 (2019). https://doi.org/10.1109/ACCESS.2019.2916203
Awad, E., et al.: The moral machine experiment. Nature 563(7729), 59–64 (2018)
Baarslag, T., Hendrikx, M.J., Hindriks, K.V., Jonker, C.M.: Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques. Auton. Agents Multi-Agent Syst. 30(5), 849–898 (2016)
Baarslag, T., Kaisers, M.: The value of information in automated negotiation: a decision model for eliciting user preferences. In: Proceedings of the 16th Conference on Autonomous Agents and Multiagent Systems, pp. 391–400 (2017)
Bachrach, Y., et al.: Negotiating team formation using deep reinforcement learning. Artif. Intell. 288, 103356 (2020)
Bagga, P., Paoletti, N., Stathis, K.: Deep learnable strategy templates for multi-issue bilateral negotiation. In: Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, pp. 1533–1535 (2022)
Bogosian, K.: Implementation of moral uncertainty in intelligent machines. Minds Mach. 27(4), 591–608 (2017)
Bostrom, N., Yudkowsky, E.: The ethics of artificial intelligence. In: Artificial Intelligence Safety and Security, pp. 57–69. Chapman and Hall/CRC (2018)
Buiten, M.C.: Towards intelligent regulation of artificial intelligence. Eur. J. Risk Regul. 10(1), 41–59 (2019)
Cardoso, R.C., Ferrando, A., Dennis, L.A., Fisher, M.: Implementing ethical governors in BDI. In: Alechina, N., Baldoni, M., Logan, B. (eds.) EMAS 2021. Lecture Notes in Computer Science, vol. 13190, pp. 22–41. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-97457-2_2
Chen, S., Weiss, G.: Automated negotiation: an efficient approach to interaction among agents. In: Interactions in Multiagent Systems, pp. 149–177. World Scientific (2019)
Floridi, L.: Soft ethics and the governance of the digital. Philos. Technol. 31(1), 1–8 (2018)
Floridi, L.: Establishing the rules for building trustworthy AI. Nat. Mach. Intell. 1(6), 261–262 (2019)
Guarini, M.: Introduction: machine ethics and the ethics of building intelligent machines. Topoi 32(2), 213–215 (2013)
Hoen, P.J., Tuyls, K., Panait, L., Luke, S., La Poutré, J.A.: An overview of cooperative and competitive multiagent learning. In: Tuyls, K., Hoen, P.J., Verbeeck, K., Sen, S. (eds.) LAMAS 2005. LNCS (LNAI), vol. 3898, pp. 1–46. Springer, Heidelberg (2006). https://doi.org/10.1007/11691839_1
Hu, J., Deng, L.: An association rule-based bilateral multi-issue negotiation model. In: 2011 Fourth International Symposium on Computational Intelligence and Design, vol. 2, pp. 234–237. IEEE (2011)
Inverardi, P., Palmiero, M., Pelliccione, P., Tivoli, M.: Ethical-aware autonomous systems from a social psychological lens. In: Proceedings of the 6th International Workshop on Cultures of Participation in the Digital Age: AI for Humans or Humans for AI? CEUR Workshop Proceedings, vol. 3136, pp. 43–48 (2022)
Kiruthika, U., Somasundaram, T.S., Raja, S.: Lifecycle model of a negotiation agent: a survey of automated negotiation techniques. Group Decis. Negot. 29(6), 1239–1262 (2020)
Kraus, S.: Agents that negotiate proficiently with people. In: Salerno, J., Yang, S.J., Nau, D., Chai, S.-K. (eds.) SBP 2011. LNCS, vol. 6589, pp. 137–137. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19656-0_21
Liao, B., Slavkovik, M., van der Torre, L.: Building jiminy cricket: an architecture for moral agreements among stakeholders. In: AAAI Conference on AI, Ethics, and Society, pp. 147–153 (2019)
Mahan, F., Isazadeh, A., Khanli, L.M.: Using an active fuzzy ECA rule-based negotiation agent in e-commerce. Int. J. Electr. Commer. Stud. 2(2), 127–148 (2011)
Memon, M.A., Scoccia, G.L., Inverardi, P., Autili, M.: Don’t you agree with my ethics? let’s negotiate! In: Augmenting Human Intellect - Proceedings of the Second International Conference on Hybrid Human-Artificial Intelligence (HHAI). Frontiers in Artificial Intelligence and Applications, vol. 368, pp. 385–388. IOS Press (2023)
Mohammadi Ashnani, F., Movahedi, Z., Fouladi, K.: Modeling opponent strategy in multi-issue bilateral automated negotiation using machine learning. Int. J. Web Res. 3(2), 16–25 (2020)
Moor, J.H.: The nature, importance, and difficulty of machine ethics. IEEE Intell. Syst. 21(4), 18–21 (2006)
Nallur, V., Collier, R.: Ethics by agreement in multi-agent software systems. In: 14th International Conference on Software Technologies, Prague, Czech Republic, 26–28 July 2019, pp. 529–535. SCITEPRESS (2019)
Picard, R.W.: Affective Computing. MIT press, Cambridge (2000)
Ryan, M., Stahl, B.C.: Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications. J. Inf. Commun. Ethics Soc. 19(1), 61–86 (2020)
Totschnig, W.: Fully autonomous AI. Sci. Eng. Ethics 26(5), 2473–2485 (2020)
Wu, L., Chen, S., Gao, X., Zheng, Y., Hao, J.: Detecting and learning against unknown opponents for automated negotiations. In: Pham, D.N., Theeramunkong, T., Governatori, G., Liu, F. (eds.) PRICAI 2021. LNCS (LNAI), vol. 13033, pp. 17–31. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-89370-5_2
Zuckerman, I., Rosenfeld, A., Kraus, S., Segal-Halevi, E.: Towards automated negotiation agents that use chat interfaces. In: The Sixth International Workshop on Agent-Based Complex Automated Negotiations (ACAN) (2013)
Acknowledgements
The authors would like to thank the entire multidisciplinary team of the EXOSOUL@univaq project for enlightening debates and joint work on digital ethics for autonomous systems.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Memon, M.A. (2023). A Brief Overview of an Approach Towards Ethical Decision-Making. In: Malvone, V., Murano, A. (eds) Multi-Agent Systems. EUMAS 2023. Lecture Notes in Computer Science(), vol 14282. Springer, Cham. https://doi.org/10.1007/978-3-031-43264-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-43264-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43263-7
Online ISBN: 978-3-031-43264-4
eBook Packages: Computer ScienceComputer Science (R0)