short-paper

Open access

A Cautionary Tale About AI-Generated Goal Suggestions

Authors:

Jugoslav Stojcheski,

Saksham Consul,

Viktoria Pammer-SchindlerAuthors Info & Claims

MuC '22: Proceedings of Mensch und Computer 2022

Pages 354 - 359

https://doi.org/10.1145/3543758.3547539

Published: 15 September 2022 Publication History

All formats PDF

Abstract

Setting the right goals and prioritizing them might be the most crucial and the most challenging type of decisions people make for themselves, their teams, and their organizations. In this article, we explore whether it might be possible to leverage artificial intelligence (AI) to help people set better goals and which potential problems might arise from such applications. We devised the first prototype of an AI-powered digital goal-setting assistant and a rigorous empirical paradigm for assessing the quality of AI-generated goal suggestions. Our empirical paradigm compares the AI-generated goal suggestions against randomly-generated goal suggestions and unassisted goal-setting on a battery of self-report measures of important goal characteristics, motivation, and usability in a large-scale repeated-measures online experiment. The results of an online experiment with 259 participants revealed that our intuitively compelling goal suggestion algorithm was actively harmful to the quality of the people’s goals and their motivation to pursue them. These surprising findings highlight three crucial problems to be tackled by future work on leveraging AI to help people set better goals: i) aligning the objective function of the AI algorithms with the design goals, ii) helping people quantify how valuable different goals are to them, and iii) preserving the user’s sense of autonomy.

References

[1]

Yossi Aviv and Amit Pazgal. 2005. A partially observed Markov decision process for dynamic pricing. Management science 51, 9 (2005), 1400–1416. https://doi.org/10.1287/mnsc.1050.0393

Digital Library

[2]

Laura Aymerich-Franch and Iliana Ferrer. 2022. Investigating the use of speech-based conversational agents for life coaching. International Journal of Human-Computer Studies 159 (2022), 102745. https://doi.org/10.1016/j.ijhcs.2021.102745

Digital Library

[3]

Shalabh Bhatnagar, Emmanuel Fernández-Gaucherand, Michael C Fu, Ying He, and Steven I Marcus. 1999. A Markov decision process model for capacity expansion and allocation. In Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No. 99CH36304), Vol. 2. IEEE, IEEE, Phoenix, AZ, USA, 1380–1385. https://doi.org/10.1109/CDC.1999.830146

[4]

Brian Christian. 2020. The alignment problem: Machine learning and human values. WW Norton & Company, New York, USA.

[5]

Saksham Consul, Jugoslav Stojcheski, Valkyrie Felso, and Falk Lieder. 2021. Optimal To-Do List Gamification for Long Term Planning. arXiv preprint arXiv:2109.06505 0, 0 (2021), 1–30.

[6]

Edward L Deci and Richard M Ryan. 2012. Self-determination theory.In Handbook of theories of social psychology, P. A. M. Van Lange, A. W. Kruglanski, and E. T. Higgins (Eds.). Sage Publications Ltd, London, UK, 416–436. https://doi.org/10.4135/9781446249215.n21

[7]

Jiahui Du, Weijiao Huang, and Khe Foon Hew. 2021. Supporting students goal setting process using chatbot: implementation in a fully online course. In 2021 IEEE International Conference on Engineering, Technology & Education (TALE). IEEE, IEEE, Wuhan, China, 35–41. https://doi.org/10.1109/TALE52509.2021.9678564

[8]

David Fetherstonhaugh, Paul Slovic, Stephen Johnson, and James Friedrich. 1997. Insensitivity to the value of human life: A study of psychophysical numbing. Journal of Risk and uncertainty 14, 3 (1997), 283–300. https://doi.org/10.1023/A:1007744326393

[9]

Adam Maria Gadomski, Sandro Bologna, Giovanni Di Costanzo, Anna Perini, and Marco Schaerf. 2001. Towards intelligent decision support systems for emergency managers: the IDA approach. International Journal of Risk Assessment and Management 2, 3-4(2001), 224–242. https://doi.org/10.1504/IJRAM.2001.001507

[10]

Hernan Gonzalez Cruz, Mike Prentice, and Falk Lieder. 2021. ’What Do You Want in Life and How Can You Get There?’ An Evaluation of a Hierarchical Goal-Setting Chatbot. Abstract of presentation at the 13th SSM Virtual Congress. In 13th Annual meeting of the Society for the Science of Motivation. Society for the Science of Motivation, Virtual Congress, 3.

[11]

Gabriela Yukari Iwama, Felix Weber, Mike Prentice, and Falk Lieder. 2021. Development and Validation of a Goal Characteristics Questionnaire. OSF Preprints 0, 0 (2021), 1–61.

[12]

D. Kahneman and A. Tversky. 1979. Intuitive prediction: biases and corrective procedures. TIMS Studies in Management Science 12 (1979), 313–327. Issue 12.

[13]

Sebastian Krakowski. 2021. Artificial Intelligence and Business Ethics: Goal Setting and Value Alignment as Management Concerns. In Academy of Management Proceedings, Vol. 2021. Academy of Management Briarcliff Manor, NY 10510, Academy of Management, New York, USA, 14636. https://doi.org/10.5465/AMBPP.2021.14636abstract

[14]

Falk Lieder, Owen X Chen, Paul M Krueger, and Thomas L Griffiths. 2019. Cognitive prostheses for goal achievement. Nature human behaviour 3, 10 (2019), 1096–1106. https://doi.org/10.1038/s41562-019-0672-9

[15]

Falk Lieder and Tom Griffiths. 2016. Helping people make better decisions using optimal gamification. In CogSci 2016. Cognitive Science Society, Philadelphia, Pennsylvania, 2075–2080.

[16]

Brian R Little, Katariina Salmela-Aro, and Susan D Phillips. 2017. Personal project pursuit: Goals, action, and human flourishing. Psychology Press, Washington DC, USA.

[17]

John G Lynch Jr, Richard G Netemeyer, Stephen A Spiller, and Alessandra Zammit. 2010. A generalizable scale of propensity to plan: The long and the short of planning for time and for money. Journal of consumer research 37, 1 (2010), 108–128. https://doi.org/10.1086/649907

[18]

Michael Minge, Manfred Thüring, Ingmar Wagner, and Carina V Kuhr. 2017. The meCUE questionnaire: a modular tool for measuring user experience. In Advances in Ergonomics Modeling, Usability & Special Populations, M. Soares, C. Falcao, and T. Z. Ahram (Eds.). Springer, Florida, USA, 115–128. https://doi.org/10.1007/978-3-319-41685-4_11

[19]

Luiz Guilherme Nadal Nunes, Solon Venancio de Carvalho, and Rita de Cássia Meneses Rodrigues. 2009. Markov decision process applied to the control of hospital elective admissions. Artificial intelligence in medicine 47, 2 (2009), 159–171. https://doi.org/10.1016/j.artmed.2009.07.003

Digital Library

[20]

Stuart Russell. 2019. Human compatible: Artificial intelligence and the problem of control. Penguin, New York, USA.

[21]

Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, 2020. Mastering atari, go, chess and shogi by planning with a learned model. Nature 588, 7839 (2020), 604–609. https://doi.org/10.1038/s41586-020-03051-4

[22]

Kennon M Sheldon, Andrew J Elliot, Richard M Ryan, Valery Chirkov, Youngmee Kim, Cindy Wu, Meliksah Demir, and Zhigang Sun. 2004. Self-concordance and subjective well-being in four cultures. Journal of cross-cultural psychology 35, 2 (2004), 209–223. https://doi.org/10.1177/0022022103262245

[23]

David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, 2017. Mastering the game of go without human knowledge. nature 550, 7676 (2017), 354–359. https://doi.org/10.1038/nature24270

[24]

Haili Song, C-C Liu, Jacques Lawarrée, and Robert W Dahlgren. 2000. Optimal electricity supply bidding by Markov decision process. IEEE transactions on power systems 15, 2 (2000), 618–624. https://doi.org/10.1109/59.867150

[25]

Jugoslav Stojcheski, Valkyrie Felso, and Falk Lieder. 2020. Optimal to-do list gamification. arXiv preprint arXiv:2008.05228 0, 0 (2020), 1–29.

Cited By

Lieder FChen PPrentice MAmo VTošić M(2024)Gamification of Behavior Change: Mathematical Principle and Proof-of-Concept StudyJMIR Serious Games10.2196/4307812(e43078)Online publication date: 22-Mar-2024
https://doi.org/10.2196/43078
Cha S(2024)Towards an international regulatory framework for AI safety: lessons from the IAEA’s nuclear safety regulationsHumanities and Social Sciences Communications10.1057/s41599-024-03017-111:1Online publication date: 12-Apr-2024
https://doi.org/10.1057/s41599-024-03017-1

Index Terms

A Cautionary Tale About AI-Generated Goal Suggestions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Goal-setting considerations for persuasive technologies that encourage physical activity
Persuasive '09: Proceedings of the 4th International Conference on Persuasive Technology

Goal-setting has been shown to be an effective strategy for changing behavior; therefore employing goal-setting in persuasive technologies could be an effective way to encourage behavior change. In our work, we are developing persuasive technologies to ...
Should you always have a backup? One vs. two goals in games

Number of goals does not have direct relationship with performance.People with two goals had higher self-appraisals of performance and played longer.Of those with two goals, a high percentage of people stopped after achieving their backup goal. Goal ...
Formative Evaluation of a Tablet Application to Support Goal-Oriented Care in Community-Dwelling Older Adults
MHCI

Tools that can help older adults self-manage multiple health goals in collaboration with their care managers are rare to find. Informed by the Self-Determination Theory, Goal-Oriented Care paradigm and our prior findings, we used an iterative, user-...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '22: Proceedings of Mensch und Computer 2022

September 2022

624 pages

ISBN:9781450396905

DOI:10.1145/3543758

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2022

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

MuC '22

MuC '22: Mensch und Computer 2022

September 4 - 7, 2022

Darmstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
562
Total Downloads

Downloads (Last 12 months)322
Downloads (Last 6 weeks)31

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lieder FChen PPrentice MAmo VTošić M(2024)Gamification of Behavior Change: Mathematical Principle and Proof-of-Concept StudyJMIR Serious Games10.2196/4307812(e43078)Online publication date: 22-Mar-2024
https://doi.org/10.2196/43078
Cha S(2024)Towards an international regulatory framework for AI safety: lessons from the IAEA’s nuclear safety regulationsHumanities and Social Sciences Communications10.1057/s41599-024-03017-111:1Online publication date: 12-Apr-2024
https://doi.org/10.1057/s41599-024-03017-1

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents