Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3643834.3660720acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article
Open access

Generative AI in User Experience Design and Research: How Do UX Practitioners, Teams, and Companies Use GenAI in Industry?

Published: 01 July 2024 Publication History

Abstract

User Experience (UX) practitioners, like UX designers and researchers, have begun to adopt Generative Artificial Intelligence (GenAI) tools into their work practices. However, we lack an understanding of how UX practitioners, UX teams, and companies actually utilize GenAI and what challenges they face. We conducted interviews with 24 UX practitioners from multiple companies and countries, with varying roles and seniority. Our findings include: 1) There is a significant lack of GenAI company policies, with companies informally advising caution or leaving the responsibility to individual employees; 2) UX teams lack team-wide GenAI practices. UX practitioners typically use GenAI individually, favoring writing-based tasks, but note limitations for design-focused activities, like wireframing and prototyping; 3) UX practitioners call for better training on GenAI to enhance their abilities to generate effective prompts and evaluate output quality. Based on our findings, we provide recommendations for GenAI integration in the UX sector.

References

[1]
Abdallah M. H. Abbas, Khairil Imran Ghauth, and Choo-Yee Ting. 2022. User Experience Design Using Machine Learning: A Systematic Review. IEEE Access 10 (2022), 51501–51514. https://doi.org/10.1109/ACCESS.2022.3173289
[2]
Ahmed Al-sa’di and Dave Miller. 2023. Exploring the Impact of Artificial Intelligence language model ChatGPT on the User Experience. International Journal of Technology, Innovation and Management (IJTIM) 3, 1 (May 2023), 1–8. https://doi.org/10.54489/ijtim.v3i1.195
[3]
James T. Allison, Michel-Alexandre Cardin, Chris McComb, Max Yi Ren, Daniel Selva, Conrad Tucker, Paul Witherell, and Yaoyao Fiona Zhao. 2022. Special Issue: Artificial Intelligence and Engineering Design. Journal of mechanical design (1990) 144, 2 (2022).
[4]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[5]
J. An, H. Kwak, S. Jung, J. Salminen, M. Admad, and B. Jansen. 2018. Imaginary People Representing Real Numbers: Generating Personas from Online Social Media Data. ACM Trans. Web 12, 4, Article 27 (nov 2018), 26 pages. https://doi.org/10.1145/3265986
[6]
Batuhan Asiroglu, Busta Rumeysa Mete, Eyyup Yildiz, Yagiz Nalcakan, Alper Sezen, Mustafa Dagtekin, and Tolga Ensari. 2019. Automatic HTML Code Generation from Mock-Up Images Using Machine Learning Techniques. In 2019 Scientific Meeting on Electrical-Electronics & Biomedical Engineering and Computer Science (EBBT). IEEE, 1–4.
[7]
Maxim Bakaev, Sebastian Heil, Vladimir Khvorostov, and Martin Gaedke. 2023. How Many Data Does Machine Learning in Human–Computer Interaction Need?: Re-Estimating the Dataset Size for Convolutional Neural Network-Based Models of Visual Perception. IT Professional 25, 2 (2023), 23–29. https://doi.org/10.1109/MITP.2023.3262923
[8]
Nagadivya Balasubramaniam, Marjo Kauppinen, Kari Hiekkanen, and Sari Kujala. 2022. Transparency and Explainability of AI Systems: Ethical Guidelines in Practice. In Requirements Engineering: Foundation for Software Quality, Vincenzo Gervasi and Andreas Vogelsang (Eds.). Springer International Publishing, Cham, 3–18.
[9]
Sam Bourgault and Jane E. 2023. Exploring the Horizon of Computation for Creativity. XRDS 29, 4 (jun 2023), 6–9. https://doi.org/10.1145/3596921
[10]
Daniel Buschek, Charlotte Anlauff, and Florian Lachner. 2020. Paper2Wire: a case study of user-centred development of machine learning tools for UX designers. In Proceedings of Mensch Und Computer 2020 (Magdeburg, Germany) (MuC ’20). Association for Computing Machinery, New York, NY, USA, 33–41. https://doi.org/10.1145/3404983.3405506
[11]
James Cabrera. 2017. Modular design frameworks: A projects-based guide for UI/UX designers. Springer.
[12]
Marivi Carlton. 2019. Design + UX Research: The case for collaboration and separation. (2019). https://doi.org/@marivi.carlton/design-ux-research-the-case-for-collaboration-and-separation-491ad2164ecb
[13]
Li-Yuan Chiou, Peng-Kai Hung, Rung-Huei Liang, and Chun-Teng Wang. 2023. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 1941–1954. https://doi.org/10.1145/3563657.3596001
[14]
Michael Chromik, Florian Lachner, and Andreas Butz. 2020. ML for UX? - An Inventory and Predictions on the Use of Machine Learning Techniques for UX Research. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI ’20). Association for Computing Machinery, New York, NY, USA, Article 57, 11 pages. https://doi.org/10.1145/3419249.3420163
[15]
Harsh Dave, Sarah Sonje, Jaswantsingh Pardeshi, Sheetal Chaudhari, and Pooja Raundale. 2021. A survey on Artificial Intelligence based techniques to convert User Interface design mock-ups to code. In 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS). IEEE, 28–33.
[16]
Nicholas Davis, Chih-Pin Hsiao, Kunwar Yashraj Singh, and Brian Magerko. 2021. Co-Creative Drawing Agent with Object Recognition. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 12, 1 (Jun. 2021), 9–15. https://doi.org/10.1609/aiide.v12i1.12863
[17]
Niraj Ramesh Dayama, Kashyap Todi, Taru Saarelainen, and Antti Oulasvirta. 2020. GRIDS: Interactive Layout Design with Integer Programming. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376553
[18]
Sebastiaan De Peuter, Antti Oulasvirta, and Samuel Kaski. 2023. Toward AI assistants that let designers design. AI Mag. 44, 1 (apr 2023), 85–96. https://doi.org/10.1002/aaai.12077
[19]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 278–288. https://doi.org/10.1145/3025453.3025739
[20]
Yogesh K. Dwivedi, Nir Kshetri, Laurie Hughes, Emma Louise Slade, Anand Jeyaraj, Arpan Kumar Kar, Abdullah M. Baabdullah, Alex Koohang, Vishnupriya Raghavan, Manju Ahuja, Hanaa Albanna, Mousa Ahmad Albashrawi, Adil S. Al-Busaidi, Janarthanan Balakrishnan, Yves Barlette, Sriparna Basu, Indranil Bose, Laurence Brooks, Dimitrios Buhalis, Lemuria Carter, Soumyadeb Chowdhury, Tom Crick, Scott W. Cunningham, Gareth H. Davies, Robert M. Davison, Rahul Dé, Denis Dennehy, Yanqing Duan, Rameshwar Dubey, Rohita Dwivedi, John S. Edwards, Carlos Flavián, Robin Gauld, Varun Grover, Mei-Chih Hu, Marijn Janssen, Paul Jones, Iris Junglas, Sangeeta Khorana, Sascha Kraus, Kai R. Larsen, Paul Latreille, Sven Laumer, F. Tegwen Malik, Abbas Mardani, Marcello Mariani, Sunil Mithas, Emmanuel Mogaji, Jeretta Horn Nord, Siobhan O’Connor, Fevzi Okumus, Margherita Pagani, Neeraj Pandey, Savvas Papagiannidis, Ilias O. Pappas, Nishith Pathak, Jan Pries-Heje, Ramakrishnan Raman, Nripendra P. Rana, Sven-Volker Rehm, Samuel Ribeiro-Navarrete, Alexander Richter, Frantz Rowe, Suprateek Sarker, Bernd Carsten Stahl, Manoj Kumar Tiwari, Wil van der Aalst, Viswanath Venkatesh, Giampaolo Viglia, Michael Wade, Paul Walton, Jochen Wirtz, and Ryan Wright. 2023. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 71 (2023), 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
[21]
Judith E. Fan, Monica Dinculescu, and David Ha. 2019. collabdraw: An Environment for Collaborative Sketching with an Artificial Agent. In Proceedings of the 2019 Conference on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 556–561. https://doi.org/10.1145/3325480.3326578
[22]
Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong. 2020. VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 343–352. https://doi.org/10.1109/TVCG.2019.2934797
[23]
Mingming Fan, Xianyou Yang, TszTung Yu, Q. Vera Liao, and Jian Zhao. 2022. Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization. Proceedings of the ACM on human-computer interaction 6, CSCW1 (2022), 1–32.
[24]
Nishit Gajjar, Vinoth Pandian Sermuga Pandian, Sarah Suleri, and Matthias Jarke. 2021. Akin: Generating UI Wireframes From UI Design Patterns Using Deep Learning. In 26th International Conference on Intelligent User Interfaces - Companion (College Station, TX, USA) (IUI ’21 Companion). Association for Computing Machinery, New York, NY, USA, 40–42. https://doi.org/10.1145/3397482.3450727
[25]
Elisa Giaccardi and Johan Redström. 2020. Technology and More-Than-Human Design. Design Issues 36, 4 (09 2020), 33–44. https://doi.org/10.1162/desi_a_00612 arXiv:https://direct.mit.edu/desi/article-pdf/36/4/33/1857682/desi_a_00612.pdf
[26]
Julian Grigera, Jordan Pascual Espada, and Gustavo Rossi. 2023. AI in User Interface Design and Evaluation. IT professional 25, 2 (2023), 20–22.
[27]
Shunan Guo, Zhuochen Jin, Fuling Sun, Jingwen Li, Zhaorui Li, Yang Shi, and Nan Cao. 2021. Vinci: An Intelligent Graphic Design System for Generating Advertising Posters. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 577, 17 pages. https://doi.org/10.1145/3411764.3445117
[28]
Maanak Gupta, Charankumar Akiri, Kshitiz Aryal, Eli Parker, and Lopamudra Praharaj. 2023. From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy. IEEE Access 11 (2023), 80218–80245. https://doi.org/10.1109/ACCESS.2023.3300381
[29]
Yuanning Han, Ziyi Qiu, Jiale Cheng, and RAY LC. 2024. When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design Task. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). Association for Computing Machinery, New York, NY, USA, 14 pages. https://doi.org/10.1145/3613904.3642133
[30]
Rex Hartson and Pardha S Pyla. 2018. The UX book: Agile UX design for a quality user experience. Morgan Kaufmann.
[31]
Lars Erik Holmquist. 2017. Intelligence on Tap: Artificial Intelligence as a New Design Material. Interactions 24, 4 (jun 2017), 28–33. https://doi.org/10.1145/3085571
[32]
Angel Hsing-Chi Hwang. 2022. Too Late to be Creative? AI-Empowered Tools in Creative Processes. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 38, 9 pages. https://doi.org/10.1145/3491101.3503549
[33]
Bernard J. Jansen, Joni Salminen, Soon-gyo Jung, and Kathleen Guan. 2021. Evaluating Data-Driven Personas. Springer International Publishing, Cham, 209–237. https://doi.org/10.1007/978-3-031-02231-9_9
[34]
Dominik K. Kanbach, Louisa Heiduk, Georg Blueher, Maximilian Schreiter, and Alexander Lahmann. 2023. The GenAI is out of the bottle: generative artificial intelligence from a business model innovation perspective. Review of Managerial Science (2023), 1–32. https://doi.org/10.1007/s11846-023-00696-z
[35]
Pegah Karimi, Jeba Rezwana, Safat Siddiqui, Mary Lou Maher, and Nasrin Dehbozorgi. 2020. Creative sketching partner: an analysis of human-AI co-creativity. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 221–230. https://doi.org/10.1145/3377325.3377522
[36]
Jingoog Kim and Mary Lou Maher. 2023. The effect of AI-based inspiration on human design ideation. International Journal of Design Creativity and Innovation 11, 2 (2023), 81–98. https://doi.org/10.1080/21650349.2023.2167124 arXiv:https://doi.org/10.1080/21650349.2023.2167124
[37]
Nir Kshetri. 2023. ChatGPT in Developing Economies. IT Professional 25, 2 (2023), 16–19. https://doi.org/10.1109/MITP.2023.3254639
[38]
Emily Kuang. 2023. Crafting Human-AI Collaborative Analysis for User Experience Evaluation. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 486, 6 pages. https://doi.org/10.1145/3544549.3577042
[39]
Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan, Jian Zhao, and Kristen Shinohara. 2023. Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text). In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 116, 15 pages. https://doi.org/10.1145/3544548.3581247
[40]
Emily Kuang, Xiaofu Jin, and Mingming Fan. 2022. “Merging Results Is No Easy Task”: An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 318, 16 pages. https://doi.org/10.1145/3491102.3517647
[41]
Effie Lai-Chong Law, Virpi Roto, Marc Hassenzahl, Arnold P.O.S. Vermeeren, and Joke Kort. 2009. Understanding, scoping and defining user experience: a survey approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 719–728. https://doi.org/10.1145/1518701.1518813
[42]
Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.
[43]
Jie Li, Hancheng Cao, Laura Lin, Youyang Hou, Ruihao Zhu, and Abdallah El Ali. 2023. User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence. arXiv preprint arXiv:2309.15237 (2023).
[44]
Na Li, Jason Mayes, and Ping Yu. 2021. ML Tools for the Web: A Way for Rapid Prototyping and HCI Research. Springer International Publishing, Cham, 315–343. https://doi.org/10.1007/978-3-030-82681-9_10
[45]
Q.Vera Liao and S. Shyam Sundar. 2022. Designing for Responsible Trust in AI Systems: A Communication Perspective. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22). Association for Computing Machinery, New York, NY, USA, 1257–1268. https://doi.org/10.1145/3531146.3533182
[46]
Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376590
[47]
Philippe Lorenz, Karine Perset, and Jamie Berryhill. 2023. Initial policy considerations for generative artificial intelligence. 1 (2023). https://doi.org/https://doi.org/10.1787/fae2d1e6-en
[48]
Yuwen Lu, Chengzhi Zhang, Iris Zhang, and Toby Jia-Jun Li. 2022. Bridging the Gap Between UX Practitioners’ Work Practices and AI-Enabled Design Support Tools. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 268, 7 pages. https://doi.org/10.1145/3491101.3519809
[49]
Nora McDonald, Aditya Johri, Areej Ali, and Aayushi Hingle. 2024. Generative Artificial Intelligence in Higher Education: Evidence from an Analysis of Institutional Policies and Guidelines. arXiv preprint arXiv:2402.01659 (2024).
[50]
Kevin Moran, Carlos Bernal-Cardenas, Michael Curcio, Richard Bonett, and Denys Poshyvanyk. 2020. Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps. IEEE transactions on software engineering 46, 2 (2020), 196–221.
[51]
Kevin Moran, Boyang Li, Carlos Bernal-Cárdenas, Dan Jelf, and Denys Poshyvanyk. 2018. Automated Reporting of GUI Design Violations for Mobile Apps. In 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE). 165–175. https://doi.org/10.1145/3180155.3180246
[52]
Hendrik Müller, Aaron Sedley, and Elizabeth Ferrall-Nunge. 2014. Survey research in HCI. Ways of Knowing in HCI (2014), 229–266.
[53]
Michael Muller, Lydia B Chilton, Anna Kantosalo, Q. Vera Liao, Mary Lou Maher, Charles Patrick Martin, and Greg Walsh. 2023. GenAICHI 2023: Generative AI and HCI at CHI 2023. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 350, 7 pages. https://doi.org/10.1145/3544549.3573794
[54]
Michael Muller, Lydia B Chilton, Anna Kantosalo, Charles Patrick Martin, and Greg Walsh. 2022. GenAICHI: Generative AI and HCI. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 110, 7 pages. https://doi.org/10.1145/3491101.3503719
[55]
Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help but Only with Enough Details: Understanding User Experience of Co-Creation with Artificial Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174223
[56]
Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help but Only with Enough Details: Understanding User Experience of Co-Creation with Artificial Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174223
[57]
Thomas Olsson and Kaisa Väänänen. 2021. How does AI challenge design practice?Interactions 28, 4 (jun 2021), 62–64. https://doi.org/10.1145/3467479
[58]
Google PAIR. 2021. People + AI Guidebook. https://pair.withgoogle.com/guidebook/
[59]
Desy Intan Permatasari, Fadilah Fahrul Hardiansyah, Mayshella Ainun Wakhidah, and Maulidan Bagus Afridian Rasyid. 2021. UX Design Documentation Application Using The Five Planes Method. In Proceedings of the 6th International Conference on Sustainable Information Engineering and Technology (Malang, Indonesia) (SIET ’21). Association for Computing Machinery, New York, NY, USA, 29–32. https://doi.org/10.1145/3479645.3479688
[60]
Muhammad Asif Razzaq, Jamil Hussain, Jaehun Bang, Cam-Hao Hua, Fahad Ahmed Satti, Ubaid Ur Rehman, Hafiz Syed Muhammad Bilal, Seong Tae Kim, and Sungyoung Lee. 2023. A Hybrid Multimodal Emotion Recognition Framework for UX Evaluation Using Generalized Mixture Functions. Sensors 23, 9 (2023). https://doi.org/10.3390/s23094373
[61]
Steven P. Reiss, Yun Miao, and Qi Xin. 2018. Seeking the user interface. Automated Software Engineering 25, 1 (2018), 157–193. https://doi.org/10.1007/s10515-017-0216-3
[62]
Joni Salminen, Soon-Gyo Jung, Jisun An, Haewoon Kwak, and Bernard J. Jansen. 2018. Findings of a User Study of Automatically Generated Personas. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188470
[63]
Joongi Shin, Michael A. Hedderich, AndréS Lucero, and Antti Oulasvirta. 2022. Chatbots Facilitating Consensus-Building in Asynchronous Co-Design. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 78, 13 pages. https://doi.org/10.1145/3526113.3545671
[64]
Joon Gi Shin, Janin Koch, Andrés Lucero, Peter Dalsgaard, and Wendy E. Mackay. 2023. Integrating AI in Human-Human Collaborative Ideation. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 355, 5 pages. https://doi.org/10.1145/3544549.3573802
[65]
Marc Steen. 2013. Co-Design as a Process of Joint Inquiry and Imagination. Design Issues 29, 2 (04 2013), 16–28. https://doi.org/10.1162/DESI_a_00207 arXiv:https://direct.mit.edu/desi/article-pdf/29/2/16/1715163/desi_a_00207.pdf
[66]
Åsne Stige, Efpraxia D. Zamani, Patrick Mikalef, and Yuzhen Zhu. 2023. Artificial intelligence (AI) for user experience (UX) design: a systematic literature review and future research agenda. Information technology & people (West Linn, Or.) (2023).
[67]
Jakob Tholander and Martin Jonsson. 2023. Design Ideation with AI - Sketching, Thinking and Talking with Generative Machine Learning Models. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 1930–1940. https://doi.org/10.1145/3563657.3596014
[68]
Kashyap Todi, Daryl Weir, and Antti Oulasvirta. 2016. Sketchplore: Sketch and Explore with a Layout Optimiser. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (Brisbane, QLD, Australia) (DIS ’16). Association for Computing Machinery, New York, NY, USA, 543–555. https://doi.org/10.1145/2901790.2901817
[69]
Alex Tyson and Emma Kikuchi. 2021. Growing public concern about the role of artificial intelligence in daily life. (2021). https://www.pewresearch.org/short-reads/2023/08/28/growing-public-concern-about-the-role-of-artificial-intelligence-in-daily-life/
[70]
Russ Unger and Carolyn Chandler. 2023. A Project Guide to UX Design: For user experience designers in the field or in the making, 3rd Edition. New Riders.
[71]
Mojtaba Vaismoradi and Sherrill Snelgrove. 2019. Theme in Qualitative Content Analysis and Thematic Analysis. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research 20, 3 (Sep. 2019). https://doi.org/10.17169/fqs-20.3.3376
[72]
Mojtaba Vaismoradi, Hannele Turunen, and Terese Bondas. 2013. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences 15, 3 (2013), 398–405. https://doi.org/10.1111/nhs.12048 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/nhs.12048
[73]
Vera van der Burg, Gijs de Boer, Alkim Almila Akdag Salah, Senthil Chandrasegaran, and Peter Lloyd. 2023. Objective Portrait: A practice-based inquiry to explore Al as a reflective design partner. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 387–400. https://doi.org/10.1145/3563657.3595974
[74]
Willem Van Der Maden, Evert Van Beek, Iohanna Nicenboim, Vera Van Der Burg, Peter Kun, James Derek Lomas, and Eunsu Kang. 2023. Towards a Design (Research) Framework with Generative AI. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23 Companion). Association for Computing Machinery, New York, NY, USA, 107–109. https://doi.org/10.1145/3563703.3591453
[75]
Roberto Verganti, Luca Vendraminelli, and Marco Iansiti. 2020. Innovation and Design in the Age of Artificial Intelligence. Journal of Product Innovation Management 37, 3 (2020), 212–227. https://doi.org/10.1111/jpim.12523 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/jpim.12523
[76]
Emmanuelle Walkowiak and Trent MacDonald. 2023. Generative AI and the Workforce: What Are the Risks?Available at SSRN (2023). https://doi.org/10.2139/ssrn.4568684
[77]
Dieter P. Wallach, Lukas A. Flohr, and Annika Kaltenhauser. 2020. Beyond the Buzzwords: On the Perspective of AI in UX and Vice Versa. In Artificial Intelligence in HCI, Helmut Degen and Lauren Reinerman-Jones (Eds.). Springer International Publishing, Cham, 146–166.
[78]
Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing Theory-Driven User-Centric Explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300831
[79]
Wavestone. 2023. Data and AI Executive Leadership Survey 2024. (2023). https://www.wavestone.com/en/insight/data-and-ai-executive-leadership-survey-2024/
[80]
Feiyu Xu, Hans Uszkoreit, Yangzhou Du, Wei Fan, Dongyan Zhao, and Jun Zhu. 2019. Explainable AI: A Brief Survey on History, Research Areas, Approaches and Challenges. In Natural Language Processing and Chinese Computing, Jie Tang, Min-Yen Kan, Dongyan Zhao, Sujian Li, and Hongying Zan (Eds.). Springer International Publishing, Cham, 563–574.
[81]
Wei Xu. 2019. Toward Human-Centered AI: A Perspective from Human-Computer Interaction. Interactions 26, 4 (jun 2019), 42–46. https://doi.org/10.1145/3328485
[82]
Wei Xu. 2023. AI in HCI Design and User Experience. arxiv:2301.00987 [cs.HC]
[83]
Qian Yang. 2017. The role of design in creating machine-learning-enhanced user experience. In 2017 AAAI spring symposium series.
[84]
Qian Yang, Alex Scuito, John Zimmerman, Jodi Forlizzi, and Aaron Steinfeld. 2018. Investigating How Experienced UX Designers Effectively Work with Machine Learning. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 585–596. https://doi.org/10.1145/3196709.3196730
[85]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-Examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376301
[86]
Nur Yildirim, Changhoon Oh, Deniz Sayar, Kayla Brand, Supritha Challa, Violet Turri, Nina Crosby Walton, Anna Elise Wong, Jodi Forlizzi, James McCann, and John Zimmerman. 2023. Creating Design Resources to Scaffold the Ideation of AI Concepts. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (Pittsburgh, PA, USA) (DIS ’23). Association for Computing Machinery, New York, NY, USA, 2326–2346. https://doi.org/10.1145/3563657.3596058
[87]
Nur Yildirim, Mahima Pushkarna, Nitesh Goyal, Martin Wattenberg, and Fernanda Viégas. 2023. Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 356, 13 pages. https://doi.org/10.1145/3544548.3580900
[88]
J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 437, 21 pages. https://doi.org/10.1145/3544548.3581388
[89]
Guanglu Zhang, Ayush Raina, Jonathan Cagan, and Christopher McComb. 2021. A cautionary tale about the impact of AI on human design teams. Design studies 72 (2021), 100990–.
[90]
Xinru Zheng, Xiaotian Qiao, Ying Cao, and Rynson Lau. 2019. Content-aware generative modeling of graphic design layouts. ACM transactions on graphics 38, 4 (2019), 1–15.
[91]
Oksana Ņikiforova, Vitaly Zabiniako, Jurijs Kornienko, Madara Gasparoviča-Asīte, and Amanda Siliņa. 2021. Mapping of Source and Target Data for Application to Machine Learning Driven Discovery of IS Usability Problems. Applied Computer Systems 26, 1 (2021), 22–30. https://doi.org/

Cited By

View all
  • (2024)"We Are Visual Thinkers, Not Verbal Thinkers!": A Thematic Analysis of How Professional Designers Use Generative AI Image Generation ToolsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685370(1-14)Online publication date: 13-Oct-2024
  • (2024)Understanding graphic designers’ usage behavior of generative artificial intelligence toolsKybernetes10.1108/K-05-2024-1159Online publication date: 28-Nov-2024

Index Terms

  1. Generative AI in User Experience Design and Research: How Do UX Practitioners, Teams, and Companies Use GenAI in Industry?

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference
        July 2024
        3616 pages
        ISBN:9798400705830
        DOI:10.1145/3643834
        This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 01 July 2024

        Check for updates

        Author Tags

        1. Company Policies
        2. GenAI
        3. Generative Artificial Intelligence
        4. Human-AI Collaboration
        5. Industry Practices
        6. Interaction Design
        7. User Experience Design
        8. User Experience Research

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        Conference

        DIS '24
        Sponsor:
        DIS '24: Designing Interactive Systems Conference
        July 1 - 5, 2024
        Copenhagen, Denmark

        Acceptance Rates

        Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)2,253
        • Downloads (Last 6 weeks)473
        Reflects downloads up to 12 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)"We Are Visual Thinkers, Not Verbal Thinkers!": A Thematic Analysis of How Professional Designers Use Generative AI Image Generation ToolsProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685370(1-14)Online publication date: 13-Oct-2024
        • (2024)Understanding graphic designers’ usage behavior of generative artificial intelligence toolsKybernetes10.1108/K-05-2024-1159Online publication date: 28-Nov-2024

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media