Death of the Design Researcher? Creating Knowledge Resources for Designers Using Generative AI
Authors: 
Willem Van Der Maden, Evert Van Beek, Brett A. Halperin, Petra Jääskeläinen, Eunsu Kang, Peter Kun, James Derek Lomas, 
Timothy Merritt, Joseph Lindley, Michael Muller, 
Iohanna Nicenboim, 
Jichen Zhu, Vera van der BurgAuthors Info & Claims
Willem Van Der Maden, Evert Van Beek, Brett A. Halperin, Petra Jääskeläinen, Eunsu Kang, Peter Kun, James Derek Lomas, Timothy Merritt, Joseph Lindley, Michael Muller, Iohanna Nicenboim, Jichen Zhu, Vera van der BurgAuthors Info & ClaimsPages 396 - 400
Abstract
This workshop explores the transformative potential of generative artificial intelligence (GenAI) in design research. GenAI, capable of creating new content such as images, text, music, video, and code, raises important questions about authorship, agency, and design practice. Inspired by Roland Barthes’ "The Death of the Author," this workshop examines how GenAI reshapes design research roles and methods. Key topics include best practices, ethical considerations, knowledge generation, and collaboration patterns between human and AI creatives.
Building on themes identified in the successful DIS 2023 workshop, this 2-day event invites designers and researchers to present completed projects, works-in-progress, and theoretical provocations. The structure allows time for both presentations and in-depth discussions, aiming to develop an online resource library and a collaborative publication. The workshop seeks to advance the discourse on GenAI, addressing its challenges and opportunities in design research.
References
[1]
Mahmoud Al-Sarayreh, Mariza Gomes Reis, Alistair Carr, and Marlon Martins dos Reis. 2023. Inverse design and AI/Deep generative networks in food design: A comprehensive review. Trends in Food Science & Technology 138 (Aug. 2023), 215–228. https://doi.org/10.1016/j.tifs.2023.06.005
[2]
Joseph Amankwah-Amoah, Samar Abdalla, Emmanuel Mogaji, Amany Elbanna, and Yogesh K Dwivedi. 2024. The impending disruption of creative industries by generative AI: Opportunities, challenges, and research agenda., 102759 pages.
[3]
Nantheera Anantrasirichai and David Bull. 2022. Artificial intelligence in the creative industries: a review. Artificial intelligence review (2022), 1–68.
[4]
H Igor Ansoff. 1975. Managing strategic surprise by response to weak signals. California management review 18, 2 (1975), 21–33.
[5]
Song Bai. 2024. Progress and Prospects in 3D Generative AI: A Technical Overview. arXiv preprint arXiv:2401.02620 (2024). https://arxiv.org/abs/2401.02620
[6]
D. Baidoo-Anu and L. Owusu Ansah. 2023. AI Video Editor: A Conceptual Review in Generative Arts. Atlantis Press 523 (2023), 529.
[7]
Maria Teresa Baldassarre, Danilo Caivano, Berenice Fernandez Nieto, Domenico Gigante, and Azzurra Ragone. 2023. The social impact of generative ai: An analysis on chatgpt. In Proceedings of the 2023 ACM Conference on Information Technology for Social Good. 363–373.
[8]
Roland Barthes. 1977. Image-Music-Text. Fontana Press, London. Includes the essay "The Death of the Author".
[9]
Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, Troy Luhman, Eric Luhman, Clarence Ng, Ricky Wang, and Aditya Ramesh. 2024. Video generation models as world simulators. (2024). https://openai.com/research/video-generation-models-as-world-simulators
[10]
Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77–91.
[11]
G. Cascini, Y. Nagai, G. V. Georgiev, J. Zelaya, N. Becattini, J. F. Boujut, H. Casakin, N. Crilly, E. Dekoninck, J. Gero, A. Goel, G. Goldschmidt, M. Gonçalves, K. Grace, L. Hay, P. Le Masson, M. L. Maher, D. Marjanović, D. Motte, P. Papalambros, R. Sosa, Srinivasan V, M. Štorga, B. Tversky, B. Yannou, and A. Wodehouse. 2022. Perspectives on design creativity and innovation research: 10 years later. International Journal of Design Creativity and Innovation 10, 1 (Jan. 2022), 1–30. https://doi.org/10.1080/21650349.2022.2021480 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/21650349.2022.2021480.
[12]
Shih-Hung Cheng. 2023. Impact of Generative Artificial Intelligence on Footwear Design Concept and Ideation. Engineering Proceedings 55, 1 (2023), 32. https://doi.org/10.3390/engproc2023055032 Number: 1 Publisher: Multidisciplinary Digital Publishing Institute.
[13]
Li-Yuan Chiou, Peng-Kai Hung, Rung-Huei Liang, and Chun-Teng Wang. 2023. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference(DIS ’23). Association for Computing Machinery, New York, NY, USA, 1941–1954. https://doi.org/10.1145/3563657.3596001
[14]
Michael Chui, Eric Hazan, Roger Roberts, Alex Singla, and Kate Smaje. 2023. The economic potential of generative AI. (2023). Publisher: McKinsey & Company.
[15]
Sasha Costanza-Chock. 2018. Design Justice, A.I., and Escape from the Matrix of Domination. Journal of Design and Science (July 2018). https://doi.org/10.21428/96c8d426
[16]
Nigel Cross. 2001. Designerly Ways of Knowing: Design Discipline Versus Design Science. Design Issues 17, 3 (2001), 49–55. https://doi.org/10.1162/074793601750357196
[17]
Nigel Cross. 2007. Forty years of design research. Design Studies 28, 1 (Jan. 2007), 1–4. https://doi.org/10.1016/j.destud.2006.11.004
[18]
Stan Cross. 2023. How graphic designers are creating their own AI tools. WePresent. https://wepresent.wetransfer.com/stories/diy-design-tools-for-graphic-designers.
[19]
Anil R. Doshi and Oliver Hauser. 2023. Generative AI enhances individual creativity but reduces the collective diversity of novel content. https://doi.org/10.2139/ssrn.4535536
[20]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX design innovation: Challenges for working with machine learning as a design material. In Proceedings of the 2017 chi conference on human factors in computing systems. 278–288.
[21]
Tojin T. Eapen, Daniel J. Finkenstadt, Josh Folk, and Lokesh Venkataswamy. 2023. How Generative AI Can Augment Human Creativity. Harvard Business Review (July 2023). https://hbr.org/2023/07/how-generative-ai-can-augment-human-creativity Section: AI and machine learning.
[22]
Peter Eigenschink, Thomas Reutterer, Stefan Vamosi, Ralf Vamosi, Chang Sun, and Klaudius Kalcher. 2023. Deep Generative Models for Synthetic Sequential Data: A Survey. IEEE Access (2023).
[23]
Tony Fry. 2010. Design as Politics. Berg.
[24]
Fiona Fui-Hoon Nah, Ruilin Zheng, Jingyuan Cai, Keng Siau, and Langtao Chen. 2023. Generative AI and ChatGPT: Applications, challenges, and AI-human collaboration. Journal of Information Technology Case and Application Research 25, 3 (July 2023), 277–304. https://doi.org/10.1080/15228053.2023.2233814
[25]
Songwei Ge, Austin Dill, Eunsu Kang, Chun-Liang Li, Lingyao Zhang, Manzil Zaheer, and Barnabas Poczos. 2019. Developing creative ai to generate sculptural objects. arXiv preprint arXiv:1908.07587 (2019).
[26]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63, 11 (2020), 139–144.
[27]
Imke Grabe, Jichen Zhu, and Manex Agirrezabal. 2022. Fashion Style Generation: Evolutionary Search with Gaussian Mixture Models in the Latent Space. http://arxiv.org/abs/2204.00592 arXiv:2204.00592 [cs].
[28]
Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books.
[29]
Thilo Hagendorff. 2024. Mapping the Ethics of Generative AI: A Comprehensive Scoping Review. http://arxiv.org/abs/2402.08323 arXiv:2402.08323 [cs].
[30]
Brett A Halperin, Gary Hsieh, Erin McElroy, James Pierce, and Daniela K Rosner. 2023. Probing a Community-Based Conversational Storytelling Agent to Document Digital Stories of Housing Insecurity. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
[31]
Brett A Halperin, Mirabelle Jones, and Daniela K Rosner. 2023. Haunted Aesthetics and Otherworldly Possibilities: Generating (Dis) embodied Performance Videos with AI. (2023).
[32]
Brett A Halperin and Stephanie M Lukin. 2023. Envisioning Narrative Intelligence: A Creative Visual Storytelling Anthology. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–21.
[33]
Holger Harreis, Theodora Koullias, Roger Roberts, and Kimberly Te. 2023. Generative AI: Unlocking the future of fashion. (2023).
[34]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems 33 (2020), 6840–6851.
[35]
Marius Hoggenmueller, Maria Luce Lupetti, Willem van der Maden, and Kazjon Grace. 2023. Creative AI for HRI Design Explorations. ACM, Stockholm, Sweden.
[36]
Jinghui Jove Hou, Lei Wang, Gang Wang, Harry Wang, and Shuai Yang. 2024. The Double-Edged Roles of Generative AI in the Creative Process: Experiments on Design Work. Available at SSRN 4739471 (2024). https://doi.org/10.2139/ssrn.4739471
[37]
Angel Hsing-Chi Hwang. 2022. Too Late to be Creative? AI-Empowered Tools in Creative Processes. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 38, 9 pages. https://doi.org/10.1145/3491101.3503549
[38]
Feifeng Jiang, Jun Ma, Christopher John Webster, Alain J. F. Chiaradia, Yulun Zhou, Zhan Zhao, and Xiaohu Zhang. 2024. Generative urban design: A systematic review on problem formulation, design generation, and decision-making. Progress in Planning 180 (Feb. 2024), 100795. https://doi.org/10.1016/j.progress.2023.100795
[39]
Harry H Jiang, Lauren Brown, Jessica Cheng, Mehtab Khan, Abhishek Gupta, Deja Workman, Alex Hanna, Johnathan Flowers, and Timnit Gebru. 2023. AI Art and its Impact on Artists. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society. 363–374.
[40]
Petra Jääskeläinen, Daniel Pargman, and André Holzapfel. 2022. On the environmental sustainability of Ai art(s). In Eighth Workshop on Computing within Limits 2022. LIMITS. https://doi.org/10.21428/bf6fb269.c46375fa
[41]
P. Jääskeläinen and C. Åsberg. 2024. What’s the Look of "Negative Gender" and "Max Ethnicity" in AI-Generated Images? A Critical Visual Analysis of the Intersectional Politics of Portrayal. In CHI EA ’24 (Honolulu, HI, USA, May 11–16). https://doi.org/10.1145/3613905.3644057
[42]
Anna Kantosalo, Prashanth Thattai Ravikumar, Ollie Bown, Kazjon Grace, Tapio Takala, and Mary Lou Maher. 2021. Second Workshop on the Future of Co-Creative Systems. Workshop at the International Conference on Computational Creativity (ICCC’21). https://underline.io/events/178/reception Online event. Accessed: [your access date here].
[43]
Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
[44]
Daniel Leiker. 2023. Generative AI for learning: Investigating the potential of synthetic learning videos. arXiv preprint arXiv:2304.03784 (2023).
[45]
Chenghao Li. 2023. Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era. arXiv preprint arXiv:2305.06131 (2023). https://arxiv.org/abs/2305.06131
[46]
James D Lomas, Willem van der Maden, Sohhom Bandyopadhyah, Giovanni Lion, Yanna Litowsky, Haian Xue, and Pieter Desmet. 2023. The Alignment of AI Emotions: human ratings of the emotions expressed by GPT-3, DALL-E and Stable Diffusion. https://doi.org/10.13140/RG.2.2.11123.81441
[47]
Louie Meyer, Johanne Engel Aaen, Anitamalina Regitse Tranberg, Peter Kun, Matthias Freiberger, Sebastian Risi, and Anders Sundnes Løvlie. 2024. Algorithmic Ways of Seeing: Using Object Detection to Facilitate Art Exploration. In Proceedings of the CHI Conference on Human Factors in Computing Systems(CHI ’24). ACM. https://doi.org/10.1145/3613904.3642157
[48]
James Muldoon and Boxi A Wu. 2023. Artificial Intelligence in the Colonial Matrix of Power. Philosophy & Technology 36, 4 (2023), 80.
[49]
Michael Muller, Lydia B Chilton, Anna Kantosalo, Q Vera Liao, Mary Lou Maher, Charles Patrick Martin, and Greg Walsh. 2023. GenAICHI 2023: Generative AI and HCI at CHI 2023. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.
[50]
Iohanna Nicenboim, Shruthi Venkat, Neva Rustad, Diana Vardanyan, Elisa Giaccardi, and Johan Redström. 2023. Conversation Starters: How Can We Misunderstand AI Better?ACM, New York, NY, USA, Hamburg, Germany, 4. https://doi.org/10. 1145/3544549.3583914
[51]
Jakob Nielsen. 2023. AI: First New UI Paradigm in 60 Years. https://www.nngroup.com/articles/ai-new-ui-paradigm/. Accessed: 2024-02-21.
[52]
Sergey I Nikolenko. 2021. Synthetic data for deep learning. Vol. 174. Springer.
[53]
Patrick Parra Pennefather. 2023. Creative Prototyping with Generative AI: Augmenting Creative Workflows with Generative AI. University of British Columbia. https://dokumen.pub/creative-prototyping-with-generative-ai-augmenting-creative-workflows-with-generative-ai-design-thinking-1nbsped-1484295781-9781484295786.html
[54]
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. 2022. Dreamfusion: Text-to-3d using 2d diffusion. arXiv preprint arXiv:2209.14988 (2022).
[55]
Nitin Rane, Saurabh Choudhary, and Jayesh Rane. 2023. Integrating ChatGPT, Bard, and leading-edge generative artificial intelligence in architectural design and engineering: applications, framework, and challenges. SSRN Electronic Journal (2023). https://doi.org/10.2139/ssrn.4645595
[56]
Jay Ratican, James Hutson, and Andrew Wright. 2023. A proposed meta-reality immersive development pipeline: Generative ai models and extended reality (xr) content for the metaverse. Journal of Intelligent Learning Systems and Applications 15 (2023).
[57]
Malak Sadek, Rafael A Calvo, and Céline Mougenot. 2023. Co-designing conversational agents: A comprehensive review and recommendations for best practices. Design Studies 89 (2023), 101230.
[58]
Joongi Shin, Janin Koch, Andrés Lucero, Peter Dalsgaard, and Wendy E Mackay. 2023. Integrating AI in Human-Human Collaborative Ideation. (2023).
[59]
Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh, Sonal Gupta, and Yaniv Taigman. 2022. Make-A-Video: Text-to-Video Generation without Text-Video Data. https://doi.org/10.48550/ARXIV.2209.14792
[60]
Christian Sivertsen, René Haas, Halfdan Hauch Jensen, and Anders Sundnes Løvlie. 2023. Exploring a Digital Art Collection through Drawing Interactions with a Deep Generative Model. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–5. https://doi.org/10.1145/3544549.3583902
[61]
Jasmina Tacheva and Srividya Ramasubramanian. 2023. AI Empire: Unraveling the interlocking systems of oppression in generative AI’s global order. Big Data & Society 10, 2 (2023), 20539517231219241.
[62]
Evert van Beek. 2023. Thingscon Workshop Disrupting disruptive innovation. https://evertvanbeek.com/wp-content/uploads/2023/02/Recap_ThingsconWinterWorkshop22.pdf
[63]
Willem van der Maden, Derek Lomas, and Paul Hekkert. 2024. Developing and Evaluating a Design Method for Positive Artificial Intelligence. arxiv:2402.01499 [cs.AI]
[64]
Willem Van Der Maden, Evert Van Beek, Iohanna Nicenboim, Vera Van Der Burg, Peter Kun, James Derek Lomas, and Eunsu Kang. 2023. Towards a Design (Research) Framework with Generative AI. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference(DIS ’23 Companion). Association for Computing Machinery, New York, NY, USA, 107–109. https://doi.org/10.1145/3563703.3591453
[65]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
[66]
Justin Weisz, Mary Lou Maher, Hendrik Strobelt, Lydia B. Chilton, David Bau, and Werner Geyer. 2022. HAI-GEN 2022: 3rd Workshop on Human-AI Co-Creation with Generative Models. https://research.ibm.com/publications/hai-gen-2022-3rd-workshop-on-human-ai-co-creation-with-generative-models
[67]
Stefan Werning. 2024. Generative AI and the Technological Imaginary of Game Design. In Creative Tools and the Softwarization of Cultural Production. Springer, 67–90.
[68]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 chi conference on human factors in computing systems. 1–13.
Index Terms
- Death of the Design Researcher? Creating Knowledge Resources for Designers Using Generative AI
Recommendations
Towards a Design (Research) Framework with Generative AI
DIS '23 Companion: Companion Publication of the 2023 ACM Designing Interactive Systems ConferenceThis one day workshop will explore the use of Generative Artificial Intelligence (GenAI) in design research and practice. Generative technologies are developing rapidly and many designers are using them. Yet, there remains little published work on the ...
Creating personas from design ethnography and grounded theory
Personas can be an effective means of communicating and synthesizing design ethnographic field data by helping designers maintain focus on users and make sense of complex needs. Personas have however been criticized on scientific grounding and ...
Power Struggles and Disciplined Designers - A Nexus Analytic Inquiry on Cross-Disciplinary Research and Design
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsDesign is at the heart of Human Computer Interaction research and practice. In the research community, there has emerged an increasing interest in understanding and conceptualizing our research practice, particularly such entailing design. However, ...
Comments
Information & Contributors
Information
Published In
July 2024
501 pages
ISBN:9798400706325
DOI:10.1145/3656156
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Novo Nordisk Funden
Conference
DIS '24
Sponsor:
DIS '24: Designing Interactive Systems Conference
July 1 - 5, 2024
IT University of Copenhagen, Denmark
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Upcoming Conference
DIS '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 688Total Downloads
- Downloads (Last 12 months)688
- Downloads (Last 6 weeks)75
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in