research-article

Drawing Conversations Mediated by AI

Authors:

Paulina Yurman,

Anuradha Venugopal ReddyAuthors Info & Claims

C&C '22: Proceedings of the 14th Conference on Creativity and Cognition

Pages 56 - 70

https://doi.org/10.1145/3527927.3531448

Published: 20 June 2022 Publication History

Abstract

In this pictorial paper, we present a series of drawing conversations held between two humans, mediated by computational GAN models. We consider how this creative collaboration is affected by the hybrid inclusion of more-than-human participants in the form of watercolour and artificial intelligence. Our drawing experiments were an extension of our search for new ways of seeing and telling, which includes a reflection of the extent to which more-than-human elements took part in our creative process. We discuss our tendencies to form strange interpretations and assign meaning to the unpredictable and ambiguous spaces we created with them. We further speculate on the characteristic material agencies they revealed in our interactions with them. Finally, we contend how such collaborations are already and always embedded and embodied in our ways of seeing and knowing in design and creativity research.

References

[1]

Can Altay and Gizem Öz. 2019. Dialogic weaving: a favorable tension between design and craft. Digital Creativity 30, 1: 39–55.

[2]

Kristina Andersen, Laura Devendorf, James Pierce, Ron Wakkary, and Daniela K. Rosner. 2018. Disruptive Improvisations: Making Use of Non-Deterministic Art Practices in HCI. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 1–8.

Digital Library

[3]

Kristina Andersen, Ron Wakkary, Laura Devendorf, and Alex McLean. 2019. Digital crafts-machine-ship: creative collaborations with machines. Interactions 27, 1: 30–35.

Digital Library

[4]

Genevieve Bell, Mark Blythe, and Phoebe Sengers. 2005. Making by Making Strange: Defamiliarization and the Design of Domestic Technologies. ACM Trans. Comput.-Hum. Interact. 12, 2: 149–173.

Digital Library

[5]

Jesse Josua Benjamin, Arne Berger, Nick Merrill, and James Pierce. 2021. Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ACM, 1–14.

Digital Library

[6]

Mark Blythe, Enrique Encinas, Jofish Kaye, Miriam Lueck Avery, Rob McCabe, and Kristina Andersen. 2018. Imaginary Design Workbooks: Constructive Criticism and Practical Provocation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[7]

Kirsten Boehner and Jeffrey T. Hancock. 2006. Advancing ambiguity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 103–106.

[8]

Ollie Bown. 2021. Beyond the creative species: making machines that make art and music. The MIT Press, Cambridge, Massachusetts.

[9]

Loren Britton, Goda Klumbyte, and Claude Draude. 2019. Doing thinking: revisiting computing with artistic research and technofeminism. Digital Creativity 30, 4: 313–328.

[10]

Otto von Busch. 2013. Collaborative Craft Capabilities: The Bodyhood of Shared Skills. The Journal of Modern Craft 6, 2: 135–146.

[11]

Suk Kyoung Choi. 2018. Guess, check and fix: a phenomenology of improvisation in ‘neural’ painting. Digital Creativity 29, 1: 96–114.

[12]

Rachel E. Clarke. 2020. Ministry of Multispecies Communications. Companion Publication of the 2020 ACM Designing Interactive Systems Conference, Association for Computing Machinery, 441–444.

[13]

Rachel Clarke, Sara Heitlinger, Marcus Foth, Carl DiSalvo, Ann Light, and Laura Forlano. 2018. More-than-human urban futures: speculative participatory design to avoid ecocidal smart cities. In Proceedings of the 15th Participatory Design Conference: Short Papers, Situated Actions, Workshops and Tutorial - Volume 2, Association for Computing Machinery, 1–4.

Digital Library

[14]

James Clifford. 1996. Anthropology and/as Travel. Etnofoor 9, 2: 5–15.

[15]

Kate Compton and M. Mateas. 2015. Casual Creators. ICCC.

[16]

David Cope. 2005. Computer Models of Musical Creativity. MIT Press, Cambridge, MA, USA.

[17]

Michael Correll, Dominik Moritz, and Jeffrey Heer. 2018. Value-Suppressing Uncertainty Palettes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–11.

Digital Library

[18]

Brock Craft and Paul Cairns. 2009. Sketching Sketching: Outlines of a Collaborative Design Method. In People and Computers XXIII Celebrating People and Technology (HCI) Confoerence, 2009.

[19]

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition, 248–255.

[20]

Audrey Desjardins, Afroditi Psarra, and Bonnie A. Whiting. 2021. Voices and Voids: Subverting Voice Assistant Systems through Performative Experiments. In Creativity and Cognition (C&C ‘21). Association for Computing Machinery, New York, NY, USA, Article 29, 1–10.

Digital Library

[21]

Audrey Desjardins and Timea Tihanyi. 2019. ListeningCups: A Case of Data Tactility and Data Stories. Proceedings of the 2019 on Designing Interactive Systems Conference, Association for Computing Machinery, 147–160.

Digital Library

[22]

Audrey Desjardins, Ron Wakkary, and Xiao Zhang. 2012. Exquisite corpses that explore interactions. CHI ’12 Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery, 1517–1522.

[23]

Laura Devendorf, Kristina Andersen, Daniela K. Rosner, Ron Wakkary, and James Pierce. 2019. From HCI to HCI-Amusement: Strategies for Engaging what New Technology Makes Old. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[24]

Jeff Donahue and Karen Simonyan. 2019. Large Scale Adversarial Representation Learning. arXiv:1907.02544 [cs, stat].

[25]

Jennifer Edmond. 2018. Managing Uncertainty in the Humanities: Digital and Analogue Approaches. Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality, Association for Computing Machinery, 840–844.

Digital Library

[26]

José Miguel Santos Araújo Carvalhais Fonseca. 2011. Towards a Model for Artificial Aesthetics - Contributions to the Study of Creative Practices in Procedural and Computational Systems.

[27]

Kenneth D. Forbus and Shaaron Ainsworth. 2017. Editors’ Introduction: Sketching and Cognition. Topics in Cognitive Science 9, 4: 864–865.

[28]

Nettrice Gaskins. Art & Algorhythms. Art & Algorhythms. Retrieved September 13, 2021 from https://www.nettricegaskins.com.

[29]

Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: Cultural Probes. interactions 6, 1: 21–29.

[30]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity As a Resource for Design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 233–240.

Digital Library

[31]

Elisa Giaccardi. 2020. Casting Things As Partners In Design: Toward A More-Than-Human Design Practice. In H. Wiltse, ed., Relating to Things: Design, Technology and the Artificial. Bloomsbury Visual Arts, London, 99–132.

[32]

Elisa Giaccardi, Nazli Cila, Chris Speed, and Melissa Caldwell. 2016. Thing Ethnography: Doing Design Research with Non-Humans. Proceedings of the 2016 ACM Conference on Designing Interactive Systems, ACM, 377–387.

Digital Library

[33]

Elisa Giaccardi and Johan Redström. 2020. Technology and More-Than-Human Design. Design Issues 36, 4: 33–44.

[34]

Vinod Goel. 1995. Sketches of Thought. A Bradford Book, Cambridge, MA, USA.

[35]

Gabriela Goldschmidt. 2017. Manual Sketching: Why Is It Still Relevant? In S. Ammon and R. Capdevila-Werning, eds., The Active Image: Architecture and Engineering in the Age of Modeling. Springer International Publishing, Cham, 77–97.

[36]

Miriam Greis, Jessica Hullman, Michael Correll, Matthew Kay, and Orit Shaer. 2017. Designing for Uncertainty in HCI: When Does Uncertainty Help? Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery, 593–600.

Digital Library

[37]

Tracy Hammond and Paul Taele. 2019. Sketching Cognition and Creativity: Leveraging Sketch Interfaces for Enhancing Creativity and Cognition. Proceedings of the 2019 on Creativity and Cognition, Association for Computing Machinery, 708–713.

Digital Library

[38]

Chipp Jansen and Elizabeth Sklar. 2021. Exploring Co-creative Drawing Workflows. Frontiers in Robotics and AI. Vol 8.

[39]

Clinton Jorge, Valentina Nisi, Nuno Nunes, Giovanni Innella, Miguel Caldeira, and Duarte Sousa. 2013. Ambiguity in design: an airport split-flap display storytelling installation. CHI ’13 Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery, 541–546.

[40]

Tero Karras, Samuli Laine, and Timo Aila. 2019. A Style-Based Generator Architecture for Generative Adversarial Networks. arXiv:1812.04948 [cs, stat].

[41]

Vera Khovanskaya, Phoebe Sengers, Melissa Mazmanian, and Charles Darrah. 2017. Reworking the Gaps between Design and Ethnography. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 5373–5385.

Digital Library

[42]

Nantia Koulidou, Jayne Wallace, Miriam Sturdee, and Abigail Durrant. 2020. Drawing on Experiences of Self: Dialogical Sketching. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 255–267.

Digital Library

[43]

Edith Law, Krzysztof Z. Gajos, Andrea Wiggins, Mary L. Gray, and Alex Williams. 2017. Crowdsourcing as a Tool for Research: Implications of Uncertainty. Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, Association for Computing Machinery, 1544–1561.

Digital Library

[44]

Yi-Chin Lee and Lea Albaugh. 2021. Hybrid Embroidery Games: Playing with Materials, Machines, and People. In Designing Interactive Systems Conference 2021. Association for Computing Machinery, New York, NY, USA, 749–762.

[45]

Makayla Lewis, Miriam Sturdee, and Nicolai Marquardt. 2019. Sketching in HCI: Hands-on Course of Sketching Techniques. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 1–5.

Digital Library

[46]

Jen Liu, Daragh Byrne, and Laura Devendorf. 2018. Design for Collaborative Survival: An Inquiry into Human-Fungi Relationships. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[47]

Dan Lockton, Flora Bowden, Clare Brass, and Rama Gheerawo. 2014. Bird-Wattching: Exploring Sonification of Home Electricity Use with Birdsong. SoniHED: Conference on Sonification of Health and Environmental Data, York UK.

[48]

Remko van der Lugt. 2002. Functions of sketching in design idea generation meetings. Proceedings of the 4th conference on Creativity & cognition, Association for Computing Machinery, 72–79.

Digital Library

[49]

Maarit Mäkelä, Nithikul Nimkulrat, and Tero Heikkinen. 2014. Editorial Drawing as a Research Tool: Making and understanding in art and design practice. Studies in Material Thinking 10. AUT University. Vol 10 (February 2014).

[50]

Jon McCormack and Mark D'Inverno, eds. 2012. Computers and creativity. Springer, Berlin; New York.

[51]

Iohanna Nicenboim, Elisa Giaccardi, Marie Louise Juul Søndergaard, 2020. More-Than-Human Design and AI: In Conversation with Agents. Companion Publication of the 2020 ACM Designing Interactive Systems Conference, Association for Computing Machinery, 397–400.

Digital Library

[52]

Amanda Phillips, Gillian Smith, Michael Cook, and Tanya Short. 2016. Feminism and procedural content generation: toward a collaborative politics of computational creativity. Digital Creativity.

[53]

Anuradha Reddy, Iohanna Nicenboim, James Pierce, and Elisa Giaccardi. 2020. Encountering ethics through design: a workshop with nonhuman participants. AI & SOCIETY.

[54]

Terry Rosenberg. 2008. New Beginnings and Monstrous Births: Notes toward an Appreciation of Ideational Drawing, Garner, S., ed. 2008. In Writing on Drawing: Essays on Drawing Practice and Research. Intellect Books, Bristol, UK, pages 97 to 110

[55]

Stanislav Roudavski and Jon McCormack. 2016. Post-anthropocentric creativity. Digital Creativity 27, 1: 3–6.

[56]

Pedro Sanches, Kristina Höök, Corina Sas, and Anna Ståhl. 2019. Ambiguity as a Resource to Inform Proto-Practices: The Case of Skin Conductance. ACM Trans. Comput.-Hum. Interact. 26, 4, Article 21 (August 2019), 32 pages.

Digital Library

[57]

Donald A. Schön. 1983. The reflective practitioner: how professionals think in action. Basic Books, New York.

[58]

Phoebe Sengers and Bill Gaver. 2006. Staying Open to Interpretation: Engaging Multiple Meanings in Design and Evaluation. Proceedings of the 6th Conference on Designing Interactive Systems, ACM, 99–108.

Digital Library

[59]

Richard Sennett. 2008. The craftsman. Yale Univ. Press, New Haven.

[60]

Robert Soden, Laura Devendorf, Richmond Y. Wong, Lydia B. Chilton, Ann Light, and Yoko Akama. 2020. Embracing Uncertainty in HCI. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 1–8.

[61]

Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. Proceedings of the Halfway to the Future Symposium 2019, Association for Computing Machinery, 1–10.

Digital Library

[62]

Barbara Tversky. 2015. On Abstraction and Ambiguity. Studying Visual and Spatial Reasoning for Design Creativity, Springer Netherlands, 215–223.

[63]

Barbara Tversky and Masaki Suwa. 2009. Thinking with Sketches. In A. Markman and K. Wood, eds., Tools for Innovation. Oxford University Press, 75–84.

[64]

Ron Wakkary. 2021. Things We Could Design: For More Than Human-Centered Worlds. MIT Press, Cambridge, MA, USA.

[65]

Paulina Yurman. 2019. Designing for Ambivalence: A designer's research into the role of smartphones for mothers and young children. PhD Thesis, Goldsmiths University of London.

[66]

Paulina Yurman. 2021. Fluid Speculations: Drawing Artefacts in Watercolour as Experimentation in Research Through Design. In Creativity and Cognition (C&C ‘21). Association for Computing Machinery, New York, NY, USA, Article 38, 1.

Digital Library

[67]

Zhuo Zhang, Guangyuan Fu, Fuqiang Di, Changlong Li, and Jia Liu. 2019. Generative Reversible Data Hiding by Image to Image Translation via GANs. arXiv:1905.02872 [cs, eess].

[68]

AutoDraw by Google Creative Lab. Retrieved January 4, 2022 from https://experiments.withgoogle.com/autodraw.

[69]

Sketch-RNN by Google Creative Lab. Retrieved January 4, 2022 from https://experiments.withgoogle.com/sketch-rnn-demo.

[70]

Runway ML | CREATE IMPOSSIBLE VIDEO. Retrieved September 14, 2021 from https://runwayml.com/.

[71]

MoMA | Meret Oppenheim. Object. Paris, 1936. Retrieved January 4, 2022 from https://www.moma.org/learn/moma_learning/meret-oppenheim-object-paris-1936

Cited By

Salinas-Navarro DVilalta-Perdomo EMichel-Villarreal RMontesinos L(2024)Using Generative Artificial Intelligence Tools to Explain and Enhance Experiential Learning for Authentic AssessmentEducation Sciences10.3390/educsci1401008314:1(83)Online publication date: 12-Jan-2024
https://doi.org/10.3390/educsci14010083
Peng CZhang Z(2024)Exploring the use of AI-generated AI-based drawings and music in Bipolar affective disorder interventionsApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-36519:1Online publication date: 29-Nov-2024
https://doi.org/10.2478/amns-2024-3651
Eriksson EYoo DBekker TNilsson E(2024)More-than-Human Perspectives in Human-Computer Interaction Research: A Scoping ReviewProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685408(1-18)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685408
Show More Cited By

Recommendations

Venetian Drawing Conversations
C&C '22: Proceedings of the 14th Conference on Creativity and Cognition

This one-day workshop invites designers, researchers and practitioners whose work might involve design, to collectively speculate about designed artefacts and technologies through the creation of drawing conversations: visual dialogues resulting from ...
The neural substrates of drawing: A voxel-based morphometry analysis of constructional, hierarchical, and spatial representation deficits

Deficits in the ability to draw objects, despite apparently intact perception and motor abilities, are defined as constructional apraxia. Constructional deficits, often diagnosed based on performance on copying complex figures, have been reported in a ...
Blindsight mediated by an s-cone-independent collicular pathway: An fmri study in hemispherectomized subjects

The purpose of our study was to investigate the ability to process achromatic and short-wavelength-sensitive cone (S-cone)-isolating (blue-yellow) stimuli in the blind visual field of hemispherectomized subjects and to demonstrate that blindsight is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '22: Proceedings of the 14th Conference on Creativity and Cognition

June 2022

710 pages

ISBN:9781450393270

DOI:10.1145/3527927

General Chairs:
Neil Maiden
City, University of London, UK
,
Corina Sas
Lancaster University, UK

Copyright © 2022 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

C&C '22

Sponsor:

SIGCHI

C&C '22: Creativity and Cognition

June 20 - 23, 2022

Venice, Italy

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
470
Total Downloads

Downloads (Last 12 months)166
Downloads (Last 6 weeks)19

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Salinas-Navarro DVilalta-Perdomo EMichel-Villarreal RMontesinos L(2024)Using Generative Artificial Intelligence Tools to Explain and Enhance Experiential Learning for Authentic AssessmentEducation Sciences10.3390/educsci1401008314:1(83)Online publication date: 12-Jan-2024
https://doi.org/10.3390/educsci14010083
Peng CZhang Z(2024)Exploring the use of AI-generated AI-based drawings and music in Bipolar affective disorder interventionsApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-36519:1Online publication date: 29-Nov-2024
https://doi.org/10.2478/amns-2024-3651
Eriksson EYoo DBekker TNilsson E(2024)More-than-Human Perspectives in Human-Computer Interaction Research: A Scoping ReviewProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685408(1-18)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685408
Sivertsen CLøvlie A(2024)Exploring Aesthetic Qualities of Deep Generative Models through Technological (Art) MediationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661498(2738-2752)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661498
Ford CNoel-Hirst ACardinale SLoth JSarmento PWilson EWolstanholme LWorrall KBryan-Kinns N(2024)Reflection Across AI-based Music CompositionProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656185(398-412)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656185
Sivertsen CSalimbeni GLøvlie ABenford SZhu J(2024)Machine Learning Processes As Sources of Ambiguity: Insights from AI ArtProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642855(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642855
Michel-Villarreal RVilalta-Perdomo ESalinas-Navarro DThierry-Aguilera RGerardou F(2023)Challenges and Opportunities of Generative AI for Higher Education as Explained by ChatGPTEducation Sciences10.3390/educsci1309085613:9(856)Online publication date: 23-Aug-2023
https://doi.org/10.3390/educsci13090856
Ko HPark GJeon HJo JKim JSeo J(2023)Large-scale Text-to-Image Generation Models for Visual Artists’ Creative WorksProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584078(919-933)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584078
Reddy A(2022)Artificial everyday creativity: creative leaps with AI through critical makingDigital Creativity10.1080/14626268.2022.213845233:4(295-313)Online publication date: 28-Oct-2022
https://doi.org/10.1080/14626268.2022.2138452

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents