Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3313831.3376258acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch

Published: 23 April 2020 Publication History

Abstract

Co-creative systems have been widely explored in the field of computational creativity. However, existing AI partners of these systems are mostly virtual agents. As sketching on paper with embodied robots could be more engaging for designers' early-stage ideation and collaborative practices, we envision the possibility of Cobbie, a mobile robot that ideates iteratively with designers by generating creative and diverse sketches. To evaluate the differences in co-creativity and user experience between the co-creative robots and virtual agents, we conducted a comparative experiment and analyzed the data collected from quantitative scales, observation, and semi-structured interview. The results reveal that Cobbie is more satisfying in motivating exploration, provoking unexpected ideas and engaging designers in the collaborative ideation process. Based on these findings, we discussed the prospects of co-creative robots for future developments of human-AI collaborative systems.

Supplementary Material

MP4 File (paper131pv.mp4)
Preview video

References

[1]
Ali Algarni. 2019. Exploring Neuroscience of Creativity Theories in designing Co-creative Agents. In Proceedings of the 2019 on Creativity and Cognition (C&C'19). ACM, NY, NY, USA, 686--690.
[2]
Patrí cia Alves-Oliveira, Patrí cia Arriaga, Ana Paiva, and Guy Hoffman. 2017. YOLO, a Robot for Creativity: A Co-Design Study with Children. In Proceedings of the 2017 Conference on Interaction Design and Children (CHI'17). ACM, NY, NY, USA, 423--429.
[3]
Sule Anjomshoae, Amro Najjar, Davide Calvaresi, and Kary Framling. 2019. Explainable Agents and Robots: Results from a Systematic Literature Review. In Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS'19). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 1078--1088.
[4]
Patti Bao, Elizabeth Gerber, Darren Gergle, and David Hoffman. 2010. Momentum: getting and staying on topic during a brainstorm. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). ACM, NY, NY, USA, 12331236.
[5]
Luca Benedetti, Holger Winnemoller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with Bob: assisted creativity for novices. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST'14). ACM, NY, NY, USA, 419--428.
[6]
Peter Brandl, Clifton Forlines, Daniel Wigdor, Michael Haller, and Chia Shen. 2008. Combining and Measuring the Benefits of Bimanual Pen and DirectTouch Interaction on Horizontal Interfaces. In Proceedings of the working conference on Advanced visual interfaces (AVI'08). ACM, NY, NY, USA, 154--161.
[7]
Erin A. Carroll, Celine Latulipe, Richard Fung, and Michael Terry. 2009. Creativity factor evaluation: towards a standardized survey metric for creativity support. In Proceedings of the seventh ACM conference on Creativity and cognition (C&C'09). ACM, NY, NY, USA, 127--136.
[8]
Sung-En Chien, Li Chu, Hsing-Hao Lee, Chien-Chun Yang, Fo-Hui Lin, Pei-Ling Yang, Te-Mei Wang, and Su-Ling Yeh. 2019. Age Difference in Perceived Ease of Use, Curiosity, and Implicit Negative Attitude toward Robots. ACM Trans. Hum.-Robot Interact. 8, 2, Article 9 (May 2019).
[9]
Brock Craft and Paul Cairns. 2009. Sketching sketching: outlines of a collaborative design method. In Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology (BCS-HCI'09). BCS Learning & Development Ltd. Swindon, UK, 65--72.
[10]
Jim Davies, Ashok K. Goel, and Nancy J. Nersessian 2009. A Computational Model of Visual Analogies in Design. Cognitive Systems Research: Special Issue on Analogies 10, 3(2009), 204--215.
[11]
Nicholas Davis, Chih-Pin Hsiao, Kunwar Yashraj Singh, and Brian Magerko. 2016. Co-Creative Drawing Agent with Object Recognition. In Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference.
[12]
Nicholas Davis. An Enactive Approach to Facilitate Interactive Machine Learning for Co-Creative Agents. 2015. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition (C&C'15). ACM, NY, NY, USA, 345--346.
[13]
Nicholas Davis, Chih-Pin Hsiao, Kunwar Yashraj Singh, Lisa Li, and Brian Magerko. 2016. Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent. In Proceedings of the 21st Interactional Conference on Intelligent User Interfaces (IUI'16). ACM, NY, NY, USA, 196--207.
[14]
Sebastian Deterding, Jonathan Hook, Rebecca Fiebrink, Marco Gillies, Jeremy Gow, Memo Akten, Gillian Smith, Antonios Liapis, and Kate Compton. 2017. Mixed-Initiative Creative Interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'17). ACM, NY, NY, USA, 628--635.
[15]
Daniel Dixon, Manoj Prasad, and Tracy Hammond. 2010. iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). ACM, NY, NY, USA, 897--906.
[16]
Judith E. Fan, Monica Dinculescu, and David Ha. 2019. collabdraw: An Environment for Collaborative Sketching with an Artificial Agent. In Proceedings of the 2019 on Creativity and Cognition (C&C'19). ACM, NY, NY, USA, 556--561.
[17]
Juan Fasola and Maja J Mataric. 2013. Experimental Robotics. Springer, Heidelberg, Chapter Socially Assistive Robot Exercise Coach: Motivating Older Adults to Engage in Physical exercise, 463--479.
[18]
Mary Ellen Forster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, and Ronald P.A. Petrick. 2012. Two People Walk Into a Bar: Dynamic MultiParty Social Interaction with a Robot Agent. In Proceedings of the 14th ACM international conference on Multimodal interaction (ICMI'12). ACM, NY, NY, USA, 3--10.
[19]
Alex Graves. 2013. Generating Sequences With Recurrent Neural Networks. Computer Science (2013). arXiv: 1308.0850 [cs.NE]
[20]
Matthew Guzdial, Nicholas Liao, Jonathan Chen, Shao-Yu Chen, Shukan Shah, Vishwa Shah, Joshua Reno, Gillian Smith, and Mark O. Riedl. 2019. Friend, Collaborator, Student, Manager: How Design of an AIDriven Game Level Editor Affects Creators. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). ACM, NY, NY, USA, Paper No. 624.
[21]
Joshua T. Gyory, Jonathan Cagan, and Kenneth Kotovsky. 2018. Are you better off alone? Mitigating the underperformance of engineering teams during conceptual design through adaptive process management. Research in Engineering Design 30, 85102(2019).
[22]
David Ha and Douglas Eck. 2017. A Neural Representation of Sketch Drawings. arXiv: 1704.03477 [cs.NE]
[23]
Chipp Jansen and Elizabeth Sklar. 2019. Co-creative Physical Drawing Systems. ICRA.
[24]
Jonas Jongejan, Henry Rowley, Takashi Kawashima, Jongmin Kim, and Nick Fox-Gieg. 2016. The Quick, Draw! -A.I. Experiment. (2016). https://quickdraw.withgoogle.com/
[25]
Deny W. Junaidy and Yukari Nagai. 2013. Co-Creation Model for Traditional Artisans in the Current Creative Environment. In Proceedings of the 9th ACM Conference on Creativity & Cognition (C&C'13). ACM, NY, NY, USA, 324--327.
[26]
Peter H. Kahn, Jr., Takayuki Kanda, Hiroshi Ishiguro, Brian T. Gill, Solace Shen, Jolina H. Ruckert, and Heather E. Gary. 2016. Human Creativity Can be Facilitated Through Interacting With a Social Robot. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction (HRI '16). IEEE Press, Piscataway, NJ, USA, 173--180.
[27]
Pegah Karimi, Nicholas Davis, Mary Lou Maher, Kazjon Frace, and Lina Lee. 2019. Relating Cognitive Models of Design Creativity to the Similarity of Sketches Generated by an AI Partner. In Proceedings of the 2019 on Creativity and Cognition (C&C'19). ACM, NY, NY, USA, 259--270.
[28]
Rubaiat Habib Kazi, Tovi Grossman, Hyunmin Cheong, Ali Hashemi, and George Fitzmaurice. 2017. DreamSketch: Early Stage 3D Design Explorations with Sketching and Generative Design. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST'17). ACM, NY, NY, USA, 401--414.
[29]
Janin Koch, Andres Lucero, Lena Hegemann, and Antti Oulasvirta. 2019. May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). ACM, NY, NY, USA, 1--12.
[30]
Pavlos Koulouris and Evangelia V. Dimaraki. 2014. Digital Gaming for Co-Creativity in Learning: TheoryFramed Co-Design with School Communities. In Proceedings of the 18th Panhellenic Conference on Informatics (PCI'14). ACM, NY, NY, USA, 16.
[31]
Eun Kwon, Gerard J. Kim. 2010. Humanoid Robot vs. Projector Robot: Exploring an Indirect Approach to Human Robot Interaction. In Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction (HRI '10). IEEE Press, Piscataway, NJ, USA, 157--158.
[32]
Matthew V. Law, JiHyun Jeong, Amritansh Kwatra, Malte F. Jung, and Guy Hoffman. 2019. Negotiating the Creative Space in Human-Robot Collaborative Design. In Proceedings of 2019 on Designing Interactive Systems Conference (DIS'19). ACM, NY, NY, USA, 645--657.
[33]
Matthew V. Law, Nikhil Dhawan, Hyunseung Bang, So-Yeon Yoon, Daniel Selva, and Guy Hoffman. 2018. Side-by-side Human-computer Design Using a Tangible User Interface. In Design Computing and Cognition '18. DCC 2018. Springer, Cham.
[34]
Duri Long, Mikhail Jacob, and Brian Magerko. 2019. Designing Co-Creative AI for Public Spaces. In Proceedings of the 2019 on Creativity and Cognition (C&C'19). ACM, NY, NY, USA, 271--284.
[35]
Arnold Lund. 2001. Measuring Usability with the USE Questionnaire. Usability and User Experience Newsletter of the STC Usability SIG. 8(2001).
[36]
Makoto Nakajima, Daisuke Sakamoto, and Takeo Igarashi. 2014. Offline Painted Media for Digital Animation Authoring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'14). ACM, NY, NY, USA, 321--330.
[37]
Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help But Only with Enough Details: Understanding the User Experience of Co-Creation with Artificial Intelligence. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). ACM, NY, NY, USA, 1--13.
[38]
Ayberk Ozgur, Wafa Johal, Francesco Mondada, and Pierre Dillenbourg. 2017. Haptic-Enabled Handheld Mobile Robots: Design and Analysis. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, NY, NY, USA, 2449--2461.
[39]
Eujin Pei, Ian Campbell, and Mark Evans. 2011. A Taxonomic Classification of Visual Design Representations Used by Industrial Designers and Engineering Designers. The Design Journal 14, 1 (2011), 64--91.
[40]
Cecil Piya, Vinayak, Senthil Chandrasegaran, Niklas Elmqvist, and Karthik Ramani. 2017. Co-3Deator: A Team-First Collaborative 3D Design Ideation Tool. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, NY, NY, USA, 6581--6592.
[41]
Aaron Powers, Sara Kiesler, Susan Fussell, and Cristen Torrey. 2007. Comparing a Computer Agent with a Humanoid Robot. In Proceedings of the ACM/IEEE international conference on Human-robot interaction (HRI'07). ACM, NY, NY, USA, 145--152.
[42]
Prashanth Thattai Ravikumar. 2017. Notational Communication with Co-creative Systems: Studying Improvements to Musical Coordination. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C'17). ACM, NY, NY, USA, 518--523.
[43]
Ruth Schulz, Philipp Kratzer, and Marc Toussaint. 2017. Building a Bridge with a Robot: A System for Collaborative On-table Task Execution. In Proceedings of the 5th International Conference on Human Agent Interaction (HAI'17). ACM, NY, NY, USA, 399--403.
[44]
Ticha Sethapakdi and James McCann. 2019. Painting with CATS: Camera-Aided Texture Synthesis. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI'19). ACM, NY, NY, USA, 1--9.
[45]
Ching-Long Shih and Li-Chen Lin. 2017. Trajectory Planning and Tracking Control of a Differential-Drive Mobile Robot in a Picture Drawing Application. Robotics. 6, 3(8, 2017).
[46]
Hyunyoung Song, Francois Guimbretiere, Tovi Grossman, and George Fitzmaurice. 2010. MouseLight: Bimanual Interactions on Digital Paper Using a Pen and a Spatially-Aware Mobile Projector. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'10). ACM, NY, NY, USA, 2451--2460.
[47]
Hyunyoung Song, Tovi Grossman, George Fitzmaurice, Francois Guimbretiere, Azam Khan, Ramtin Attar, and Gordon Kurtenbach. 2009. PenLight: Combining a Mobile Projector and a Digital Pen for Dynamic Visual Overlay. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'09). ACM, NY, NY, USA, 143152.
[48]
Masaki Suwa, John S. Gero, and Terry A. Purcell. 1998. The Roles of Sketches in Early Conceptual Design Processes. In Proceedings of Twentieth Annual Meeting of the Cognitive Science Society. Lawrence Erlbaum Hillsdale, New Jersey, 1043--1048.
[49]
Theophanis Tsandilas, Magdalini Grammatikou, and Stephane Huot. 2015. BricoSketch: Mixing Paper and Computer Drawing Tools in Professional Illustration. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS'15). ACM, NY, NY, USA, 127--136.
[50]
Pierre Wellner. 1991. The DigitalDesk calculator: tangible manipulation on a desk top display. In Proceedings of the 4th annual ACM symposium on User interface software and technology (UIST'91). ACM, NY, NY, USA, 27--33.
[51]
Blake Williford, Abhay Doke, and Michel Pahud. 2019. DrawMyPhoto: Assisting Novices in Drawing from Photographs. In Proceedings of the 2019 on Creativity and Cognition (C&C'19). ACM, NY, NY, USA, 198--209.
[52]
Yang Zhang, Chris Harrison. 2018. Pulp Nonfiction: Low-Cost Touch Tracking for Paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). ACM, NY, NY, USA, Paper No. 117.
[53]
OPEN AI LAB. 2019. Tengine. https://github.com/OAID/Tengine

Cited By

View all
  • (2024)The Renaissance of Human-Robot Coalescence in Industry 5.0Human-Machine Collaboration and Emotional Intelligence in Industry 5.010.4018/979-8-3693-6806-0.ch006(113-128)Online publication date: 30-Jun-2024
  • (2024)Can Machines Tell What People Want? Bringing Situated Intelligence to Generative AIProceedings of the Halfway to the Future Symposium10.1145/3686169.3686172(1-6)Online publication date: 21-Oct-2024
  • (2024)AI and Future-Making: Design, Biases, and Human-Plant InteractionsProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681738(24-35)Online publication date: 8-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. co-creative system
  2. creative robot
  3. early-stage design
  4. human-ai collaboration
  5. ideation

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)500
  • Downloads (Last 6 weeks)40
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The Renaissance of Human-Robot Coalescence in Industry 5.0Human-Machine Collaboration and Emotional Intelligence in Industry 5.010.4018/979-8-3693-6806-0.ch006(113-128)Online publication date: 30-Jun-2024
  • (2024)Can Machines Tell What People Want? Bringing Situated Intelligence to Generative AIProceedings of the Halfway to the Future Symposium10.1145/3686169.3686172(1-6)Online publication date: 21-Oct-2024
  • (2024)AI and Future-Making: Design, Biases, and Human-Plant InteractionsProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681738(24-35)Online publication date: 8-Oct-2024
  • (2024)Unpacking Human-AI interactions: From Interaction Primitives to a Design SpaceACM Transactions on Interactive Intelligent Systems10.1145/366452214:3(1-51)Online publication date: 8-Jun-2024
  • (2024)"I Wish You Could Make the Camera Stand Still": Envisioning Media Accessibility Interventions with People with AphasiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675598(1-17)Online publication date: 27-Oct-2024
  • (2024)AI and the Future of Collaborative Work: Group Ideation with an LLM in a Virtual CanvasProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663398(1-14)Online publication date: 25-Jun-2024
  • (2024)Text-to-Image AI as a Catalyst for Semantic Convergence in Creative CollaborationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661543(2753-2767)Online publication date: 1-Jul-2024
  • (2024)Affinity Diagramming with a RobotACM Transactions on Human-Robot Interaction10.1145/364151413:1(1-41)Online publication date: 11-Mar-2024
  • (2024)Perceptions of Interaction Dynamics in Co-Creative AI: A Comparative Study of Interaction Modalities in DrawctoProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656202(102-116)Online publication date: 23-Jun-2024
  • (2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media