poster

StoryDrawer: A Co-Creative Agent Supporting Children's Storytelling through Collaborative Drawing

Authors:

Guanyun WangAuthors Info & Claims

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 354, Pages 1 - 6

https://doi.org/10.1145/3411763.3451785

Published: 08 May 2021 Publication History

Abstract

Storytelling is a common creative activity for children. During storytelling, children need creative support and are subjected to cognitive challenges. This paper explores a co-creative agent - StoryDrawer, which supports children in creating oral stories through collaborative drawing. StoryDrawer works with children in two strategies: Child says and AI draws; and Child scribbles and AI completes. These two collaborative strategies allow children to draw their stories as an externalization and provoke unexpected ideas. This paper presents the interaction design, collaborative strategies and implementation of StoryDrawer, and conducts a user study for the fun and task effectiveness of StoryDrawer. The results reveal that our system can encourage children's active participation in storytelling and help them create novel stories through human-computer collaboration.

References

[1]

Ali Algarni. 2019. Exploring neuroscience of creativity theories in designing co-creative agents. In Proceedings of the 2019 on Creativity and Cognition (C&C ’19). Association for Computing Machinery, New York, NY, USA, 686–690. https://doi.org/10.1145/3325480.3326559

Digital Library

[2]

Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. “Hey google is it ok if i eat you?”: initial explorations in child-agent interaction. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC ’17). Association for Computing Machinery, New York, NY, USA, 595–600. https://doi.org/10.1145/3078072.3084330

Digital Library

[3]

Franca Garzotto, Paolo Paolini, and Amalia Sabiescu. 2010. Interactive storytelling for children. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC ’10). Association for Computing Machinery, New York, NY, USA, 356–359. https://doi.org/10.1145/1810543.1810613

Digital Library

[4]

David Ha and Douglas Eck. 2017. A neural representation of sketch drawings. arXiv:1704.03477 [cs, stat]. Retrieved August 4, 2020 from http://arxiv.org/abs/1704.03477

[5]

Kendall F Haven. 2007. Story Proof: The Science behind the Startling Power of Story. Libraries Unlimited, Westport, Conn.

[6]

Beth Ann Hennessey and Teresa M. Amabile. 1988. Story-telling: a method for assessing children's creativity. J. Creat. Behav. 22, 4 (December 1988), 235–246. https://doi.org/10.1002/j.2162-6057.1988.tb00502.x

[7]

Juan Pablo Hourcade, Benjamin B. Bederson, Allison Druin, and Gustav Taxén. 2002. KidPad: collaborative storytelling for children. In CHI ’02 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’02). Association for Computing Machinery, New York, NY, USA, 500–501. https://doi.org/10.1145/506443.506449

Digital Library

[8]

Seth Hunter, Jeevan Kalanithi, and David Merrill. 2010. Make a riddle and telestory: designing children's applications for the siftables platform. In Proceedings of the 9th International Conference on Interaction Design and Children (IDC ’10). Association for Computing Machinery, New York, NY, USA, 206–209. https://doi.org/10.1145/1810543.1810572

Digital Library

[9]

David Kirsh. 2009. Projections, problem space, and anchoring. In Proceedings of the 31st Annual Conference of the Cognitive Science Society. 2310–2315.

[10]

David Kirsh. 2010. Thinking with external representations. AI Soc. 25, 4 (November 2010), 441–454. https://doi.org/10.1007/s00146-010-0272-8

[11]

Pavlos Koulouris and Evangelia V. Dimaraki. 2014. Digital gaming for co-creativity in learning: theory-framed co-design with school communities. In Proceedings of the 18th Panhellenic Conference on Informatics (PCI ’14). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/2645791.2645816

Digital Library

[12]

Max Kreminski, Melanie Dickinson, Michael Mateas, and Noah Wardrip-Fruin. 2020. Why are we like this?: the ai architecture of a co-creative storytelling game. In International Conference on the Foundations of Digital Games (FDG ’20). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3402942.3402953

Digital Library

[13]

Max Kreminski and Noah Wardrip-Fruin. 2019. Generative games as storytelling partners. In Proceedings of the 14th International Conference on the Foundations of Digital Games (FDG ’19). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3337722.3341861

Digital Library

[14]

Yuyu Lin, Jiahao Guo, Yang Chen, Cheng Yao, and Fangtian Ying. 2020. It is your turn: collaborative ideation with a co-creative robot through sketch. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376258

Digital Library

[15]

Robert McKee. 2010. Story: Style, Structure, Substance, and the Principles of Screenwriting. HarperCollins e-books.

[16]

Emily McReynolds, Sarah Hubbard, Timothy Lau, Aditya Saraf, Maya Cakmak, and Franziska Roesner. 2017. Toys that listen: a study of parents, children, and internet-connected toys. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5197–5207. https://doi.org/10.1145/3025453.3025735

Digital Library

[17]

Indrani Medhi Thies, Nandita Menon, Sneha Magapu, Manisha Subramony, and Jacki O'Neill. 2017. How do you want your chatbot? an exploratory wizard-of-oz study with young, urban indians. In Human-Computer Interaction - INTERACT 2017. Springer International Publishing, Cham, 441–459. https://doi.org/10.1007/978-3-319-67744-6_28

[18]

Nicoletta Noceti, Francesca Odone, Antonio Marsella, Matteo Moro, and Elena Nicora. 2020. Tangible coding for kids with ai inside. In Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization (UMAP ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 163–166. https://doi.org/10.1145/3386392.3399329

Digital Library

[19]

Prashanth Thattai Ravikumar. 2017. Notational communication with co-creative systems: studying improvements to musical coordination. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (C&C ’17). Association for Computing Machinery, New York, NY, USA, 518–523. https://doi.org/10.1145/3059454.3078702

Digital Library

[20]

Janet Read, Stuart Macfarlane, and Chris Casey. 2002. Endurability, engagement and expectations: measuring children's fun. In Proceedings of Conference on Interaction Design and Children. Shaker Publishing, 189–198.

[21]

Bernard R. Robin. 2008. Digital storytelling: a powerful technology tool for the 21st century classroom. Theory Pract. 47, 3 (July 2008), 220–228. https://doi.org/10.1080/00405840802153916

[22]

Ming Sun, Iolanda Leite, Jill Fain Lehman, and Boyang Li. 2017. Collaborative storytelling between robot and child: a feasibility study. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC ’17). Association for Computing Machinery, New York, NY, USA, 205–214. https://doi.org/10.1145/3078072.3079714

Digital Library

[23]

Cristina Sylla, Clara Coutinho, and Pedro Branco. 2014. A digital manipulative for embodied “stage-narrative” creation. Entertain. Comput. 5, 4 (December 2014), 495–507. https://doi.org/10.1016/j.entcom.2014.08.011

[24]

Wahju Agung Widjajanto, Michael Lund, and Heidi Schelhowe. 2008. “Wayang authoring”: a web-based authoring tool for visual storytelling for children. In Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (MoMM ’08). Association for Computing Machinery, New York, NY, USA, 464–467. https://doi.org/10.1145/1497185.1497284

Digital Library

[25]

Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. A is for artificial intelligence: the impact of artificial intelligence activities on young children's perceptions of robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290605.3300677

Digital Library

[26]

Blake Williford, Abhay Doke, Michel Pahud, Ken Hinckley, and Tracy Hammond. 2019. DrawMyPhoto: assisting novices in drawing from photographs. In Proceedings of the 2019 on Creativity and Cognition (C&C ’19). Association for Computing Machinery, New York, NY, USA, 198–209. https://doi.org/10.1145/3325480.3325507

Digital Library

[27]

A. Wright and A. Maley. 1997. Creating Stories with Children. OUP Oxford.

[28]

Li Xu. 2017. Practical research on creative graffiti for children. In Proceedings of the 2017 7th International Conference on Social Network, Communication and Education (SNCE 2017). Atlantis Press, 321–323. https://doi.org/10.2991/snce-17.2017.65

[29]

Cheng Zheng, Caowei Zhang, Xuan Li, Xin Liu, Chuqi Tang, Guanyun Wang, Cheng Yao, Fan Zhang, Wenjie Xu, and Fangtian Ying. 2017. Toon-chat: a cartoon-masked chat system for children with autism. In ACM SIGGRAPH 2017 Posters. ACM, Los Angeles California, 1–2. https://doi.org/10.1145/3102163.3102249

Digital Library

Cited By

Wang GZheng CFu YZhu KLai FZhang LLi MWu XRen MZheng YLian BZhang KWang QYao CLuo SYing FSun LTao Y(2024)KiPneu: Designing a Constructive Pneumatic Platform for Biomimicry Learning in STEAM EducationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661828(441-458)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661828
Deshpande MPark JPait SMagerko B(2024)Perceptions of Interaction Dynamics in Co-Creative AI: A Comparative Study of Interaction Modalities in DrawctoProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656202(102-116)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656202
Zhao YCheng YDing SFang YCao WLiu KCao J(2024)Magic Camera: An AI Drawing Game Supporting Instantaneous Story Creation for ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659386(738-743)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659386
Show More Cited By

Recommendations

StoryDrawer: A Child–AI Collaborative Drawing System to Support Children's Creative Visual Storytelling
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Visual storytelling is a new approach to creative expression based on verbal and figural creativity. The keys to visual storytelling are narrating and drawing over a period of time, which can be beneficial but also demanding on creativity for children. ...
A Tangible Platform for Mixing and Remixing Narratives
ACE 2013: Proceedings of the 10th International Conference on Advances in Computer Entertainment - Volume 8253

This work discusses a tangible interface for storytelling that targets pre-school children and offers a playful experimental space where children can create their own narratives by placing tangible picture-blocks on an electronic board. We present the ...
Magic Camera: An AI Drawing Game Supporting Instantaneous Story Creation for Children
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

Storytelling plays a crucial role in the development of children’s comprehensive abilities. This paper presents an innovative AI drawing game designed to enhance children’s capabilities in using metaphors and storytelling. The game employs a unique ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

2965 pages

ISBN:9781450380959

DOI:10.1145/3411763

Editors:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Ministry of Education of the People's Republic of China
National Natural Science Foundation of China

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
923
Total Downloads

Downloads (Last 12 months)250
Downloads (Last 6 weeks)27

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang GZheng CFu YZhu KLai FZhang LLi MWu XRen MZheng YLian BZhang KWang QYao CLuo SYing FSun LTao Y(2024)KiPneu: Designing a Constructive Pneumatic Platform for Biomimicry Learning in STEAM EducationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661828(441-458)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661828
Deshpande MPark JPait SMagerko B(2024)Perceptions of Interaction Dynamics in Co-Creative AI: A Comparative Study of Interaction Modalities in DrawctoProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656202(102-116)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656202
Zhao YCheng YDing SFang YCao WLiu KCao J(2024)Magic Camera: An AI Drawing Game Supporting Instantaneous Story Creation for ChildrenProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659386(738-743)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659386
Zhang CLiu XZiska KJeon SYu CXu Y(2024)Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative StorytellingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642647(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642647
Han AZhou XCai ZHan SKo RCorrigan SPeppler K(2024)Teachers, Parents, and Students' perspectives on Integrating Generative AI into Elementary Literacy EducationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642438(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642438
Zhou ZLi JZhang ZYu JDuh H(2024)Examining How the Large Language Models Impact the Conceptual Design with Human Designers: A Comparative Case StudyInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2370635(1-17)Online publication date: Jul-2024
https://doi.org/10.1080/10447318.2024.2370635
Schleiger EMason CNaughtin CReeson AParis C(2024)Collaborative Intelligence: A Scoping Review Of Current ApplicationsApplied Artificial Intelligence10.1080/08839514.2024.232789038:1Online publication date: 17-Mar-2024
https://doi.org/10.1080/08839514.2024.2327890
Kim TLee YChang MKim J(2023)Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language ModelsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606833(1-18)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606833
Han ACai Z(2023)Design implications of generative AI systems for visual storytelling for young learnersProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3593867(470-474)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3593867
Zhang CZhou ZHu YLiu LWu JShao YLiu JZhang LLiu LChen HYing FYao C(2023)Observe It, Draw It: Scaffolding Children’s Observations of Plant Biodiversity with an Interactive Drawing ToolProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589380(253-266)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3589380
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents