StoryIcon: A Prototype for Visualizing Children’s Storytelling
Authors: 
Bingchan Shao, Yichi Zhang, Qi Wang, Xinchi Xu, Yang Zhou, Guihuan Feng, Fei LvAuthors Info & Claims
Bingchan Shao, Yichi Zhang, Qi Wang, Xinchi Xu, Yang Zhou, Guihuan Feng, Fei LvAuthors Info & ClaimsPages 152 - 157
Abstract
Storytelling is an activity to cultivate children’s comprehensive abilities. In this paper, we adopt a fully digital way of natural interaction to inspire children to create stories. To achieve story visualization, we develop a system StoryIcon. Based on visualization, we propose an avatar-based method to support visual story creation. The study of different degrees of facial similarity is affected by children’s attention. In addition, in order to ensure the integrity and fluency of the narrative, we incorporate conversation agents into the story system to guide children to tell stories. A preliminary experiment is conducted on 6 children aged 5-8 years old. The results show that the design is feasible and has guiding significance for the development of visualization systems in the future.
References
[1]
Bretagne Abirached, Yan Zhang, Jake K Aggarwal, Birgi Tamersoy, Tiago Fernandes, José Carlos Miranda, and Verónica Orvalho. 2011. Improving communication skills of children with ASDs through interaction with virtual characters. In 2011 IEEE 1st international conference on serious games and applications for health (SeGAH). IEEE, 1–4.
[2]
Houman Alborzi, Allison Druin, Jaime Montemayor, Michele Platner, Jessica Porteous, Lisa Sherman, Angela Boltman, Gustav Taxen, Jack Best, Joe Hammer, 2000. Designing StoryRooms: Interactive storytelling spaces for children. In Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques. 95–104.
[3]
Daniel Andrews and Chris Baber. 2014. Visualizing interactive narratives: employing a branching comic to tell a story and show its readings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1895–1904.
[4]
Steve Benford, Benjamin B Bederson, Karl-Petter Åkesson, Victor Bayon, Allison Druin, Pär Hansson, Juan Pablo Hourcade, Rob Ingram, Helen Neale, Claire O’malley, 2000. Designing storytelling technologies to encouraging collaboration between young children. In Proceedings of the SIGCHI conference on Human factors in computing systems. 556–563.
[5]
Justine Cassell and Kimiko Ryokai. 2001. Making space for voice: Technologies to support children’s fantasy and storytelling. Personal and ubiquitous computing 5, 3 (2001), 169–190.
[6]
Françoise Decortis and Antonio Rizzo. 2002. New active tools for supporting narrative structures. Personal and Ubiquitous Computing 6, 5 (2002), 416–429.
[7]
Nicoletta Di Blas and Bianca Boretti. 2009. Interactive storytelling in pre-school: a case-study. In Proceedings of the 8th International conference on interaction design and children. 44–51.
[8]
Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. ” Hey Google is it ok if I eat you?” Initial explorations in child-agent interaction. In Proceedings of the 2017 conference on interaction design and children. 595–600.
[9]
Jennifer W Glos and Justine Cassell. 1997. Rosebud: A place for interaction between memory, story, and self. In Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age. IEEE, 88–97.
[10]
Jérôme Guegan, Stéphanie Buisine, Fabrice Mantelet, Nicolas Maranzana, and Frédéric Segonds. 2016. Avatar-mediated creativity: When embodying inventors makes engineers more creative. Computers in Human Behavior 61 (2016), 165–175.
[11]
Phyllis N Hallenbeck. 1976. Remediating with comic strips. Journal of learning disabilities 9, 1 (1976), 11–15.
[12]
David Hawkridge. 2009. I, Avatar: The culture and consequences of having a second life–By Mark Stephen Meadows. British Journal of Educational Technology 40, 3 (2009), 577–580.
[13]
Sara Henriques and Zilda Fidalgo. [n.d.]. The relevance of storytelling in learning and memory. ([n. d.]).
[14]
Christoph Klimmt, Dorothée Hefner, and Peter Vorderer. 2009. The video game experience as “true” identification: A theory of enjoyable alterations of players’ self-perception. Communication theory 19, 4 (2009), 351–373.
[15]
Elly A Konijn and Johan F Hoorn. 2005. Some like it bad: Testing a model for perceiving and experiencing fictional characters. Media psychology 7, 2 (2005), 107–144.
[16]
Dong Dong Li, Albert Kien Liau, and Angeline Khoo. 2013. Player–Avatar Identification in video gaming: Concept and measurement. Computers in Human Behavior 29, 1 (2013), 257–263.
[17]
Hui Liang, Jian Chang, Ismail K Kazmi, Jian J Zhang, and Peifeng Jiao. 2017. Hand gesture-based interactive puppetry system to assist storytelling for children. The Visual Computer 33, 4 (2017), 517–531.
[18]
Silvia B Lovato, Anne Marie Piper, and Ellen A Wartella. 2019. Hey Google, do unicorns exist? Conversational agents as a path to answers to children’s questions. In Proceedings of the 18th ACM International Conference on Interaction Design and Children. 301–313.
[19]
Fei Lu, Feng Tian, Yingying Jiang, Xiang Cao, Wencan Luo, Guang Li, Xiaolong Zhang, Guozhong Dai, and Hongan Wang. 2011. ShadowStory: creative and collaborative digital storytelling inspired by cultural heritage. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1919–1928.
[20]
Lesley Mandel Morrow. 1985. Retelling stories: A strategy for improving young children’s comprehension, concept of story structure, and oral language complexity. The Elementary School Journal 85, 5 (1985), 647–661.
[21]
Raymond Ng and Robb Lindgren. 2013. Examining the effects of avatar customization and narrative on engagement and learning in video games. In Proceedings of CGAMES’2013 USA. IEEE, 87–90.
[22]
Carole Peterson and Allyssa McCabe. 2004. Echoing our parents: Parental influences on children’s narration. Family stories and the life course: Across time and generations (2004), 27–54.
[23]
Elisa Rubegni and Monica Landoni. 2014. Fiabot! Design and evaluation of a mobile storytelling application for schools. In Proceedings of the 2014 conference on Interaction design and children. 165–174.
[24]
Carolina Beniamina Rutta, Gianluca Schiavo, Massimo Zancanaro, and Elisa Rubegni. 2020. Collaborative comic-based digital storytelling with primary school children. In Proceedings of the Interaction Design and Children Conference. 426–437.
[25]
Kimiko Ryokai, Hayes Raffle, and Robert Kowalski. 2012. Storyfaces: pretend-play with ebooks to support social-emotional storytelling. In Proceedings of the 11th International Conference on Interaction Design and Children. 125–133.
[26]
Kimiko Ryokai, Cati Vaucelle, and Justine Cassell. 2003. Virtual peers as partners in storytelling and literacy learning. Journal of computer assisted learning 19, 2 (2003), 195–208.
[27]
Aryan Saini, Kartik Mathur, Abhinav Thukral, Nishtha Singhal, and Aman Parnami. 2019. Aesop: Authoring Engaging Digital Storytelling Experiences. In The Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software and Technology. 56–59.
[28]
Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE transactions on visualization and computer graphics 16, 6(2010), 1139–1148.
[29]
Astrida L Seja and Sandra W Russ. 1999. Children’s fantasy play and emotional understanding. Journal of clinical child psychology 28, 2 (1999), 269–277.
[30]
Kil-Soo Suh, Hongki Kim, and Eung Kyo Suh. 2011. What if your avatar looks like you? Dual-congruity perspectives for avatar use. MIs Quarterly (2011), 711–729.
[31]
Ming Sun, Iolanda Leite, Jill Fain Lehman, and Boyang Li. 2017. Collaborative storytelling between robot and child: A feasibility study. In Proceedings of the 2017 Conference on Interaction Design and Children. 205–214.
[32]
Jan Van Looy, Cédric Courtois, Melanie De Vocht, and Lieven De Marez. 2012. Player identification in online games: Validation of a scale for measuring identification in MMOGs. Media Psychology 15, 2 (2012), 197–221.
[33]
Jacqueline Kory Westlund and Cynthia Breazeal. 2015. The interplay of robot language level with children’s language learning during storytelling. In Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction extended abstracts. 65–66.
[34]
Ying Xu, Dakuo Wang, Penelope Collins, Hyelim Lee, and Mark Warschauer. 2021. Same benefits, different communication patterns: Comparing Children’s reading with a conversational agent vs. a human partner. Computers & Education 161 (2021), 104059.
[35]
Ying Xu and Mark Warschauer. 2020. ” Elinor Is Talking to Me on the Screen!” Integrating Conversational Agents into Children’s Television Programming. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8.
[36]
Niloofar Zarei, Sharon Lynn Chu, Francis Quek, Nanjie’Jimmy’ Rao, and Sarah Anne Brown. 2020. Investigating the Effects of Self-Avatars and Story-Relevant Avatars on Children’s Creative Storytelling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.
Index Terms
- StoryIcon: A Prototype for Visualizing Children’s Storytelling
Index terms have been assigned to the content through auto-classification.
Recommendations
Interactive storytelling for children
IDC '10: Proceedings of the 9th International Conference on Interaction Design and ChildrenSince the nineties, storytelling has received increasing attention in the HCI, IDC, and AI communities, exploring the potential of interactivity and multimedia as a means to promote engagement, enjoyment, fun, to foster new forms of children's ...
Detecting Gender Stereotypes in Children Digital StoryTelling
IDC '19: Proceedings of the 18th ACM International Conference on Interaction Design and ChildrenGender is a major variable affecting identity and life opportunities from a young age. Our research aims to explore the persistence of gender stereotypes in multimedia stories created by children with the final purpose of attenuating this stereotypical ...
Interactive Storytelling for Children Education
VS-GAMES '09: Proceedings of the 2009 Conference in Games and Virtual Worlds for Serious ApplicationsIn latest years there is a consisting trend in creating educational opportunities for schools increasingly rich and involving for children. Constructivism and technology represent an important combination to define innovative educational courses. ...
Comments
Information & Contributors
Information
Published In
October 2021
166 pages
ISBN:9781450386951
DOI:10.1145/3490355
Copyright © 2021 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 February 2022
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Conference
Chinese CHI 2021
Chinese CHI 2021: The Ninth International Symposium of Chinese CHI
October 16 - 17, 2021
Online, Hong Kong
Acceptance Rates
Overall Acceptance Rate 17 of 40 submissions, 43%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 150Total Downloads
- Downloads (Last 12 months)56
- Downloads (Last 6 weeks)3
Reflects downloads up to 27 Jul 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format