abstract

StoryFaces: children exploring emotional expressions in storytelling with video

Authors:

Kimiko Ryokai,

Robert Kowalski,

Hayes RaffleAuthors Info & Claims

CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

Pages 87 - 96

https://doi.org/10.1145/1979742.1979605

Published: 07 May 2011 Publication History

Get Access

Abstract

We introduce StoryFaces, a new composition and storytelling tool for children to explore the role of emotional expressions in children's narrative. StoryFaces invites children to record emotional expressions and then automatically composes these recordings in storybook illustrations. After children watch their faces bring a story to life, they can "go backstage" to play with the story by rearranging the videos and altering the story text. This paper presents our exploratory prototype, a design rationale that focuses on supporting children's emotional growth through storytelling play and reflection, and reports on a formative evaluation with two children ages 4-6. Results from the evaluation suggest that children ages 4-6 are engaged in the activity, are excited to create a variety of emotional expressions, find the narratives funny yet clear, and work to re-craft and reinterpret story meanings through iterative editing and play with both video and textual content. Our goal is to provoke new ideas about how pretend play with digital tools can empower young children in a narrative process.

References

[1]

Ananny, M (2002). Supporting children's collaborative authoring: practicing written literacy while composing oral texts. Proc. of the CSCL, Boulder, CO.

Digital Library

Google Scholar

[2]

Bruner, J. (2004) Towards a Theory of Instruction. Belknap Press.

Google Scholar

[3]

Elf Yourself. http://www.elfyourself.com/

Google Scholar

[4]

Juan Pablo Hourcade, Benjamin B. Bederson, Allison Druin, and Gustav Tax. KidPad: collaborative storytelling for children. In CHI '02 extended abstracts on Human factors in computing systems.

Google Scholar

[5]

Piaget, J. (1976). The grasp of consciousness. Cambridge: Harvard University Press.

Google Scholar

[6]

Hayes Raffle, Cati Vaucelle, Ruibing Wang, and Hiroshi Ishii. 2007. Jabberstamp: embedding sound and voice in traditional drawings. In Proc IDC '07. ACM, New York, NY, USA, 137--144.

Digital Library

Google Scholar

[7]

Hayes Raffle, Rafael Ballagas, Glenda Revelle, Hiroshi Horii, Sean Follmer, Janet Go, Emily Reardon, Koichi Mori, Joseph Kaye, and Mirjana Spasojevic. 2010. Family story play: reading with young children (and elmo) over a distance. In Proc. CHI '10. ACM, New York, NY, USA, 1583--1592.

Digital Library

Google Scholar

[8]

Singer, Jerome L. (1998). Imaginative play in early childhood: A foundation for adaptive emotional and cognitive development. International Medical Journal. 1998 Jun; Vol 5(2): 93--100.

Google Scholar

[9]

Scott S. Snibbe and Hayes S. Raffle. Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. Proc. CHI '09.

Digital Library

Google Scholar

[10]

Snow, C. E. (1983). Literacy and language: Relationships during the preschool years. Harvard Educational Review, 53, 165--189.

Crossref

Google Scholar

[11]

Cati Vaucelle and Hiroshi Ishii. 2009. Play-it-by-eye! collect movies and improvise perspectives with tangible video objects. Artif. Intell. Eng. Des. Anal. Manuf. 23, 3 (August 2009), 305--316.

Digital Library

Google Scholar

[12]

Svetlana Yarosh, Kori M. Inkpen, and A.J. Bernheim Brush. 2010. Video playdate: toward free play across distance. In Proc. CHI '10. ACM, New York, NY, USA, 1251--1260.

Digital Library

Google Scholar

Cited By

View all

Hubbard LAdricula NBrown CPerkoff EDudy SColunga EYeh T(2023)The Dimensions of Reflection Coding Scheme: A New Tool for Measuring the Impact of Designing for Reflection in Early ChildhoodProceedings of the 15th Conference on Creativity and Cognition10.1145/3591196.3593512(519-528)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3591196.3593512
Suhan SKalaichelvan KSamarage LAlahakoon DSamarasinghe PNadeeshani M(2022)Automated Evaluation of Child Emotion Expression and Recognition Abilities2022 International Conference on Information Technology Systems and Innovation (ICITSI)10.1109/ICITSI56531.2022.9970990(388-393)Online publication date: 8-Nov-2022
https://doi.org/10.1109/ICITSI56531.2022.9970990
Duc-Minh Pham Trong-Nhan Dam-Nguyen Phuc-Thinh Nguyen-Vo Minh-Triet Tran (2013)Smart Teddy Bear a vision-based story teller2013 International Conference on Control, Automation and Information Sciences (ICCAIS)10.1109/ICCAIS.2013.6720564(257-262)Online publication date: Nov-2013
https://doi.org/10.1109/ICCAIS.2013.6720564
Show More Cited By

Index Terms

StoryFaces: children exploring emotional expressions in storytelling with video
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

StoryFaces: pretend-play with ebooks to support social-emotional storytelling
IDC '12: Proceedings of the 11th International Conference on Interaction Design and Children

We introduce StoryFaces, a new composition and storytelling tool for children to explore the role of emotional expressions in children's narrative. StoryFaces invites children to record emotional expressions that become part of storybook illustrations. ...
t-words: playing with sounds and creating narratives
ACE'12: Proceedings of the 9th international conference on Advances in Computer Entertainment

We present t-words an interface for children to playful explore sounds, words and sentences while developing pre-literate skills. The interface consists of rectangular blocks in which children can record and then play the recorded audio. Additionally ...
Exploring the use of an interactive storytelling toy to engage Ukranian child refugees in learning Italian
IDC '24: Proceedings of the 23rd Annual ACM Interaction Design and Children Conference

We report on an ongoing user study about the use of an interactive storytelling toy to engage child refugees in learning the language of their host countries, motivated by the scarcity of research regarding the design of technology for this understudied ...

Comments

Information & Contributors

Information

Published In

CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

May 2011

2554 pages

ISBN:9781450302685

DOI:10.1145/1979742

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
422
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hubbard LAdricula NBrown CPerkoff EDudy SColunga EYeh T(2023)The Dimensions of Reflection Coding Scheme: A New Tool for Measuring the Impact of Designing for Reflection in Early ChildhoodProceedings of the 15th Conference on Creativity and Cognition10.1145/3591196.3593512(519-528)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3591196.3593512
Suhan SKalaichelvan KSamarage LAlahakoon DSamarasinghe PNadeeshani M(2022)Automated Evaluation of Child Emotion Expression and Recognition Abilities2022 International Conference on Information Technology Systems and Innovation (ICITSI)10.1109/ICITSI56531.2022.9970990(388-393)Online publication date: 8-Nov-2022
https://doi.org/10.1109/ICITSI56531.2022.9970990
Duc-Minh Pham Trong-Nhan Dam-Nguyen Phuc-Thinh Nguyen-Vo Minh-Triet Tran (2013)Smart Teddy Bear a vision-based story teller2013 International Conference on Control, Automation and Information Sciences (ICCAIS)10.1109/ICCAIS.2013.6720564(257-262)Online publication date: Nov-2013
https://doi.org/10.1109/ICCAIS.2013.6720564
Ryokai KRaffle HKowalski RSchelhowe H(2012)StoryFacesProceedings of the 11th International Conference on Interaction Design and Children10.1145/2307096.2307111(125-133)Online publication date: 12-Jun-2012
https://dl.acm.org/doi/10.1145/2307096.2307111

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

StoryFaces: pretend-play with ebooks to support social-emotional storytelling

t-words: playing with sounds and creating narratives

Exploring the use of an interactive storytelling toy to engage Ukranian child refugees in learning Italian

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations