research-article

Visualizing interactive narratives: employing a branching comic to tell a story and show its readings

Authors:

Daniel Andrews,

Chris BaberAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1895 - 1904

https://doi.org/10.1145/2556288.2557296

Published: 26 April 2014 Publication History

Abstract

This paper describes the design and evaluation of a branching comic to compare how readers recall a visual narrative when presented as an interactive, digital program, or as a linear sequence on paper. The layout of the comic is used to visualize this data as heat maps and explore patterns of users' recollections. We describe the theoretical justification for this based upon previous work in narrative visualizations, interactive stories and comics. Having tested the comic with school boys aged 11-12; we saw patterns in the data that complement other research in both interactive stories and visualizations. We argue that the heat maps helped identify these patterns, which have implications for future designs and analyses of interactive visual and/or narrative media.

References

[1]

Abello, J., Broadwell, P., and Tangherlini, T. R. Computational Folkloristics. Communications of the ACM 55, 7 (2012), 60--70.

Digital Library

[2]

Adams, E. and Rollings, A. Fundamentals of Game Design. Pearson Prentice Hall, 2007.

[3]

Andrews, D., Baber, C., Efremov, S., and Komarov, M. Creating and using interactive narratives: reading and writing branching comics. Proc. CHI 2012, ACM Press (2012), 1703--1712.

Digital Library

[4]

Aylett, R., Louchart, S., Tychsen, A., Hitchens, M., Figueiredo, R., and Mata, C. D. Managing emergent character-based narrative. Proc. INTETAIN 2008, ICST (2008), 1--8.

Digital Library

[5]

Aylett, R., Louchart, S., and Weallans, A. Research in Interactive Drama Environments, Role-Play and StoryTelling. In M. Si, D. Thue, E. André, J. Lester, J. Tanenbaum and V. Zammitto, eds., Interactive Storytelling. Springer Berlin Heidelberg, 2011, 1--12.

Digital Library

[6]

Barthes, R. and Duisit, L. An Introduction to the Structural Analysis of Narrative. New Literary History 6, 2 (1975), 237--272.

[7]

Black, J. B. and Wilensky, R. An Evaluation of Story Grammars*. Cognitive Science 3, 3 (1979), 213--229.

[8]

Cohn, N., Paczynski, M., Jackendoff, R., Holcomb, P. J., and Kuperberg, G. R. (Pea)nuts and bolts of visual narrative: Structure and meaning in sequential image comprehension. Cognitive Psychology 65, 1 (2012), 1--38.

[9]

Cohn, N. Visual Narrative Structure. Cognitive Science 37, 3 (2013), 413--452.

[10]

Diakopoulos, N., Kivran-Swaine, F., and Naaman, M. Playable data: characterizing the design space of gamey infographics. Proc. CHI 2011, ACM Press (2011), 1717--1726.

Digital Library

[11]

Dundes, A. Binary Opposition in Myth: The Propp/Lévi-Strauss Debate in Retrospect. Western Folklore 56, 1 (1997), 39--50.

[12]

Finlayson, M. A. Deriving Narrative Morphologies via Analogical Story Merging. Proc. Analogy 09, New Bulgarian University Press (2009), 127--136.

[13]

Garnham, A. What's wrong with story grammars. Cognition 15, 1-3 (1983), 145--154.

[14]

Hudson, L. DC Releases a Choose Your Own Adventure-Style Digital Comic About Batman. Wired, (2013). http://www.wired.com/underwire/2013/12/chooseyour-adventure-comic/.

[15]

Knickmeyer, R. L. and Mateas, M. Preliminary evaluation of the interactive drama facade. Proc. CHI EA '05, ACM Press (2005), 1549--1552.

Digital Library

[16]

Mandler, J. M. and Johnson, N. S. Remembrance of things parsed: Story structure and recall. Cognitive Psychology 9, 1 (1977), 111--151.

[17]

Mangen, A. Hypertext fiction reading: haptics and immersion. Journal of Research in Reading 31, 4 (2008), 404--419.

[18]

McCloud, S. Understanding Comics: The Invisible Art. HarperCollins, 1994.

[19]

Medler, B., John, M., and Lane, J. Data cracker: developing a visual game analytic tool for analyzing online gameplay. Proc. CHI 2011, ACM Press (2011), 2365--2374.

Digital Library

[20]

Mitchell, A. and McGee, K. Limits of rereadability in procedural interactive stories. Proc. CHI 2011, ACM Press (2011), 1939--1948.

Digital Library

[21]

Moissinac, L. Review of Psychonarratology: Foundations for the empirical study of literary response. Narrative Inquiry 14, 1 (2004), 231--234.

[22]

Moura, D., el-Nasr, M. S., and Shaw, C. D. Visualizing and understanding players' behavior in video games: discovering patterns and supporting aggregation and comparison. ACM SIGGRAPH 2011 Game Papers, ACM Press (2011), 2:1--2:6.

Digital Library

[23]

Pearman, C. J. Independent Reading of CD-ROM Storybooks: Measuring Comprehension with Oral Retellings. The Reading Teacher 61, 8 (2008), 594--602.

[24]

Poels, K., de Kort, Y., and Ijsselsteijn, W. "It is always a lot of fun!": exploring dimensions of digital game experience using focus group methodology. Proc. Future Play 2007, ACM Press (2007), 83--89.

Digital Library

[25]

Pope, J. Where Do We Go From Here? Readers' Responses to Interactive Fiction: Narrative Structures, Reading Pleasure and the Impact of Interface Design. Convergence: The International Journal of Research into New Media Technologies 16, 1 (2010), 75--94.

[26]

Propp, V. and Wagner, L. A. Morphology of the Folk Tale. University of Texas Press, 2010.

[27]

Rumelhart, D. E. Notes on a schema for stories. In Representation and understanding: Studies in cognitive science. Academic Press, New York, 1975, 211--236.

[28]

Sali, S. and Mateas, M. Using Information Visualization to Understand Interactive Narrative: A Case Study on Façade. In M. Si, D. Thue, E. André, J. C. Lester, J. Tanenbaum and V. Zammitto, eds., Interactive Storytelling. Springer Berlin Heidelberg, 2011, 284--289.

Digital Library

[29]

Segel, E. and Heer, J. Narrative Visualization: Telling Stories with Data. IEEE Transactions on Visualization and Computer Graphics 16, 6 (2010), 1139--1148.

Digital Library

[30]

Seif El-Nasr, M., Milam, D., and Maygoli, T. Experiencing interactive narrative: A qualitative analysis of Façade. Entertainment Computing 4, 1 (2013), 39--52.

[31]

Thorndyke, P. W. Cognitive structures in comprehension and memory of narrative discourse. Cognitive Psychology 9, 1 (1977), 77--110.

[32]

Urakami, J. and Krems, J. F. How hypertext reading sequences affect understanding of causal and temporal relations in story comprehension. Instructional Science 40, 2 (2012), 277--295.

Cited By

Dunnell KAgarwal GPataranutaporn PLippman AMaes P(2024)AI-Generated Media for Exploring Alternate RealitiesExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650861(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650861
Nadal CMcCully SDoherty KSas CDoherty G(2022)The TAC Toolkit: Supporting Design for User Acceptance of Health Technologies from a Macro-Temporal PerspectiveProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502039(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502039
Shao BZhang YWang QXu XZhou YFeng GLv F(2021)StoryIcon: A Prototype for Visualizing Children’s StorytellingProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490377(152-157)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490377
Show More Cited By

Index Terms

Visualizing interactive narratives: employing a branching comic to tell a story and show its readings
1. Human-centered computing

Recommendations

Interactive stories and the audience: Why empathy is important
SPECIAL ISSUE: TV and Video Entertainment Environments

Interactive narratives have long been advocated as having the potential to create more immersive and transformative experiences for audiences by adding the pleasure of agency. In practice, however, finding the balance between sufficient interactivity ...
Interactive TV narratives: Opportunities, progress, and challenges

This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...
Children's interactive narratives: how far is UP?
IE '13: Proceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death

How Far is UP? is a children's book app. In making this work I drew on cognitive science, games and children's literary theory with the aim of investigating the relationships between multimedia, interactivity and narrative flow.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
797
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)7

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dunnell KAgarwal GPataranutaporn PLippman AMaes P(2024)AI-Generated Media for Exploring Alternate RealitiesExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650861(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650861
Nadal CMcCully SDoherty KSas CDoherty G(2022)The TAC Toolkit: Supporting Design for User Acceptance of Health Technologies from a Macro-Temporal PerspectiveProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502039(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502039
Shao BZhang YWang QXu XZhou YFeng GLv F(2021)StoryIcon: A Prototype for Visualizing Children’s StorytellingProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490377(152-157)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490377
Gloder ADucceschi LZancanaro M(2020)A Language-based Interface for Analysis of Digital StorytellingProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399859(1-5)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3399715.3399859
Rutta CSchiavo GZancanaro MRubegni ERubegni EVasalou AParés NSawhney N(2020)Collaborative comic-based digital storytelling with primary school childrenProceedings of the Interaction Design and Children Conference10.1145/3392063.3394433(426-437)Online publication date: 21-Jun-2020
https://dl.acm.org/doi/10.1145/3392063.3394433
Rutta CSchiavo GZancanaro MTellioglu HTeli MNathan L(2019)Comic-based Digital Storytelling for Self-expressionProceedings of the 9th International Conference on Communities & Technologies - Transforming Communities10.1145/3328320.3328400(9-13)Online publication date: 3-Jun-2019
https://dl.acm.org/doi/10.1145/3328320.3328400
Rutta CSchiavo GZancanaro MRubegni EFails J(2019)Comic-based Digital Storytelling with Primary School ChildrenProceedings of the 18th ACM International Conference on Interaction Design and Children10.1145/3311927.3325331(508-513)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3311927.3325331
Cohn N(2019)Your Brain on Comics: A Cognitive Model of Visual Narrative ComprehensionTopics in Cognitive Science10.1111/tops.1242112:1(352-386)Online publication date: 8-Apr-2019
https://doi.org/10.1111/tops.12421
Kapadia MMuniz CSohn SPan YSchriber SMitchell KGross M(2019)JUNGLE: An Interactive Visual Platform for Collaborative Creation and Consumption of Nonlinear Transmedia StoriesInteractive Storytelling10.1007/978-3-030-33894-7_26(250-266)Online publication date: 19-Nov-2019
https://dl.acm.org/doi/10.1007/978-3-030-33894-7_26
Rutta CSchiavo GZancanaro M(2018)Interactive Comic-Based Digital Storytelling for Self-expressionInteractive Storytelling10.1007/978-3-030-04028-4_79(657-661)Online publication date: 21-Nov-2018
https://doi.org/10.1007/978-3-030-04028-4_79
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents