short-paper

Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation

Authors:

Ronald Metoyer,

Walter ScheirerAuthors Info & Claims

IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces

Pages 503 - 507

https://doi.org/10.1145/3172944.3173007

Published: 05 March 2018 Publication History

Abstract

Online writers and journalism media are increasingly combining visualization (and other multimedia content) with narrative text to create narrative visualizations. Often, however, the two elements are presented independently of one another. We propose an approach to automatically integrate text and visualization elements. We begin with a writer»s narrative that presumably can be supported with visual data evidence. We leverage natural language processing, quantitative narrative analysis, and information visualization to (1) automatically extract narrative components (who, what, when, where) from data-rich stories, and (2) integrate the supporting data evidence with the text to develop a narrative visualization. We also employ bidirectional interaction from text to visualization and visualization to text to support reader exploration in both directions. We demonstrate the approach with a case study in the data-rich field of sports journalism.

References

[1]

Ruben Arcos and Randolph Pherson. 2015. Intelligence Communication in the Digital Era: Transforming Security, Defence and Business. Springer.

[2]

Chris Bryan, Kwan-Liu Ma, and Jonathan Woodring. 2017. Temporal summary images: An approach to narrative visualization via interactive annotation generation and placement. IEEE transactions on visualization and computer graphics 23, 1 (2017), 511--520.

Digital Library

[3]

Wenwen Dou, Xiaoyu Wang, Drew Skau, William Ribarsky, and Michelle X Zhou. 2012. Leadline: Interactive visual analysis of text data through event identification and exploration. In Visual Analytics Science and Technology (VAST), 2012 IEEE Conference on. IEEE, 93--102.

Digital Library

[4]

Roberto Franzosi. 2010. Quantitative narrative analysis. Number 162. Sage.

[5]

Jessica Hullman and Nick Diakopoulos. 2011. Visualization rhetoric: Framing effects in narrative visualization. IEEE transactions on visualization and computer graphics 17, 12 (2011), 2231--2240.

Digital Library

[6]

Jessica Hullman, Nicholas Diakopoulos, and Eytan Adar. 2013. Contextifier: automatic generation of annotated stock visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2707--2716.

Digital Library

[7]

Stefan J"anicke, Greta Franzini, Muhammad Faisal Cheema, and Gerik Scheuermann. 2015. On close and distant reading in digital humanities: A survey and future challenges. Proc. EuroVis, Cagliari, Italy (2015).

[8]

Matthew L. Jockers. 2013. Macroanalysis: Digital Methods and Literary history. University of Illinois Press.

Digital Library

[9]

Robert Kosara and Jock Mackinlay. 2013. Storytelling: The next step for visualization. Computer 46, 5 (2013), 44--50.

Digital Library

[10]

Bum Chul Kwon, Florian Stoffel, Dominik J"ackle, Bongshin Lee, and Daniel Keim. 2014. VisJockey: Enriching Data Stories through Orchestrated Interactive Visualization. In Poster Compendium of the Computation

[11]

Journalism Symposium, Vol. 3.

[12]

Bongshin Lee, Nathalie Henry Riche, Petra Isenberg, and Sheelagh Carpendale. 2015. More than telling a story: Transforming data into visually shared stories. IEEE computer graphics and applications 35, 5 (2015), 84--90.

[13]

Franco Moretti. 2013. Distant Reading. Verso Books.

[14]

Chris North and Ben Shneiderman. 2000. Snap-together visualization: a user interface for coordinating visualizations via relational schemata. In Proceedings of the working conference on Advanced visual interfaces. ACM, 128--135.

Digital Library

[15]

Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE transactions on visualization and computer graphics 16, 6 (2010), 1139--1148.

Digital Library

Cited By

Li HWang YQu H(2024)Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI CollaborationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642726(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642726
He SChen YXia YLi YLiang HYu L(2024)Visual harmony: text-visual interplay in circular infographicsJournal of Visualization10.1007/s12650-024-00957-327:2(255-271)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1007/s12650-024-00957-3
Jiang PRayan JDow SXia H(2023)Graphologue: Exploring Large Language Model Responses with Interactive DiagramsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606737(1-20)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606737
Show More Cited By

Index Terms

Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Information extraction
2. Human-centered computing
  1. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

Storytelling in Information Visualizations: Does it Engage Users to Explore Data?
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

We present the results of three web-based field experiments, in which we evaluate the impact of using initial narrative visualization techniques and storytelling on user-engagement with exploratory information visualizations. We conducted these ...
Visualization Rhetoric: Framing Effects in Narrative Visualization

Narrative visualizations combine conventions of communicative and exploratory information visualization to convey an intended story. We demonstrate visualization rhetoric as an analytical framework for understanding how design techniques that prioritize ...
Narrative Visualization: Telling Stories with Data

Data visualization is regularly promoted for its ability to reveal stories within data, yet these “data stories” differ in important ways from traditional forms of storytelling. Storytellers, especially online journalists, have increasingly been ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces

March 2018

698 pages

ISBN:9781450349451

DOI:10.1145/3172944

General Chairs:
Shlomo Berkovsky
CSIRO, Australia
,
Yoshinori Hijikata
Kwansei Gakuin University, Japan
,
Jun Rekimoto
University of Tokyo, Japan
,
Program Chairs:
Margaret Burnett
Oregon State University, USA
,
Mark Billinghurst
University of South Australia, Australia
,
Aaron Quigley
University of St Andrews, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

IUI'18

Sponsor:

SIGAI

IUI'18: 23rd International Conference on Intelligent User Interfaces

March 7 - 11, 2018

Tokyo, Japan

Acceptance Rates

IUI '18 Paper Acceptance Rate 43 of 299 submissions, 14%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
742
Total Downloads

Downloads (Last 12 months)102
Downloads (Last 6 weeks)11

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li HWang YQu H(2024)Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI CollaborationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642726(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642726
He SChen YXia YLi YLiang HYu L(2024)Visual harmony: text-visual interplay in circular infographicsJournal of Visualization10.1007/s12650-024-00957-327:2(255-271)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1007/s12650-024-00957-3
Jiang PRayan JDow SXia H(2023)Graphologue: Exploring Large Language Model Responses with Interactive DiagramsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606737(1-20)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606737
Jordan BKoesten LMöller T(2023)Chatting About Data - Interacting with Voice Interfaces to Engage with Election Panel DataProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597126(1-12)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597126
Wang YKim Y(2023)Making Data-Driven Articles more Accessible: An Active Preference Learning Approach to Data Fact PersonalizationProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595986(1353-1366)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595986
Masson DMalacria SCasiez GVogel D(2023)Charagraph: Interactive Generation of Charts for Realtime Annotation of Data-Rich ParagraphsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581091(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581091
Song SChen JLi CWang C(2023)GVQA: Learning to Answer Questions about Graphs with Visualizations via Knowledge BaseProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581067(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581067
Shen LZhang YZhang HWang Y(2023)Data Player: Automatic Generation of Data Videos with Narration-Animation InterplayIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332719730:1(109-119)Online publication date: 3-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3327197
Shen LShen ELuo YYang XHu XZhang XTai ZWang J(2023)Towards Natural Language Interfaces for Data Visualization: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314800729:6(3121-3144)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3148007
Christino LFerreira MPaulovich F(2022)Q4EDA: A Novel Strategy for Textual Information Retrieval Based on User Interactions with Visual Representations of Time SeriesInformation10.3390/info1308036813:8(368)Online publication date: 2-Aug-2022
https://doi.org/10.3390/info13080368
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents