Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Narratives + Diagrams: An Integrated Approach for Externalizing and Sharing People's Causal Beliefs

Published: 18 October 2021 Publication History

Abstract

Causal knowledge is of interest in many areas, such as statistics and machine learning, as it allows people and algorithms to predict outcomes and make data-driven decisions. Researchers in CSCW have proposed tools and workflows to externalize causal knowledge or beliefs from a group of people; however, most of the generated causal diagrams lack a deeper understanding of the causal mechanisms or could not capture diverse beliefs. By integrating narratives with causal diagrams, we implemented an interactive system that allows users to 1) write narratives to rationalize their perceived causal relationships, 2) visualize their causal models using directed diagrams, and 3) review and utilize others' causal diagrams and narratives. We conducted a user study (N=20) to learn how participants leveraged this integrated approach to externalize their perceived causal models for a given application context. Our results showed that the approach implemented in our tool enabled the externalization of users' causal beliefs (e.g., how and why a causal relationship might occur), allowed blind spots of individuals' causal reasoning to be revealed (e.g., learning new ideas from peers), and inspired their causal reasoning (e.g., revising or adding new causal relationships). We also identified the individual differences in people's causal beliefs and observed the impacts of showing others' causal models when one is building his/her causal diagram and narratives. This work provides practical design implications for developing collaborative tools that facilitate capturing and sharing causal beliefs.

Supplementary Material

ZIP File (v5cscw444aux.zip)
Supplemental Material for "Narratives + Diagrams: An Integrated Approach for Externalizing and Sharing People's Causal Beliefs"

References

[1]
Mark S Ackerman, Juri Dachtera, Volkmar Pipek, and Volker Wulf. Sharing knowledge and expertise: The cscw view of knowledge management. Computer Supported Cooperative Work (CSCW), 22(4--6):531--573, 2013.
[2]
Lada A Adamic, Jun Zhang, Eytan Bakshy, and Mark S Ackerman. Knowledge sharing and yahoo answers: everyone knows something. In Proceedings of the 17th international conference on World Wide Web, pages 665--674, 2008.
[3]
Payam Aminpour, Steven A Gray, Antonie J Jetter, Joshua E Introne, Alison Singer, and Robert Arlinghaus. Wisdom of stakeholder crowds in complex social--ecological systems. Nature Sustainability, 3(3):191--199, 2020.
[4]
Robert Axelrod. Structure of decision: The cognitive maps of political elites. Princeton university press, 2015.
[5]
Carlo Batini, Enrico Nardelli, and Roberto Tamassia. A layout algorithm for data flow diagrams. IEEE Transactions on Software Engineering, (4):538--546, 1986.
[6]
Roy F Baumeister and Kathleen D Vohs. Encyclopedia of social psychology, volume 1. Sage, 2007.
[7]
Dani Ben-Zvi. Scaffolding students' informal inference and argumentation. In Proceedings of the Seventh International Conference on Teaching Statistics, pages 1--6. International Statistical Institute Voorburg, the Netherlands, 2006.
[8]
Daniel Berenberg and James P Bagrow. Efficient crowd exploration of large networks: The case of causal attribution. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW):1--25, 2018.
[9]
Md Momen Bhuiyan, Amy X Zhang, Connie Moon Sehat, and Tanushree Mitra. Investigating differences in crowdsourced news credibility assessment: Raters, tasks, and expert criteria. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2):1--26, 2020.
[10]
Dorrit Billman, Gregorio Convertino, Jeff Shrager, P Pirolli, and J Massar. Collaborative intelligence analysis with cache and its effects on information gathering and cognitive bias. In Human Computer Interaction Consortium Workshop, 2006.
[11]
Richard J Boland Jr, Anil K Maheshwari, Dov Te'eni, David G Schwartz, and Ramkrishnan V Tenkasi. Sharing perspectives in distributed decision making. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work, pages 306--313, 1992.
[12]
Richard J Boland Jr and Ramkrishnan V Tenkasi. Perspective making and perspective taking in communities of knowing. Organization science, 6(4):350--372, 1995.
[13]
John H Boman and Owen Gallupe. Has covid-19 changed crime? crime rates in the united states during the pandemic. American journal of criminal justice, 45(4):537--545, 2020.
[14]
Josh C Bongard, Paul DH Hines, Dylan Conger, Peter Hurd, and Zhenyu Lu. Crowdsourcing predictors of behavioral outcomes. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 43(1):176--185, 2012.
[15]
Yang Chen, Jamal Alsakran, Scott Barlowe, Jing Yang, and Ye Zhao. Supporting effective common ground construction in asynchronous collaborative visual analytics. In 2011 IEEE Conference on Visual Analytics Science and Technology (VAST), pages 101--110. IEEE, 2011.
[16]
Haeyong Chung, Seungwon Yang, Naveed Massjouni, Christopher Andrews, Rahul Kanna, and Chris North. Vizcept: Supporting synchronous collaboration for constructing visualizations in intelligence analysis. In 2010 IEEE Symposium on Visual Analytics Science and Technology, pages 107--114. IEEE, 2010.
[17]
Jacob Cohen. A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1):37--46, 1960.
[18]
Harry Collins. Tacit and explicit knowledge. University of Chicago Press, 2010.
[19]
Kenneth James Williams Craik. The nature of explanation, volume 445. CUP Archive, 1952.
[20]
Claudia Dalbert, Isaac M Lipkus, Hedvig Sallay, and Irene Goch. A just and an unjust world: Structure and validity of different world beliefs. Personality and Individual Differences, 30(4):561--577, 2001.
[21]
David Danks. Unifying the mind: Cognitive representations as graphical models. Mit Press, 2014.
[22]
Adam Darlow, Gideon Goldin, and Steven Sloman. Causal interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1655--1664, 2014.
[23]
Matthew W Easterday, Vincent Aleven, and Richard Scheines. Tis better to construct than to receive? the effects of diagram tools on causal reasoning. Frontiers in artificial intelligence and applications, 158:93, 2007.
[24]
Siamak Faridani, Ephrat Bitton, Kimiko Ryokai, and Ken Goldberg. Opinion space: a scalable tool for browsing online comments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 1175--1184, 2010.
[25]
Rocio Garcia-Retamero and Ulrich Hoffrage. How causal knowledge simplifies decision-making. Minds and Machines, 16(3):365--380, 2006.
[26]
Charles F Gettys, Carol Manning, Tom Mehle, and Stanley D Fisher. Hypothesis generation: A final report of three years of research. Technical report, OKLAHOMA UNIV NORMAN DECISION PROCESSES LAB, 1980.
[27]
Roxana Girju. Automatic detection of causal relations for question answering. In Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering-Volume 12, pages 76--83. Association for Computational Linguistics, 2003.
[28]
Andrew S Gordon, Cosmin A Bejan, and Kenji Sagae. Commonsense causal reasoning using millions of personal stories. In Twenty-Fifth AAAI Conference on Artificial Intelligence, 2011.
[29]
Nitesh Goyal and Susan R Fussell. Effects of sensemaking translucence on distributed collaborative analysis. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, pages 288--302, 2016.
[30]
Nitesh Goyal, Gilly Leshed, Dan Cosley, and Susan R Fussell. Effects of implicit sharing in collaborative analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 129--138, 2014.
[31]
York Hagmayer and Cilia Witteman. Causal knowledge and reasoning in decision making. In Psychology of Learning and Motivation, volume 67, pages 95--134. Elsevier, 2017.
[32]
Kazuaki Hanawa, Akira Sasaki, Naoaki Okazaki, and Kentaro Inui. A crowdsourcing approach for annotating causal relation instances in wikipedia. In Proceedings of the 31st Pacific Asia Conference on Language, Information and Computation, pages 336--345, 2017.
[33]
Richard T Herschel, Hamid Nemati, and David Steiger. Tacit to explicit knowledge conversion: knowledge exchange protocols. Journal of knowledge management, 5(1):107--116, 2001.
[34]
Richards J Heuer. Psychology of intelligence analysis. Center for the Study of Intelligence, 1999.
[35]
Irving L Janis. Groupthink. IEEE Engineering Management Review, 36(1):36, 2008.
[36]
Philip Nicholas Johnson-Laird. Mental models: Towards a cognitive science of language, inference, and consciousness. Number 6. Harvard University Press, 1983.
[37]
James M Joyce. The foundations of causal decision theory. Cambridge University Press, 1999.
[38]
Steven A Julious and Mark A Mullee. Confounding and simpson's paradox. Bmj, 309(6967):1480--1481, 1994.
[39]
Corey Kosak, Joe Marks, and Stuart Shieber. Automating the layout of network diagrams with specified visual organization. IEEE Transactions on Systems, Man, and Cybernetics, 24(3):440--454, 1994.
[40]
Robin Lakoff. Language and woman's place. Language in society, 2(1):45--79, 1973.
[41]
Campbell Leaper and Rachael D Robnett. Women are more likely than men to use tentative language, aren't they? a meta-analysis testing for gender differences and moderators. Psychology of Women Quarterly, 35(1):129--142, 2011.
[42]
Narges Mahyar and Melanie Tory. Supporting communication and coordination in collaborative sensemaking. IEEE transactions on visualization and computer graphics, 20(12):1633--1642, 2014.
[43]
Shufan Ming, Ryan DW Mayfield, Haocong Cheng, Ke-Rou Wang, and Yun Huang. Examining interactions between community members and university safety organizations through community-sourced risk systems. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW1):1--23, 2021.
[44]
Frederick Mosteller and Cleo Youtz. Quantifying probabilistic expressions. Statistical Science, pages 2--12, 1990.
[45]
Sean A Munson and Paul Resnick. Presenting diverse political opinions: how and how much. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 1457--1466, 2010.
[46]
Donald A Norman. Some observations on mental models. Mental models, 7(112):7--14, 1983.
[47]
Bernie J O'Brien. Words or numbers? the evaluation of probability expressions in general practice. The Journal of the Royal College of General Practitioners, 39(320):98--100, 1989.
[48]
Eira Wyn Patterson. Structuring the composition process in scientific writing. International journal of science education, 23(1):1--16, 2001.
[49]
Judea Pearl. Causality. Cambridge university press, 2009.
[50]
Judea Pearl and Dana Mackenzie. The book of why: the new science of cause and effect. Basic Books, 2018.
[51]
Mark S Pfaff, Jill L Drury, and Garly L Klein. Crowdsourcing mental models using desim (descriptive to executable simulation modeling). In international conference on natualistic decision making, McLean, VA, 2015.
[52]
Mark S Pfaff, Jill L Drury, and Gary L Klein. Modeling knowledge using a crowd of experts. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 60, pages 183--187. SAGE Publications Sage CA: Los Angeles, CA, 2016.
[53]
Mark S Pfaff, Gary L Klein, and Jill D Egeth. Characterizing crowdsourced data collected using desim (descriptive to executable simulation modeling). In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 61, pages 178--182. SAGE Publications Sage CA: Los Angeles, CA, 2017.
[54]
William A Pike, Richard May, Bob Baddeley, Roderick Riensche, Joe Bruce, and Katarina Younkin. Scalable visual reasoning: Supporting collaboration through distributed analysis. In 2007 International Symposium on Collaborative Technologies and Systems, pages 24--32. IEEE, 2007.
[55]
Leonid Rozenblit and Frank Keil. The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive science, 26(5):521--562, 2002.
[56]
Colleen M Seifert, David E Meyer, Natalie Davidson, Andrea L Patalano, and Ilan Yaniv. Demystification of cognitive insight: Opportunistic assimilation and the prepared-mind hypothesis. 1994.
[57]
Pao Siangliulue, Joel Chan, Krzysztof Z Gajos, and Steven P Dow. Providing timely examples improves the quantity and quality of generated ideas. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition, pages 83--92, 2015.
[58]
Craig Silverman. The backfire effect: More on the press's inability to debunk bad information. Columbia Journalism Review, 2011.
[59]
Jonathan Silvertown. A new dawn for citizen science. Trends in ecology & evolution, 24(9):467--471, 2009.
[60]
Steven Sloman. Causal models: How people think about the world and its alternatives. Oxford University Press, 2005.
[61]
Peter Spirtes, Clark N Glymour, Richard Scheines, and David Heckerman. Causation, prediction, and search. MIT press, 2000.
[62]
Bethany A Teachman, Kathrine D Gapinski, Kelly D Brownell, Melissa Rawlins, and Subathra Jeyaram. Demonstrations of implicit anti-fat bias: the impact of providing causal information and evoking empathy. Health psychology, 22(1):68, 2003.
[63]
Joshua B Tenenbaum, Charles Kemp, Thomas L Griffiths, and Noah D Goodman. How to grow a mind: Statistics, structure, and abstraction. science, 331(6022):1279--1285, 2011.
[64]
David R Thomas. A general inductive approach for qualitative data analysis. 2003.
[65]
Luis A Vasconcelos and Nathan Crilly. Inspiration and fixation: Questions, methods, findings, and challenges. Design Studies, 42:1--32, 2016.
[66]
Michael R Waldmann. Knowledge-based causal induction. Psychology of Learning and Motivation, 34:47--88, 1996.
[67]
Michael R Waldmann and Keith J Holyoak. Predictive and diagnostic learning within causal models: Asymmetries in cue competition. Journal of Experimental Psychology: General, 121(2):222, 1992.
[68]
Mengting Wan and Julian McAuley. Modeling ambiguity, subjectivity, and diverging viewpoints in opinion question answering systems. In 2016 IEEE 16th international conference on data mining (ICDM), pages 489--498. IEEE, 2016.
[69]
Jun Wang and Klaus Mueller. The visual causality analyst: An interactive interface for causal reasoning. IEEE transactions on visualization and computer graphics, 22(1):230--239, 2015.
[70]
Wesley Willett, Jeffrey Heer, and Maneesh Agrawala. Strategies for crowdsourcing social data analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 227--236, 2012.
[71]
Wesley Willett, Jeffrey Heer, Joseph Hellerstein, and Maneesh Agrawala. Commentspace: structured support for collaborative visual analysis. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 3131--3140, 2011.
[72]
Jian Zhao, Michael Glueck, Petra Isenberg, Fanny Chevalier, and Azam Khan. Supporting handoff in asynchronous collaborative sensemaking using knowledge-transfer graphs. IEEE transactions on visualization and computer graphics, 24(1):340--350, 2017.

Cited By

View all
  • (2024)Belief Miner: A Methodology for Discovering Causal Beliefs and Causal Illusions from General PopulationsProceedings of the ACM on Human-Computer Interaction10.1145/36372988:CSCW1(1-37)Online publication date: 26-Apr-2024
  • (2022)Supporting Domain Characterization in Visualization Design Studies With the Critical Decision Method2022 IEEE 4th Workshop on Visualization Guidelines in Research, Design, and Education (VisGuides)10.1109/VisGuides57787.2022.00007(8-15)Online publication date: Oct-2022

Index Terms

  1. Narratives + Diagrams: An Integrated Approach for Externalizing and Sharing People's Causal Beliefs

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Human-Computer Interaction
      Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW2
      CSCW2
      October 2021
      5376 pages
      EISSN:2573-0142
      DOI:10.1145/3493286
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 18 October 2021
      Published in PACMHCI Volume 5, Issue CSCW2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. causal beliefs
      2. causal diagrams
      3. explanatory narratives
      4. knowledge externalization
      5. knowledge sharing

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)67
      • Downloads (Last 6 weeks)14
      Reflects downloads up to 01 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Belief Miner: A Methodology for Discovering Causal Beliefs and Causal Illusions from General PopulationsProceedings of the ACM on Human-Computer Interaction10.1145/36372988:CSCW1(1-37)Online publication date: 26-Apr-2024
      • (2022)Supporting Domain Characterization in Visualization Design Studies With the Critical Decision Method2022 IEEE 4th Workshop on Visualization Guidelines in Research, Design, and Education (VisGuides)10.1109/VisGuides57787.2022.00007(8-15)Online publication date: Oct-2022

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media