Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Towards Understanding and Supporting Journalistic Practices Using Semi-Automated News Discovery Tools

Published: 18 October 2021 Publication History

Abstract

Journalists are routinely challenged with monitoring vast information environments in order to identify what is newsworthy and of interest to report to a wider audience. In a process referred to as computational news discovery, alerts and leads based on data-driven algorithmic analysis can orient journalists' attention to events, documents, or anomalous patterns in data that are more likely to be newsworthy. In this paper we prototype one such news discovery tool, Algorithm Tips, which we designed to help journalists find newsworthy leads about algorithmic decision-making systems used across all levels of U.S. government. The tool incorporates algorithmic, crowdsourced, and expert evaluations into an integrated interface designed to support users in making editorial decisions about which news leads to pursue. We then present an evaluation of our prototype based on an extended deployment with eight professional journalists. Our findings offer insights into journalistic practices that are enabled and transformed by such news discovery tools, and suggest opportunities for improving computational news discovery tool designs to better support those practices.

References

[1]
Elena Agapie, Jaime Teevan, and Andrés Monroy-Hernández. 2015. Crowdsourcing in the Field: A Case Study Using Local Crowds for Event Reporting. Third AAAI Conference on Human Computation and Crowdsourcing (Sept. 2015).
[2]
Tanja Aitamurto. 2015. Crowdsourcing as a Knowledge-Search Method in Digital Journalism. Digital Journalism, Vol. 4, 2 (May 2015), 280--297.
[3]
Tanja Aitamurto, Mike Ananny, Chris W. Anderson, Larry Birnbaum, Nicholas Diakopoulos, Matilda Hanson, Jessica Hullman, and Nick Ritchie. 2019. HCI for Accurate, Impartial and Transparent Journalism: Challenges and Solutions. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA '19). ACM, New York, NY, USA, 1--8.
[4]
Omar Alonso. 2019. The Practice of Crowdsourcing. Morgan & Claypool.
[5]
Franziska Badenschier and Holger Wormer. 2011. Issue Selection in Science Journalism: Towards a Special Theory of News Values for Science News? In The Sciencestextquoteright Media Connection textendashPublic Communication and its Repercussions. Springer Netherlands, Dordrecht, 59--85.
[6]
Ruha Benjamin. 2019. ARace After Technology: Abolitionist Tools for the New Jim Code .Polity.
[7]
Kenneth Benoit, Drew Conway, Benjamin E. Lauderdale, Michael Laver, and Slava Mikhaylov. 2016. Crowd-sourced Text Analysis: Reproducible and Agile Production of Political Data. American Political Science Review, Vol. 110, 2 (May 2016), 278--295.
[8]
Frank Bentley, Katie Quehl, Jordan Wirfs-Brock, and Melissa Bica. 2019. Understanding Online News Behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, New York, USA, 1--11.
[9]
Esha Bhandari and Rachel Goodman. 2017. Data Journalism and the Computer Fraud and Abuse Act: Tips for Moving Forward in an Uncertain Landscape (Computation+Journalism Symposium).
[10]
Hannah Bloch-Wehba. 2020. Access to Algorithms. Fordham Law Review, Vol. 88 (2020).
[11]
Engin Bozdag. 2013. Bias in algorithmic filtering and personalization. Ethics and Information Technology, Vol. 15, 3 (June 2013), 209--227.
[12]
Petter Bae Brandtzaeg, Marika Lüders, Jochen Spangenberg, Linda Rath-Wiggins, and Asbjørn Følstad. 2015. Emerging Journalistic Verification Practices Concerning Social Media. Journalism Practice, Vol. 10, 3 (2015), 323--342. https://doi.org/10.1080/17512786.2015.1020331
[13]
Virginia Braun and Victoria Clarke. 2008. Using thematic analysis in psychology. Qualitative Research in Psychology, Vol. 3, 2 (July 2008), 77--101.
[14]
Matthew Brehmer, Stephen Ingram, Jonathan Stray, and Tamara Munzner. 2014. Overview: The design, adoption, and analysis of a visual document mining tool for investigative journalists. In IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 20, 12 (2014), 2271--2280.
[15]
Meredith Broussard. 2015. Artificial Intelligence for Investigative Reporting. Digital Journalism, Vol. 3, 6 (Nov. 2015), 814--831.
[16]
Madalina Busuioc. 2020. Accountable Artificial Intelligence: Holding Algorithms to Account. Public Administration Review (2020). https://doi.org/10.1111/puar.13293
[17]
Matt Carlson. 2017. Automating judgment? Algorithmic judgment, news knowledge, and journalistic professionalism. New Media & Society, Vol. 8, 4 (May 2017), 146144481770668.
[18]
Cary Coglianese and Lavi Ben Dor. 2020. AI in Adjudication and Administration: A Status Report on Governmental Use of Algorithmic Tools in the United States. Brooklyn Law Review (2020).
[19]
Sarah Cohen, James T. Hamilton, and Fred Turner. 2011. Computational journalism. Commun. ACM, Vol. 54, 10 (Oct. 2011), 66--71.
[20]
David Cuillier and Charles N. Davis. 2011. The Art of Access: Strategies for Acquiring Public Records. CQ Press, Washington DC.
[21]
Dharma Dailey and Kate Starbird. 2014. Journalists as Crowdsourcerers: Responding to Crisis by Reporting with a Crowd. Computer Supported Cooperative Work (CSCW), Vol. 23, 4 (Dec. 2014), 445--481.
[22]
Nicholas Diakopoulos. 2015. Algorithmic Accountability: Journalistic Investigation of Computational Power Structures. Digital Journalism, Vol. 3, 3 (2015), 398--415.
[23]
Nicholas Diakopoulos. 2019 a. Automating the news: How algorithms are rewriting the media .Harvard University Press.
[24]
Nicholas Diakopoulos. 2019 b. Towards a Design Orientation on Algorithms and Automation in News Production. Digital Journalism, Vol. 7, 8 (Nov. 2019), 1180--1184.
[25]
Nicholas Diakopoulos. 2020. Computational News Discovery: Towards Design Considerations for Editorial Orientation Algorithms in Journalism. Digital Journalism (2020), 1--23.
[26]
Nicholas Diakopoulos, Munmun De Choudhury, and Mor Naaman. 2012. Finding and assessing social media information sources in the context of journalism. In Proceedings of the CHI conference on human factors in computing systems. ACM, 2451--2460.
[27]
Nicholas Diakopoulos, Madison Dong, Leonard Bronner, and Jeremy Bowers. 2020. Generating Location-Based News Leads for National Politics Reporting. In Proc. Computation+Journalism Symposium .
[28]
Nicholas Diakopoulos, Sergio Goldenberg, and Irfan Essa. 2009. Videolyzer: Quality Analysis of Online Informational Video for Bloggers and Journalists. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). ACM, 799.
[29]
Nicholas Diakopoulos, Mor Naaman, and Funda Kivran-Swaine. 2010. Diamonds in the rough: Social media visual analytics for journalistic inquiry. In 2010 IEEE Symposium on Visual Analytics Science and Technology. 115--122.
[30]
Fernando José Fradique Duarte, Óscar Mortágua Pereira, and Rui L. Aguiar. 2019. Framework for the Discovery of Newsworthy Events in Social Media. International Journal of Organizational and Collective Intelligence (IJOCI), Vol. 9, 3 (2019), 45--62. https://doi.org/10.4018/ijoci.2019070103
[31]
David Freeman Engstrom, Daniel E. Ho, Catherine M. Sharkey, and Mariano-Florentino Cuéllar. 2020. Government by Algorithm: Artificial Intelligence in Federal Administrative Agencies. Technical Report.
[32]
Nel Escher and Nikola Banovic. 2020. Exposing Error in Poverty Management Technology: A Method for Auditing Government Benefits Screening Tools. PACM Human-Computer Interaction, Vol. 4, CSCW1 (2020). https://doi.org/10.1145/3392874
[33]
Virginia Eubanks. 2018. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin's Press.
[34]
Martin Flintham, Christian Karner, Khaled Bachour, Helen Creswick, Neha Gupta, and Stuart Moran. 2018. Falling for Fake News: Investigating the Consumption of News via Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--10. https://doi.org/10.1145/3173574.3173950
[35]
Luciano Floridi. 2020. Artificial Intelligence as a Public Service: Learning from Amsterdam and Helsinki. Philosophy & Technology, Vol. 33, 4 (10 2020), 541--546. https://doi.org/10.1007/s13347-020-00434--3
[36]
Asbjørn William Ammitzbøll Flügge, Thomas Hildebrandt, and Naja Holten Møller. 2020. Algorithmic Decision Making in Public Services: A CSCW-Perspective. In GROUP '20: Companion of the 2020 ACM International Conference on Supporting Group Work. 111--114. https://doi.org/10.1145/3323994.3369886
[37]
Floyd J. Fowler. 1995. Improving survey questions : design and evaluation. Sage Publications.
[38]
Graham R Gibbs. 2007. Analyzing qualitative data. Sage London, England.
[39]
Barney G Glaser and Anselm L Strauss. 2017. Discovery of grounded theory: Strategies for qualitative research. Routledge.
[40]
Lucas Graves. 2018. Understanding the Promise and Limits of Automated Fact-Checking. Technical Report. Reuters Institute for the Study of Journalism.
[41]
Nick Hagar and Nicholas Diakopoulos. 2019. Optimizing Content with A/B Headline Testing: Changing Newsroom Practices. Media and Communication, Vol. 7, 1 (2019), 117--127. https://doi.org/10.17645/mac.v7i1.1801
[42]
James T. Hamilton. 2016. Democracytextquoterights Detectives. Harvard University Press.
[43]
James T. Hamilton and Fred Turner. 2009. Accountability through algorithm: Developing the field of computational journalism. Center for Advanced Study in the Behavioral Sciences.
[44]
Tony Harcup and Deirdre O'Neill. 2001. What Is News? Galtung and Ruge revisited. Journalism Studies, Vol. 2, 2 (May 2001), 261--280.
[45]
Tony Harcup and Deirdre O'Neill. 2016. What is news? News values revisited (again). Journalism Studies, Vol. 23, 1 (March 2016), 1--19.
[46]
Naeemul Hassan, Fatma Arslan, Chengkai Li, and Mark Tremayne. 2017. Toward Automated Fact-Checking: Detecting Check-worthy Factual Claims by ClaimBuster. In Proc. Knowledge Discovery and Datamining KDD .
[47]
Melinda McClure Haughey, Meena Devii Muralikumar, Cameron Wood, and Kate Starbird. 2020. On the Misinformation Beat: Understanding the Work of Investigative Journalists Reporting on Problematic Information Online. Proc. ACM Hum.-Comput. Interact., Vol. 4, CSCW2 (2020).
[48]
Melanie Kellar, Carolyn Watters, and Kori M Inkpen. 2007. An exploration of web-based monitoring. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM Press, New York, New York, USA, 377--386.
[49]
Alayna Kennedy, Daphne Coates, and Katelyn Lindquist. 2020. Auditing Government AI: How to assess ethical vulnerability in machine learning. In Workshop on Navigating the Broader Impacts of AI Research Workshop at the 34th Conference on Neural Information Processing Systems (NeurIPS 2020) .
[50]
Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E. Kraut. 2011. CrowdForge: Crowdsourcing Complex Work. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 43--52. https://doi.org/10.1145/2047196.2047202
[51]
Tomoko Komatsu, Marisela Gutierrez Lopez, Stephann Makri, Colin Porlezza, Glenda Cooper, Andrew MacFarlane, and Sondess Missaoui. 2020. AI should embody our values: Investigating journalistic values to inform AI technology design. In Proceedings of the Nordic Conference on Human-Computer Interaction. https://doi.org/10.1145/3419249.3420105
[52]
Raymond Liaw, Ari Zilnik, Mark Baldwin, and Stephanie Butler. 2013. Maater: Crowdsourcing to Improve Online Journalism. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, CHI EA '13. 2549--2554. https://doi.org/10.1145/2468356.2468828
[53]
Fabienne Lind, Maria Gruber, and Hajo G. Boomgaarden. 2017. Content Analysis by the Crowd: Assessing the Usability of Crowdsourcing for Coding Latent Constructs. Communication Methods and Measures, Vol. 11, 3 (May 2017), 191--209.
[54]
Xiaomo Liu, Armineh Nourbakhsh, Quanzhi Li, Sameena Shah, Robert Martin, and John Duprey. 2017. Reuters tracer: Toward automated news production using large scale social media data. In 2017 IEEE International Conference on Big Data (Big Data). IEEE, 1483--1493.
[55]
Måns Magnusson, Jens Finnas, and Leonard Wallentin. 2016. Finding the news lead in the data haystack: Automated local data journalism using crime data. In Computation+Journalism Symposium.
[56]
Neil Maiden, Konstantinos Zachos, Amanda Brown, George Brock, Lars Nyre, Aleksander Nygrard Tonheim, Dimitris Apsotolou, and Jeremy Evans. 2018. Making the News: Digital Creativity Support for Journalists. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--11.
[57]
Tyler McDonnell, Matthew Lease, Mucahid Kutlu, and Tamer Elsayed. 2016. Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. Fourth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2016).
[58]
Cristina Monzer, Judith Moeller, Natali Helberger, and Sarah Eskens. 2020. User Perspectives on the News Personalisation Process: Agency, Trust and Utility as Building Blocks. Digital Journalism (2020), 1--21.
[59]
Janice Morse. 2004. Purposive Sampling. In The SAGE Encyclopedia of Social Science Research Methods, Michael Lewis-Beck, Alan Bryman, and Tim Futing Liao (Eds.). Sage Publications, Inc., Thousand Oaks,CA.
[60]
Enrico Motta, Enrico Daga, Andreas L. Opdahl, and Bjørnar Tessem. 2020. Analysis and Design of Computational News Angles. IEEE Access, Vol. 8 (2020).
[61]
Naja Holten Møller, Irina Shklovski, and Thomas T Hildebrandt. 2020. Shifting concepts of value: Designing algorithmic decision-support systems for public services. In Proceedings of the Nordic Conference on Human-Computer Interaction. 1--12. https://doi.org/10.1145/3419249.3420149
[62]
Armineh Nourbakhsh, Quanzhi Li, Xiaomo Liu, and Sameena Shah. 2017. "Breaking" Disasters - Predicting and Characterizing the Global News Value of Natural and Man-made Disasters. In Data Science+Journalism Workshop .
[63]
Changhoon Oh, Jinhan Choi, Sungwoo Lee, SoHyun Park, Daeryong Kim, Jungwoo Song, Dongwhan Kim, Joonhwan Lee, and Bongwon Suh. 2020. Understanding User Perception of Automated News Generation System. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13.
[64]
Deokgun Park, Simranjit Sachar, Nicholas Diakopoulos, and Niklas Elmqvist. 2016. Supporting comment moderators in identifying high quality online news comments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1114--1125.
[65]
Perry Parks. 2018. Textbook News Values: Stable Concepts, Changing Choices. Journalism & Mass Communication Quarterly, Vol. 96, 3 (Oct. 2018), 784--810.
[66]
Michael Quinn Patton. 2014. Qualitative Research & Evaluation Methods: Integrating Theory and Practice 4 ed.). Sage Publications.
[67]
William Perrin. 2017. Local News Engine: Can the machine help spot diamonds in the dust? In Data Journalism Past, Present, Future, John Mair, Richard Lance Keeble, Megan Lucero, and Martin Moore (Eds.). Abramis academic publishing.
[68]
Alicja Piotrkowicz, Vania Dimitrova, and Katja Markert. 2017. Automatic Extraction of News Values from Headline Text. In Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Valencia, Spain, 64--74.
[69]
David Randall. 2011. The Universal Journalist 4 ed.). PlutoPress.
[70]
Zvi Reich. 2006. The Process Model of News Initiative. Journalism Studies, Vol. 7, 4 (2006), 497--514. https://doi.org/10.1080/14616700600757928
[71]
Zvi Reich and Yigal Godler. 2014. A Time of Uncertainty: The effects of reporters' time schedule on their work. Journalism Studies, Vol. 15, 5 (2014), 607--618. https://doi.org/10.1080/1461670x.2014.882484
[72]
Daniel Riffe, Stephen Lacy, and Frederick Fico. 2005. Analyzing Media Messages: Using Quantitative Content Analysis in Research 2nd ed.). Lawrence Erlbaum, Mahwah, NJ, USA.
[73]
Devansh Saxena, Karla Badillo-Urquiola, Pamela J Wisniewski, and Shion Guha. 2020. A Human-Centered Review of Algorithms used within the U.S. Child Welfare System. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1--15. https://doi.org/10.1145/3313831.3376229
[74]
Michael Schudson. 2011. The Sociology of News 2 ed.). W. W. Norton and Company, Inc.
[75]
Ida Schultz. 2007. The Journalistic Gut Feeling: Journalistic Doxa, News Habitus and Orthodox News Value. Journalism Practice, Vol. 1, 2 (June 2007), 190--207.
[76]
Raz Schwartz, Mor Naaman, and Rannie Teodoro. 2015. Editorial algorithms: Using social media to discover and report local news. In International Conference on Web and Social Media .
[77]
M. Shearer, B. Simon, and C. Geiger. 2014. Datastringer: easy dataset monitoring for journalists. In Proceedings Symposium on Computation+Journalism.
[78]
Pamela J. Shoemaker and Timothy Vos. 2009. Gatekeeping Theory. Routledge, New York, NY, USA.
[79]
Katie A. Siek, Gillian R. Hayes, Mark W. Newman, and John C. Tang. 2014. Field Deployments: Knowing from Using in Context. In Ways of Knowing in HCI, Judith S. Olson and Wendy A. Kellogg (Eds.). 267--289. https://doi.org/10.1007/978--1--4939-0378--8_6
[80]
C. Estelle Smith, Eduardo Nevarez, and Haiyi Zhu. 2020. Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '20). ACM, New York, NY, USA, 1--13.
[81]
C. Estelle Smith, Xinyi Wang, Raghav Pavan Karumur, and Haiyi Zhu. 2018. [Un]Breaking News: Design Opportunities for Enhancing Collaboration in Scientific Media Production. In Proceedings of the CHI Conference on Human Factors in Computing Systems. New York, NY, USA, 1--13. https://doi.org/10.1145/3173574.3173955
[82]
Anselm Strauss and Juliet Corbin. 1990. Basics of qualitative research. Sage Publications.
[83]
Jonathan Stray. 2019. Making Artificial Intelligence Work for Investigative Journalism. Digital Journalism, Vol. 7, 8 (2019), 1--22. https://doi.org/10.1080/21670811.2019.1630289
[84]
James Surowiecki. 2004. The Wisdom of Crowds : Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations. Little Brown, London, England.
[85]
Keren Tenenboim-Weinblatt and Motti Neiger. 2018. Temporal affordances in the news. Journalism, Vol. 19, 1 (2018), 37--55. https://doi.org/10.1177/1464884916689152
[86]
Neil Thurman. 2019. Computational Journalism. In The Handbook of Journalism Studies 2nd ed.), Karin Wahl-Jorgensen and Thomas Hanitzsch (Eds.).
[87]
Neil Thurman and Steve Schifferes. 2012. The Future of Personalization at News Websites. Journalism Studies, Vol. 13, 5--6 (10 2012), 775 -- 790. https://doi.org/10.1080/1461670x.2012.664341
[88]
Peter Tolmie, Rob Procter, David William Randall, Mark Rouncefield, Christian Burger, Geraldine Wong Sak Hoi, Arkaitz Zubiaga, and Maria Liakata. 2017. Supporting the use of user generated content in journalistic practice. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3632--3644.
[89]
Daniel Trielli and Nicholas Diakopoulos. 2019. Search as News Curator: The Role of Google in Shaping Attention to News Information. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--15.
[90]
Daniel Trielli, Jennifer Stark, and Nicholas Diakopoulos. 2017. Algorithm Tips: A Resource for Algorithmic Accountability in Government. In Proc. Computation+Journalism Symposium .
[91]
Damian Trilling, Petro Tolochko, and Björn Burscher. 2016. From Newsworthiness to Shareworthiness: How to Predict News Sharing Based on Article Characteristics. Journalism & Mass Communication Quarterly, Vol. 94, 1 (March 2016), 38--60.
[92]
Michael Veale and Irina Brass. 2019. Administration by Algorithm? Public Management meets Public Sector Machine Learning. In Algorithmic Regulation. https://doi.org/10.31235/osf.io/mwhnb
[93]
Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making. In Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.31235/osf.io/8kvf4
[94]
Sukrit Venkatagiri, Jacob Thebault-Spieker, Rachel Kohler, John Purviance, Rifat Sabbir Mansur, and Kurt Luther. 2019. GroundTruth: Augmenting Expert Image Geolocation with Crowdsourcing and Shared Representations. Proc. ACM Hum.-Comput. Interact., Vol. 3, CSCW (Nov. 2019), 1--30.
[95]
Julian Wallace. 2018. Modelling contemporary gatekeeping: The rise of individuals, algorithms and platforms in digital news dissemination. Digital Journalism, Vol. 6, 3 (2018), 274--293.
[96]
Yixue Wang and Nicholas Diakopoulos. 2021. Journalistic Source Discovery: Supporting The Identification of News Sources in User Generated Content. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--15.
[97]
Patricia Wei, Holden S. Foreman, Erin D. Bennett, and Christopher H. Stock. 2020. Agenda Watch: personalized email alerts for public meetings. In Computation+Journalism Symposium .
[98]
Meng-Han Wu and Alexander James Quinn. 2017. Confusing the Crowd: Task Instruction Quality on Amazon Mechanical Turk. Fifth AAAI Conference on Human Computation and Crowdsourcing (Sept. 2017).
[99]
Barbie Zelizer. 2018. Epilogue: Timing the study of news temporality. Journalism, Vol. 19, 1 (2018), 111--121. https://doi.org/10.1177/1464884916688964
[100]
Arkaitz Zubiaga. 2019. Mining social media for newsgathering: A review. Online Social Networks and Media, Vol. 13 (2019), 100049.
[101]
Arkaitz Zubiaga, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Peter Tolmie. 2016. Analysing How People Orient to and Spread Rumours in Social Media by Looking at Conversational Threads. PloS one, Vol. 11, 3 (03 2016), e0150989. https://doi.org/10.1371/journal.pone.0150989

Cited By

View all
  • (2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
  • (2024)Understanding Practices around Computational News Discovery Tools in the Domain of Science JournalismProceedings of the ACM on Human-Computer Interaction10.1145/36374198:CSCW1(1-36)Online publication date: 26-Apr-2024
  • (2024)OSINT Research Studios: A Flexible Crowdsourcing Framework to Scale Up Open Source Intelligence InvestigationsProceedings of the ACM on Human-Computer Interaction10.1145/36373828:CSCW1(1-38)Online publication date: 26-Apr-2024
  • Show More Cited By

Index Terms

  1. Towards Understanding and Supporting Journalistic Practices Using Semi-Automated News Discovery Tools

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW2
    CSCW2
    October 2021
    5376 pages
    EISSN:2573-0142
    DOI:10.1145/3493286
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 October 2021
    Published in PACMHCI Volume 5, Issue CSCW2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. algorithmic accountability
    2. computational journalism
    3. computational news discovery
    4. newsworthiness

    Qualifiers

    • Research-article

    Funding Sources

    • National Science Foundation

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)123
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 13 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
    • (2024)Understanding Practices around Computational News Discovery Tools in the Domain of Science JournalismProceedings of the ACM on Human-Computer Interaction10.1145/36374198:CSCW1(1-36)Online publication date: 26-Apr-2024
    • (2024)OSINT Research Studios: A Flexible Crowdsourcing Framework to Scale Up Open Source Intelligence InvestigationsProceedings of the ACM on Human-Computer Interaction10.1145/36373828:CSCW1(1-38)Online publication date: 26-Apr-2024
    • (2024)Not Quite Filling the Void: Comparing the Perceptions of Local Online Groups and Local Media Pages on FacebookProceedings of the ACM on Human-Computer Interaction10.1145/36373778:CSCW1(1-22)Online publication date: 26-Apr-2024
    • (2023)Reasons for News Avoidance on Mobile News ConsumptionTransformed Communication Codes in the Mediated World10.4018/979-8-3693-0896-7.ch005(78-108)Online publication date: 18-Dec-2023
    • (2023)Algorithms and communication: A systematized literature reviewComunicar10.3916/C74-2023-0131:74(9-21)Online publication date: 1-Jan-2023
    • (2023)Understanding image-text relations and news values for multimodal news analysisFrontiers in Artificial Intelligence10.3389/frai.2023.11255336Online publication date: 2-May-2023
    • (2023)DoubleCheck: Designing Community-based Assessability for Historical Person IdentificationJournal on Computing and Cultural Heritage 10.1145/362530316:4(1-27)Online publication date: 16-Nov-2023
    • (2023)Exoskeleton for the Mind: Exploring Strategies Against Misinformation with a Metacognitive AgentProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582725(209-220)Online publication date: 12-Mar-2023
    • (2023)CoSINT: Designing a Collaborative Capture the Flag Competition to Investigate MisinformationProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595997(2551-2572)Online publication date: 10-Jul-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media