research-article

Verba Volant, Scripta Volant: Understanding Post-publication Title Changes in News Outlets

Authors:

Brian Kondracki,

Nick Nikiforakis,

Steven SkienaAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 588 - 598

https://doi.org/10.1145/3485447.3512219

Published: 25 April 2022 Publication History

Abstract

Digital media (including websites and online social networks) facilitate the broadcasting of news via flexible and personalized channels. Unlike conventional newspapers which become “read-only” upon publication, online news sources are free to arbitrarily modify news headlines after their initial release. The motivation, frequency, and effect of post-publication headline changes are largely unknown, with no offline equivalent from where researchers can draw parallels.

In this paper, we collect and analyze over 41K pairs of altered news headlines by tracking ∼ 411K articles from major US news agencies over a six month period (March to September 2021), identifying that 7.5% articles have at least one post-publication headline edit with a wide range of types, from minor updates, to complete rewrites. We characterize the frequency with which headlines are modified and whether certain outlets are more likely to be engaging in post-publication headline changes than others. We discover that 49.7% of changes go beyond minor spelling or grammar corrections, with 23.13% of those resulting in drastically disparate information conveyed to readers. Finally, to better understand the interaction between post-publication headline edits and social media, we conduct a temporal analysis of news popularity on Twitter. We find that an effective headline post-publication edit should occur within the first ten hours after the initial release to ensure that the previous, potentially misleading, information does not fully propagate over the social network.

References

[1]

[n. d.]. Alexa Top Sites. https://www.alexa.com/topsites.

[2]

[n. d.]. Media Bias Chart. https://www.adfontesmedia.com/intro-to-the-media-bias-chart/.

[3]

[n. d.]. Open Graph Protocol. https://ogp.me.

[4]

[n. d.]. Python Newspaper Library. https://newspaper.readthedocs.io/en/latest/.

[5]

[n. d.]. Twitter Card Troubleshooting. https://developer.twitter.com/en/docs/twitter-for-websites/cards/guides/troubleshooting-cards#outdated.

[6]

2014. How Americans get their news. https://www.americanpressinstitute.org/publications/reports/survey-research/how-americans-get-news/.

[7]

Jonas Nygaard Blom and Kenneth Reinecke Hansen. 2015. Click bait: Forward-reference as lure in online news headlines. Journal of Pragmatics 76(2015), 87–100.

[8]

Johannes Daxenberger and Iryna Gurevych. 2013. Automatically classifying edit categories in Wikipedia revisions. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. 578–589.

[9]

Sohan De Sarkar, Fan Yang, and Arjun Mukherjee. 2018. Attending sentences to detect satirical fake news. In Proceedings of the 27th international conference on computational linguistics. 3371–3380.

[10]

Daniel Dor. 2003. On newspaper headlines as relevance optimizers. Journal of pragmatics 35, 5 (2003), 695–721.

[11]

Lisa Fazio. 2020. Pausing to consider why a headline is true or false can help reduce the sharing of false news. Harvard Kennedy School Misinformation Review 1, 2 (2020).

[12]

Jennifer Golbeck, Matthew Mauriello, Brooke Auxier, Keval H Bhanushali, Christopher Bonk, Mohamed Amine Bouzaghrane, Cody Buntain, Riya Chanduka, Paul Cheakalos, Jennine B Everett, 2018. Fake news vs satire: A dataset and analysis. In Proceedings of the 10th ACM Conference on Web Science. 17–21.

Digital Library

[13]

Nick Hagar and Nicholas Diakopoulos. 2019. Optimizing content with A/B headline testing: Changing newsroom practices. Media and Communication 7, 1 (2019), 117–127.

[14]

Austin Hounsel, Jordan Holland, Ben Kaiser, Kevin Borgolte, Nick Feamster, and Jonathan Mayer. 2020. Identifying disinformation websites using infrastructure features. In 10th {USENIX} Workshop on Free and Open Communications on the Internet ({FOCI} 20).

[15]

Elly Ifantidou. 2009. Newspaper headlines and relevance: Ad hoc concepts in ad hoc contexts. Journal of Pragmatics 41, 4 (2009), 699–720.

[16]

Hamid Karimi, Proteek Roy, Sari Saba-Sadiya, and Jiliang Tang. 2018. Multi-source multi-class fake news detection. In Proceedings of the 27th international conference on computational linguistics. 1546–1557.

[17]

Danielle K Kilgo and Vinicio Sinta. 2016. Six things you didn’t know about headline writing: Sensationalistic form in viral news content from traditional and digitally native news organizations. In Research Journal of the International Symposium on Online Journalism, Vol. 6. 111–130.

[18]

Jeffrey Kuiken, Anne Schuth, Martijn Spitters, and Maarten Marx. 2017. Effective headlines of newspaper articles in a digital environment. Digital Journalism 5, 10 (2017), 1300–1314.

[19]

Srijan Kumar and Neil Shah. 2018. False information on web and social media: A survey. arXiv preprint arXiv:1804.08559(2018).

[20]

Edison Marrese-Taylor, Machel Reid, and Yutaka Matsuo. 2020. Variational Inference for Learning Representations of Natural Language Edits. arXiv preprint arXiv:2004.09143(2020).

[21]

Alexander Nazaryan. 2021. I Miss the Thrill of Trump. https://web.archive.org/web/20210211110734if_/https://www.theatlantic.com/ideas/archive/2021/02/i-miss-thrill-trump/617993/.

[22]

Alexander Nazaryan. 2021. I Was an Enemy of the People. https://web.archive.org/web/20210223004426if_/https://www.theatlantic.com/ideas/archive/2021/02/i-miss-thrill-trump/617993/.

[23]

Martin Potthast, Sebastian Köpsel, Benno Stein, and Matthias Hagen. 2016. Clickbait detection. In European Conference on Information Retrieval. Springer, 810–817.

[24]

Peng Qi, Yuhao Zhang, Yuhui Zhang, Jason Bolton, and Christopher D Manning. 2020. Stanza: A Python natural language processing toolkit for many human languages. arXiv preprint arXiv:2003.07082(2020).

[25]

Julio CS Reis, André Correia, Fabrício Murai, Adriano Veloso, and Fabrício Benevenuto. 2019. Supervised learning for fake news detection. IEEE Intelligent Systems 34, 2 (2019), 76–81.

Digital Library

[26]

Julio Rieis, Fabrício de Souza, Pedro Vaz de Melo, Raquel Prates, Haewoon Kwak, and Jisun An. 2015. Breaking the news: First impressions matter on online news. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 9.

[27]

Ellen Riloff and Janyce Wiebe. 2003. Learning extraction patterns for subjective expressions. In Proceedings of the 2003 conference on Empirical methods in natural language processing. 105–112.

Digital Library

[28]

Victoria L Rubin, Niall Conroy, Yimin Chen, and Sarah Cornwell. 2016. Fake news or truth? using satirical cues to detect potentially misleading news. In Proceedings of the second workshop on computational approaches to deception detection. 7–17.

[29]

Elisa Shearer. 2021. More than eight-in-ten Americans get news from digital devices. https://www.pewresearch.org/fact-tank/2021/01/12/more-than-eight-in-ten-americans-get-news-from-digital-devices/.

[30]

Kai Shu, Amy Sliva, Suhang Wang, Jiliang Tang, and Huan Liu. 2017. Fake news detection on social media: A data mining perspective. ACM SIGKDD explorations newsletter 19, 1 (2017), 22–36.

Digital Library

[31]

Luis Vargas, Patrick Emami, and Patrick Traynor. 2020. On the detection of disinformation campaign activity with network analysis. In Proceedings of the 2020 ACM SIGSAC Conference on Cloud Computing Security Workshop. 133–146.

Digital Library

[32]

Diyi Yang, Aaron Halfaker, Robert Kraut, and Eduard Hovy. 2017. Identifying semantic edit intentions from revisions in wikipedia. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 2000–2010.

[33]

Pengcheng Yin, Graham Neubig, Miltiadis Allamanis, Marc Brockschmidt, and Alexander L Gaunt. 2018. Learning to represent edits. arXiv preprint arXiv:1810.13337(2018).

[34]

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019. Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675(2019).

[35]

Xinyi Zhou, Reza Zafarani, Kai Shu, and Huan Liu. 2019. Fake news: Fundamental theories, detection strategies and challenges. In Proceedings of the twelfth ACM international conference on web search and data mining. 836–837.

Digital Library

Cited By

Aljebreen AMeng WDragut EChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Analysis and Detection of "Pink Slime" Websites in Social Media PostsProceedings of the ACM on Web Conference 202410.1145/3589334.3645588(2572-2581)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645588
Tsoukaladelis CNikiforakis N(2024)Manufactured Narratives: On the Potential of Manipulating Social Media to Politicize World Events2024 IEEE Security and Privacy Workshops (SPW)10.1109/SPW63631.2024.00007(17-27)Online publication date: 23-May-2024
https://doi.org/10.1109/SPW63631.2024.00007

Index Terms

Verba Volant, Scripta Volant: Understanding Post-publication Title Changes in News Outlets

Index terms have been assigned to the content through auto-classification.

Recommendations

Ranking scholarly outlets for information technology
SIGITE '09: Proceedings of the 10th ACM conference on SIG-information technology education

The purpose of this paper is to establish a ranking for scholarly outlets for those publishing in the field of information technology. Many well-established disciplines have a number of outlets for scholarly work, including archival journals, conference ...
Changes in PubMed affiliation indexing improved publication identification by country

Publications are often used to estimate the biomedical scientific production of an institution or country. Through its "affiliation" filter PubMed is a useful open-access tool for this purpose. In 2013 this filter was modified, beginning to include all ...
Citation success of different publication types: a case study on all references in psychology publications from the German-speaking countries (D---A---CH---L---L) in 2009, 2010, and 2011

Scientometric data on the citation success of different publication types and publication genres in psychology publications are presented. Data refer to references that are cited in these scientific publications and that are documented in PSYNDEX, the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

NSF

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
216
Total Downloads

Downloads (Last 12 months)77
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Aljebreen AMeng WDragut EChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Analysis and Detection of "Pink Slime" Websites in Social Media PostsProceedings of the ACM on Web Conference 202410.1145/3589334.3645588(2572-2581)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645588
Tsoukaladelis CNikiforakis N(2024)Manufactured Narratives: On the Potential of Manipulating Social Media to Politicize World Events2024 IEEE Security and Privacy Workshops (SPW)10.1109/SPW63631.2024.00007(17-27)Online publication date: 23-May-2024
https://doi.org/10.1109/SPW63631.2024.00007

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents