Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3184558.3188722acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Free access

Fake News Detection in Social Networks via Crowd Signals

Published: 23 April 2018 Publication History

Abstract

Our work considers leveraging crowd signals for detecting fake news and is motivated by tools recently introduced by Facebook that enable users to flag fake news. By aggregating users' flags, our goal is to select a small subset of news every day, send them to an expert (e.g., via a third-party fact-checking organization), and stop the spread of news identified as fake by an expert. The main objective of our work is to minimize the spread of misinformation by stopping the propagation of fake news in the network. It is especially challenging to achieve this objective as it requires detecting fake news with high-confidence as quickly as possible. We show that in order to leverage users' flags efficiently, it is crucial to learn about users' flagging accuracy. We develop a novel algorithm, DETECTIVE, that performs Bayesian inference for detecting fake news and jointly learns about users' flagging accuracy over time. Our algorithm employs posterior sampling to actively trade off exploitation (selecting news that maximize the objective value at a given epoch) and exploration (selecting news that maximize the value of information towards learning about users' flagging accuracy). We demonstrate the effectiveness of our approach via extensive experiments and show the power of leveraging community signals for fake news detection.

References

[1]
Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In WWW. 675--684.
[2]
Olivier Chapelle and Lihong Li. 2011. An empirical evaluation of thompson sampling. In NIPS. 2249--2257.
[3]
Liang Chen, Zheng Yan, Weidong Zhang, and Raimo Kantola. 2015. TruSMS: a trustworthy SMS spam control system based on trust management. Future Generation Computer Systems Vol. 49 (2015), 77--93.
[4]
Yuxin Chen, Jean-Michel Renders, Morteza Haghir Chehreghani, and Andreas Krause. 2017. Efficient Online Learning for Optimizing Value of Information: Theory and Application to Interactive Troubleshooting. In UAI.
[5]
Pern Hui Chia and Svein Johan Knapskog. 2011. Re-evaluating the wisdom of crowds in assessing web security International Conference on Financial Cryptography and Data Security. 299--314.
[6]
Giovanni Luca Ciampaglia, Prashant Shiralkar, Luis M Rocha, Johan Bollen, Filippo Menczer, and Alessandro Flammini. 2015. Computational fact checking from knowledge networks. PloS one Vol. 10, 6 (2015), e0128193.
[7]
Niall J Conroy, Victoria L Rubin, and Yimin Chen. 2015. Automatic deception detection: Methods for finding fake news. Proceedings of the Association for Information Science and Technology Vol. 52, 1 (2015), 1--4.
[8]
Nan Du, Le Song, Manuel Gomez-Rodriguez, and Hongyuan Zha. 2013. Scalable Influence Estimation in Continuous-Time Diffusion Networks NIPS. 3147--3155.
[9]
Stuart Ewen. 1998. PR!: a social history of spin. Basic Books.
[10]
Facebook. 2016. News Feed FYI: Addressing Hoaxes and Fake News. texttthttps://newsroom.fb.com/news/2016/texttt12/news-feed-fyi-addressing-hoaxes-and-textttfake-news/. (December. 2016).
[11]
Facebook. 2017. Umgang mit Falschmeldungen (Handling of false alarms). texttthttps://de.newsroom.fb.com/news/2017/texttt01/umgang-mit-falschmeldungen/. (January. 2017).
[12]
David Mandell Freeman. 2017. Can You Spot the Fakes: On the Limitations of User Feedback in Online Social Networks WWW. 1093--1102.
[13]
Aditi Gupta, Ponnurangam Kumaraguru, Carlos Castillo, and Patrick Meier. 2014. Tweetcred: Real-time credibility assessment of content on twitter International Conference on Social Informatics. Springer, 228--243.
[14]
Nguyen Quoc Viet Hung, Duong Chi Thang, Matthias Weidlich, and Karl Aberer. 2015. Minimizing efforts in validating crowd answers. In SIGMOD. 999--1014.
[15]
David Kempe, Jon Kleinberg, and Éva Tardos. 2003. Maximizing the spread of influence through a social network KDD. 137--146.
[16]
J. Kim, B. Tabibian, A. Oh, B. Schoelkopf, and M. Gomez-Rodriguez. 2018. Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation WSDM '18: Proceedings of the 11th ACM International Conference on Web Search and Data Mining.
[17]
Srijan Kumar, Robert West, and Jure Leskovec. 2016. Disinformation on the web: Impact, characteristics, and detection of wikipedia hoaxes WWW. 591--602.
[18]
Sejeong Kwon, Meeyoung Cha, and Kyomin Jung. 2017. Rumor detection over varying time windows. PloS one Vol. 12, 1 (2017), e0168344.
[19]
Jure Leskovec and Julian J Mcauley. 2012. Learning to discover social circles in ego networks NIPS. 539--547.
[20]
Yaliang Li, Qi Li, Jing Gao, Lu Su, Bo Zhao, Wei Fan, and Jiawei Han. 2015. On the discovery of evolving truth. In KDD. 675--684.
[21]
Mengchen Liu, Liu Jiang, Junlin Liu, Xiting Wang, Jun Zhu, and Shixia Liu. 2017. Improving Learning-from-Crowds through Expert Validation IJCAI. 2329--2336.
[22]
Cristian Lumezanu, Nick Feamster, and Hans Klein. 2012. # bias: Measuring the tweeting behavior of propagandists AAAI Conference on Weblogs and Social Media.
[23]
Tyler Moore and Richard Clayton. 2008. Evaluating the wisdom of crowds in assessing phishing websites. Lecture Notes in Computer Science Vol. 5143 (2008), 16--30.
[24]
Ian Osband, Dan Russo, and Benjamin Van Roy. 2013. (More) efficient reinforcement learning via posterior sampling NIPS. 3003--3011.
[25]
Poynter. 2016. International Fact-Checking Network: Fact-Checkers Code Principles. texttthttps://www.poynter.org/international- textttfact-checking-network-fact-checkers- textttcode-principles. (September. 2016).
[26]
Marian-Andrei Rizoiu, Lexing Xie, Scott Sanner, Manuel Cebrián, Honglin Yu, and Pascal Van Hentenryck. 2017. Expecting to be HIP: Hawkes Intensity Processes for Social Media Popularity WWW. 735--744.
[27]
Victoria L Rubin, Yimin Chen, and Niall J Conroy. 2015. Deception detection for news: three types of fakes. Proceedings of the Association for Information Science and Technology Vol. 52, 1 (2015), 1--4.
[28]
Behzad Tabibian, Isabel Valera, Mehrdad Farajtabar, Le Song, Bernhard Schölkopf, and Manuel Gomez-Rodriguez. 2017. Distilling information reliability and source trustworthiness from digital traces WWW. 847--855.
[29]
William R Thompson. 1933. On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika Vol. 25, 3/4 (1933), 285--294.
[30]
Hastagiri P Vanchinathan, Andreas Marfurt, Charles-Antoine Robelin, Donald Kossmann, and Andreas Krause. 2015. Discovering valuable items from massive data. In KDD. 1195--1204.
[31]
Svitlana Volkova, Kyle Shaffer, Jin Yea Jang, and Nathan Hodas. 2017. Separating Facts from Fiction: Linguistic Models to Classify Suspicious and Trusted News Posts on Twitter. In ACL, Vol. Vol. 2. 647--653.
[32]
Gang Wang, Manish Mohanlal, Christo Wilson, Xiao Wang, Miriam J. Metzger, Haitao Zheng, and Ben Y. Zhao. 2013. Social Turing Tests: Crowdsourcing Sybil Detection NDSS.
[33]
William Yang Wang. 2017. "Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection ACL. 422--426.
[34]
Wei Wei and Xiaojun Wan. 2017. Learning to Identify Ambiguous and Misleading News Headlines IJCAI. 4172--4178.
[35]
Shu Wu, Qiang Liu, Yong Liu, Liang Wang, and Tieniu Tan. 2016. Information Credibility Evaluation on Social Media. AAAI. 4403--4404.
[36]
Bo Zhao, Benjamin IP Rubinstein, Jim Gemmell, and Jiawei Han. 2012. A bayesian approach to discovering truth from conflicting sources for data integration. Proceedings of the VLDB Endowment Vol. 5, 6 (2012), 550--561.
[37]
Qingyuan Zhao, Murat A. Erdogdu, Hera Y. He, Anand Rajaraman, and Jure Leskovec. 2015 a. SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity KDD. 1513--1522.
[38]
Zhe Zhao, Paul Resnick, and Qiaozhu Mei. 2015 b. Enquiring minds: Early detection of rumors in social media from enquiry posts WWW. 1395--1405.
[39]
Elena Zheleva, Aleksander Kolcz, and Lise Getoor. 2008. Trusting spam reporters: A reporter-based reputation system for email filtering. TOIS Vol. 27, 1 (2008), 3.

Cited By

View all
  • (2024)Enhancing Fake News Detection with a Hybrid NLP-Machine Learning FrameworkIECE Transactions on Intelligent Systematics10.62762/TIS.2024.4619431:3(203-214)Online publication date: 12-Dec-2024
  • (2024)A Survey on the Use of Large Language Models (LLMs) in Fake NewsFuture Internet10.3390/fi1608029816:8(298)Online publication date: 19-Aug-2024
  • (2024)Leveraging Chatbots to Combat Health Misinformation for Older Adults: Participatory Design StudyJMIR Formative Research10.2196/607128(e60712)Online publication date: 11-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '18: Companion Proceedings of the The Web Conference 2018
April 2018
2023 pages
ISBN:9781450356404
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • IW3C2: International World Wide Web Conference Committee

In-Cooperation

Publisher

International World Wide Web Conferences Steering Committee

Republic and Canton of Geneva, Switzerland

Publication History

Published: 23 April 2018

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

WWW '18
Sponsor:
  • IW3C2
WWW '18: The Web Conference 2018
April 23 - 27, 2018
Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)572
  • Downloads (Last 6 weeks)75
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Enhancing Fake News Detection with a Hybrid NLP-Machine Learning FrameworkIECE Transactions on Intelligent Systematics10.62762/TIS.2024.4619431:3(203-214)Online publication date: 12-Dec-2024
  • (2024)A Survey on the Use of Large Language Models (LLMs) in Fake NewsFuture Internet10.3390/fi1608029816:8(298)Online publication date: 19-Aug-2024
  • (2024)Leveraging Chatbots to Combat Health Misinformation for Older Adults: Participatory Design StudyJMIR Formative Research10.2196/607128(e60712)Online publication date: 11-Oct-2024
  • (2024)A Bi-GRU-DSA-based social network rumor detection approachOpen Computer Science10.1515/comp-2023-011414:1Online publication date: 23-Mar-2024
  • (2024)Progressive Detection of Uncertainty in Natural Language Processing Using a Labeled Variable Dimension Kalman FilterApplied Computational Intelligence and Soft Computing10.1155/2024/66281922024:1Online publication date: 29-Oct-2024
  • (2024)Role of Statistics in Detecting Misinformation: A Review of the State of the Art, Open Issues, and Future Research DirectionsAnnual Review of Statistics and Its Application10.1146/annurev-statistics-040622-03380611:1(27-50)Online publication date: 22-Apr-2024
  • (2024)Improving Implicit Crowd Signals Based Fake News Detection on Social Media: A Time-Aware Method for Early DetectionProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658278(1-9)Online publication date: 20-May-2024
  • (2024)Quantifying the impact of misinformation and vaccine-skeptical content on FacebookScience10.1126/science.adk3451384:6699Online publication date: 31-May-2024
  • (2024)Multimodal Fake News Analysis Based on Image–Text SimilarityIEEE Transactions on Computational Social Systems10.1109/TCSS.2023.324406811:1(959-972)Online publication date: Feb-2024
  • (2024)An Optimized TF-IDF Features based Deep Learning Enabled Automated Fake News Detection Scheme2024 Asia Pacific Conference on Innovation in Technology (APCIT)10.1109/APCIT62007.2024.10673703(1-9)Online publication date: 26-Jul-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media