Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3485447.3512238acmconferencesArticle/Chapter ViewAbstractPublication PageswebconfConference Proceedingsconference-collections
research-article

This Must Be the Place: Predicting Engagement of Online Communities in a Large-scale Distributed Campaign

Published: 25 April 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Understanding collective decision making at a large-scale, and elucidating how community organization and community dynamics shape collective behavior are at the heart of social science research. In this work we study the behavior of thousands of communities with millions of active members. We define a novel task: predicting which community will undertake an unexpected, large-scale, distributed campaign. To this end, we develop a hybrid model, combining textual cues, community meta-data, and structural properties. We show how this multi-faceted model can accurately predict large-scale collective decision-making in a distributed environment. We demonstrate the applicability of our model through Reddit’s r/place – a large-scale online experiment in which millions of users, self-organized in thousands of communities, clashed and collaborated in an effort to realize their agenda.
    Our hybrid model achieves a high F1 prediction score of 0.826. We find that coarse meta-features are as important for prediction accuracy as fine-grained textual cues, while explicit structural features play a smaller role. Interpreting our model, we provide and support various social insights about the unique characteristics of the communities that participated in the r/place experiment.
    Our results and analysis shed light on the complex social dynamics that drive collective behavior, and on the factors that propel user coordination. The scale and the unique conditions of the r/place experiment suggest that our findings may apply in broader contexts, such as online activism, (countering) the spread of hate speech and reducing political polarization. The broader applicability of the model is demonstrated through an extensive analysis of the WallStreetBets community, their role in r/place and four years later, in the GameStop short squeeze campaign of 2021.

    References

    [1]
    Ben Armstrong. 2018. Coordination in a Peer Production Platform: A study of Reddit’s/r/Place experiment. Master’s thesis. University of Waterloo.
    [2]
    Tal August, Dallas Card, Gary Hsieh, Noah A Smith, and Katharina Reinecke. 2020. Explain like I am a Scientist: The Linguistic Barriers of Entry to r/science. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.
    [3]
    Christopher Andrew Bail. 2016. Combining natural language processing and network analysis to examine how advocacy organizations stimulate conversation on social media. Proceedings of the National Academy of Sciences 113, 42(2016), 11823–11828.
    [4]
    Eytan Bakshy, Solomon Messing, and Lada A Adamic. 2015. Exposure to ideologically diverse news and opinion on Facebook. Science 348, 6239 (2015), 1130–1132.
    [5]
    Melisa Basol, Jon Roozenbeek, and Sander van der Linden. 2020. Good News about Bad News: Gamified Inoculation Boosts Confidence and Cognitive Immunity Against Fake News. Journal of Cognition 3, 1 (2020).
    [6]
    Iz Beltagy, Matthew E Peters, and Arman Cohan. 2020. Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150(2020).
    [7]
    Yochai Benkler, Robert Faris, and Hal Roberts. 2018. Network propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford University Press.
    [8]
    Alexandre Bovet and Hernán A Makse. 2019. Influence of fake news in Twitter during the 2016 US presidential election. Nature communications 10, 1 (2019), 7.
    [9]
    William J Brady, Julian A Wills, John T Jost, Joshua A Tucker, and Jay J Van Bavel. 2017. Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Sciences 114, 28(2017), 7313–7318.
    [10]
    Brian C Britt, Rebecca K Britt, Jameson L Hayes, Elliot T Panek, Jessica Maddox, and Aibek Musaev. 2021. Oral healthcare implications of dedicated online communities: A computational content analysis of the r/Dentistry subreddit. Health communication 36, 5 (2021), 572–584.
    [11]
    David M Chavis and Abraham Wandersman. 2002. Sense of community in the urban environment: A catalyst for participation and community development. In A Quarter Century of Community Psychology. Springer, 265–292.
    [12]
    Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2014. How community feedback shapes user behavior. In Eighth International AAAI Conference on Weblogs and Social Media.
    [13]
    Daejin Choi, Jinyoung Han, Taejoong Chung, Yong-Yeol Ahn, Byung-Gon Chun, and Ted Taekyoung Kwon. 2015. Characterizing conversation patterns in Reddit: From the perspectives of content properties and user participation behaviors. In Proceedings of the 2015 ACM on Conference on Online Social Networks. ACM, 233–243.
    [14]
    Tiago Oliveira Cunha, Ingmar Weber, Hamed Haddadi, and Gisele L Pappa. 2016. The effect of social feedback in a reddit weight loss community. In Proceedings of the 6th International Conference on Digital Health Conference. ACM, 99–103.
    [15]
    Srayan Datta and Eytan Adar. 2019. Extracting inter-community conflicts in reddit. In Proceedings of the international AAAI conference on Web and Social Media, Vol. 13. 146–157.
    [16]
    Munmun De Choudhury and Sushovan De. 2014. Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity. In ICWSM.
    [17]
    Michela Del Vicario, Gianna Vivaldo, Alessandro Bessi, Fabiana Zollo, Antonio Scala, Guido Caldarelli, and Walter Quattrociocchi. 2016. Echo chambers: Emotional contagion and group polarization on facebook. Scientific reports 6(2016), 37825.
    [18]
    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).
    [19]
    Tim Di Muzio. 2021. GameStop Capitalism. Wall Street vs. The Reddit Rally (Part I). (2021).
    [20]
    Justin Fagnan, Osmar Zaïane, and Denilson Barbosa. 2014. Using triads to identify local community structure in social networks. In Proceedings of the 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE Press, 108–112.
    [21]
    Casey Fiesler, Jialun” Aaron” Jiang, Joshua McCann, Kyle Frye, and Jed R Brubaker. 2018. Reddit Rules! Characterizing an Ecosystem of Governance. In ICWSM. 72–81.
    [22]
    Dana R Fisher, Kenneth T Andrews, Neal Caren, Erica Chenoweth, Michael T Heaney, Tommy Leung, L Nathan Perkins, and Jeremy Pressman. 2019. The science of contemporary street protest: New efforts in the United States. Science advances 5, 10 (2019), eaaw5461.
    [23]
    Jerome H Friedman. 2002. Stochastic gradient boosting. Computational Statistics & Data Analysis 38, 4 (2002), 367–378.
    [24]
    Adrien Friggeri, Guillaume Chelius, and Eric Fleury. 2011. Triangles to capture social cohesion. In 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing. IEEE, 258–265.
    [25]
    Maria Glenski and Tim Weninger. 2017. Predicting user-interactions on reddit. In Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017. ACM, 609–612.
    [26]
    Yoav Goldberg. 2017. Neural network methods for natural language processing. Synthesis Lectures on Human Language Technologies 10, 1(2017), 1–309.
    [27]
    Mark S Granovetter. 1973. The strength of weak ties. In Social networks. Elsevier, 347–367.
    [28]
    Nir Grinberg, Kenneth Joseph, Lisa Friedland, Briony Swire-Thompson, and David Lazer. 2019. Fake news on Twitter during the 2016 US presidential election. Science 363, 6425 (2019), 374–378.
    [29]
    William L Hamilton, Justine Zhang, Cristian Danescu-Niculescu-Mizil, Dan Jurafsky, and Jure Leskovec. 2017. Loyalty in online communities. In Eleventh International AAAI Conference on Web and Social Media.
    [30]
    Simo Hanouna, Omer Neu, Sharon Pardo, Oren Tsur, and Hila Zahavi. 2019. Sharp power in social media: Patterns from datasets across electoral campaigns. Australian and New Zealand Journal of European Studies 11, 3(2019).
    [31]
    T Hässler, Johannes Ullrich, Michelle Bernardino, Nurit Shnabel, D Valdenegro, C Van Laar, S Sebben, E Visintin, L Tropp, R González, 2020. A large-scale test of the link between intergroup contact and support for social change. Nature Human Behaviour(2020).
    [32]
    Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
    [33]
    Margaret Hu. 2020. Cambridge Analytica’s black box. Big Data & Society 7, 2 (2020), 2053951720938091.
    [34]
    Sarah J Jackson and Brooke Foucault Welles. 2016. # Ferguson is everywhere: initiators in emerging counterpublic networks. Information, Communication & Society 19, 3 (2016), 397–418.
    [35]
    Kathleen Hall Jamieson. 2018. Cyberwar: How Russian Hackers and Trolls Helped Elect a President What We Don’t, Can’t, and Do Know. Oxford University Press.
    [36]
    Ridley Jones, Lucas Colusso, Katharina Reinecke, and Gary Hsieh. 2019. r/science: Challenges and opportunities in online science communication. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–14.
    [37]
    John T Jost, Pablo Barberá, Richard Bonneau, Melanie Langer, Megan Metzger, Jonathan Nagler, Joanna Sterling, and Joshua A Tucker. 2018. How social media facilitates political protest: Information, motivation, and social networks. Political psychology 39(2018), 85–118.
    [38]
    Brian Keegan, Darren Gergle, and Noshir Contractor. 2011. Hot off the wiki: dynamics, practices, and structures in Wikipedia’s coverage of the Tohoku catastrophes. In Proceedings of the 7th international symposium on Wikis and open collaboration. ACM, 105–113.
    [39]
    Brian Keegan, Darren Gergle, and Noshir Contractor. 2012. Do editors or articles drive collaboration?: multilevel statistical network analysis of wikipedia coauthorship. In Proceedings of the ACM 2012 conference on computer supported cooperative work. ACM, 427–436.
    [40]
    Yoon Kim. 2014. Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882(2014).
    [41]
    Zornitsa Kozareva and Eduard Hovy. 2010. Not all seeds are equal: Measuring the quality of text mining seeds. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 618–626.
    [42]
    Adam DI Kramer, Jamie E Guillory, and Jeffrey T Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences 111, 24(2014), 8788–8790.
    [43]
    Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097–1105.
    [44]
    Srijan Kumar, William L Hamilton, Jure Leskovec, and Dan Jurafsky. 2018. Community interaction and conflict on the web. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, 933–943.
    [45]
    David Lazer, Alex Sandy Pentland, Lada Adamic, Sinan Aral, Albert Laszlo Barabasi, Devon Brewer, Nicholas Christakis, Noshir Contractor, James Fowler, Myron Gutmann, 2009. Life in the network: the coming age of computational social science. Science (New York, NY) 323, 5915 (2009), 721.
    [46]
    Kurt Lewin. 1947. Frontiers in Group Dynamics: Concept, Method and Reality in Social Science; Social Equilibria and Social Change. Human Relations 1, 1 (1947), 5–41. https://doi.org/10.1177/001872674700100103 arXiv:https://doi.org/10.1177/001872674700100103
    [47]
    Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692(2019).
    [48]
    Cheng Long, Brian M Lucey, and Larisa Yarovaya. 2021. “I Just Like the Stock” versus “Fear and Loathing on Main Street”: The Role of Reddit Sentiment in the GameStop Short Squeeze. (2021).
    [49]
    Lorenzo Lucchini, Luca Maria Aiello, Laura Alessandretti, Gianmarco De Francisci Morales, Michele Starnini, and Andrea Baronchelli. 2021. From Reddit to Wall Street: The role of committed minorities in financial collective action. arXiv preprint arXiv:2107.07361(2021).
    [50]
    Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems. 4765–4774.
    [51]
    Joan Massachs, Corrado Monti, Gianmarco De Francisci Morales, and Francesco Bonchi. 2020. Roots of trumpism: Homophily and social feedback in donald trump support on reddit. In 12th ACM Conference on Web Science. 49–58.
    [52]
    Alexey N Medvedev, Renaud Lambiotte, and Jean-Charles Delvenne. 2017. The anatomy of Reddit: An overview of academic research. In Dynamics on and of Complex Networks. Springer, 183–204.
    [53]
    Alberto Melucci. 1996. Challenging codes: Collective action in the information age. Cambridge University Press.
    [54]
    Humphrey Mensah, Lu Xiao, and Sucheta Soundarajan. 2020. Characterizing the Evolution of Communities on Reddit. In International Conference on Social Media and Society. 58–64.
    [55]
    William Merrill, Yoav Goldberg, Roy Schwartz, and Noah A Smith. 2021. Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?arXiv preprint arXiv:2104.10809(2021).
    [56]
    Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781(2013).
    [57]
    Robert S Mueller. 2019. Report on the investigation into Russian interference in the 2016 presidential election. US Dept. of Justice. Washington, DC(2019).
    [58]
    Thomas F Müller and James Winters. 2018. Compression in cultural evolution: Homogeneity and structure in the emergence and evolution of a large-scale online collaborative art project. PloS one 13, 9 (2018), e0202019.
    [59]
    Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, 2017. Dynet: The dynamic neural network toolkit. arXiv preprint arXiv:1701.03980(2017).
    [60]
    Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User Migration in Online Social Networks: A Case Study on Reddit During a Period of Community Unrest. In ICWSM. 279–288.
    [61]
    Mancur Olson. 2009. The Logic of Collective Action: Public Goods and the Theory of Groups, Second printing with new preface and appendix. Vol. 124. Harvard University Press.
    [62]
    Elinor Ostrom. 2000. Collective action and the evolution of social norms. Journal of economic perspectives 14, 3 (2000), 137–158.
    [63]
    Elliot Panek, Connor Hollenbach, Jinjie Yang, and Tyler Rhodes. 2018. The Effects of Group Size and Time on the Formation of Online Communities: Evidence From Reddit. Social Media+ Society 4, 4 (2018), 2056305118815908.
    [64]
    Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019), 8026–8037.
    [65]
    Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12, Oct (2011), 2825–2830.
    [66]
    Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.
    [67]
    Sarah Perez. 2019. Reddit’s monthly active user base grew 30% to reach 430M in 2019. TechCrunch (Date accessed: 2/2/2020)(2019). https://techcrunch.com/2019/12/04/reddits-monthly-active-user-base-grew-30-to-reach-430m-in-2019
    [68]
    Sam Ransbotham and Gerald C Kane. 2011. Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. Mis Quarterly (2011), 613–627.
    [69]
    Jérémie Rappaz, Michele Catasta, Robert West, and Karl Aberer. 2018. Latent structure in collaboration: the case of Reddit R/place. In Twelfth International AAAI Conference on Web and Social Media.
    [70]
    David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. 1985. Learning internal representations by error propagation. Technical Report. California Univ San Diego La Jolla Inst for Cognitive Science.
    [71]
    Gerard Salton and Michael J McGill. 1986. Introduction to modern information retrieval. (1986).
    [72]
    Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108(2019).
    [73]
    Robert E Schapire. 1990. The strength of weak learnability. Machine learning 5, 2 (1990), 197–227.
    [74]
    Chhavi Sharma, Deepesh Bhageria, William Scott, Srinivas PYKL, Amitava Das, Tanmoy Chakraborty, Viswanath Pulabaigari, and Bjorn Gamback. 2020. SemEval-2020 Task 8: Memotion Analysis–The Visuo-Lingual Metaphor!arXiv preprint arXiv:2008.03781(2020).
    [75]
    Greg Stoddard. 2015. Popularity Dynamics and Intrinsic Quality in Reddit and Hacker News. In ICWSM. 416–425.
    [76]
    Prateek Vachher, Zachary Levonian, Hao-Fei Cheng, and Svetlana Yarosh. 2020. Understanding Community-Level Conflicts Through Reddit r/place. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing. 401–405.
    [77]
    Yikai Wang, Wenbing Huang, Fuchun Sun, Tingyang Xu, Yu Rong, and Junzhou Huang. 2020. Deep multimodal fusion by channel exchanging. Advances in Neural Information Processing Systems 33 (2020).
    [78]
    Ken Ward. 2018. Social networks, the 2016 US presidential election, and Kantian ethics: applying the categorical imperative to Cambridge Analytica’s behavioral microtargeting. Journal of media ethics 33, 3 (2018), 133–148.
    [79]
    Tim Weninger, Xihao Avi Zhu, and Jiawei Han. 2013. An exploration of discussion threads in social news sites: A case study of the reddit community. In Advances in Social Networks Analysis and Mining (ASONAM), 2013 IEEE/ACM International Conference on. IEEE, 579–583.
    [80]
    Wenpeng Yin, Jamaal Hay, and Dan Roth. 2019. Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach. arXiv preprint arXiv:1909.00161(2019).
    [81]
    Wayne W Zachary. 1977. An information flow model for conflict and fission in small groups. Journal of anthropological research 33, 4 (1977), 452–473.
    [82]
    Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, 2020. Big Bird: Transformers for Longer Sequences. In NeurIPS.
    [83]
    Justine Zhang, William L Hamilton, Cristian Danescu-Niculescu-Mizil, Dan Jurafsky, and Jure Leskovec. 2017. Community identity and user engagement in a multi-community landscape. In Eleventh International AAAI Conference on Web and Social Media.
    [84]
    Naitian Zhou and David Jurgens. 2020. Condolences and empathy in online communities. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 609–626.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '22: Proceedings of the ACM Web Conference 2022
    April 2022
    3764 pages
    ISBN:9781450390965
    DOI:10.1145/3485447
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 April 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Computational Social Science
    2. GameStop
    3. Natural Language Processing
    4. Online Communities
    5. Reddit
    6. Social Networks
    7. rPlace
    8. wallStreetBets

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    WWW '22
    Sponsor:
    WWW '22: The ACM Web Conference 2022
    April 25 - 29, 2022
    Virtual Event, Lyon, France

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 318
      Total Downloads
    • Downloads (Last 12 months)88
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 27 Jul 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media