Exploring Intervention Techniques to Alleviate Negative Emotions during Video Content Moderation Tasks as a Worker-centered Task Design
Authors: 
Dokyun Lee, Sangeun Seo, Chanwoo Park, 
Sunjun Kim, Buru Chang, Jean Y SongAuthors Info & Claims
Dokyun Lee, Sangeun Seo, Chanwoo Park, Sunjun Kim, Buru Chang, Jean Y SongAuthors Info & ClaimsPages 1701 - 1721
Abstract
Videos are dynamic and multi-modal compared to other types of content, making automatic filtering difficult, which is why content moderators play a crucial role. However, video content moderators are exposed to more profound emotional labor because videos contain rich visual information, sometimes including even harmful content, such as violent or terrifying scenes. In this work, we explore the effect of six intervention techniques on alleviating negative emotions during video content moderation tasks. We conducted one online crowdsourcing experiment and two controlled user studies to find out that (i) interleaving with positive videos or (ii) cartoonization could significantly reduce negative emotions in the moderators. Participants reported that the advantages of these approaches are in helping reduce negative emotions at the time of moderation while existing approaches focus on post-task activities (e.g., relaxation, talking with others, or getting a hobby). We discuss the applicability of our findings to broader tasks, including improvement in intervention techniques.
References
[1]
Muninder Adavelli. 2023. How many videos are uploaded on Youtube every day?https://techjury.net/blog/how-many-videos-are-uploaded-to-youtube-a-day/
[2]
Anu Aggarwal. 2023. Do cartoons positively affect your mental health. https://anuaggarwalfoundation.org/do-cartoons-positively-affect-your-mental-health/
[3]
Joe Bagliere. 2020. Science shows watching cute animals is good for your health. CNN. https://www. cnn. com/2020/09/27/us/watching-cute-animals-studyscn-trnd/index. html (2020).
[4]
Monika Bickert. 2019. Publishing our internal enforcement guidelines and expanding our appeals process. https://about.fb.com/news/2018/04/comprehensive-community-standards/
[5]
Branka. 2023. Facebook statistics 2023. https://truelist.co/blog/facebook-statistics/
[6]
Nicola W Burton, Ken I Pakenham, and Wendy J Brown. 2010. Feasibility and effectiveness of psychosocial resilience training: a pilot study of the READY program. Psychology, health & medicine 15, 3 (2010), 266–277.
[7]
K Canegallo. 2019. Meet the teams keeping our corner of the internet safer. The Keyword (2019).
[8]
Robert D Caplan. 1983. Person-environment fit: Past, present and future. Stress research (1983).
[9]
Elinor Carmi. 2019. The hidden listeners: regulating the line from telephone operators to content moderators. International Journal of Communication 13 (2019), 440–458.
[10]
James Carmody and Ruth A Baer. 2008. Relationships between mindfulness practice and levels of mindfulness, medical and psychological symptoms and well-being in a mindfulness-based stress reduction program. Journal of behavioral medicine 31 (2008), 23–33.
[11]
Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A cross-community learning-based system to assist reddit moderators. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–30.
[12]
Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The bag of communities: Identifying abusive behavior online with preexisting internet data. In Proceedings of the 2017 CHI conference on human factors in computing systems. 3175–3187.
[13]
A Chen. 2012. Facebook releases new content guidelines, now allows bodily fluids. Gawker (2012).
[14]
Adrian Chen. 2014. The laborers who keep dick pics and beheadings out of your Facebook feed. Wired 23 (2014), 14.
[15]
Jill Collins, Alison Gibson, Sarah Parkin, Rosemary Parkinson, Diana Shave, and Colin Dyer. 2012. Counselling in the workplace: How time-limited counselling can effect change in well-being. Counselling and Psychotherapy Research 12, 2 (2012), 84–92.
[16]
Cambridge Consultants. 2019. Use of AI in Online Content Moderation. (2019).
[17]
Christine L Cook, Jie Cai, and Donghee Yvette Wohn. 2022. Awe Versus Aww: The Effectiveness of Two Kinds of Positive Emotional Stimulation on Stress Reduction for Online Content Moderators. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–19.
[18]
Christine L Cook, Aashka Patel, and Donghee Yvette Wohn. 2021. Commercial versus volunteer: Comparing user perceptions of toxicity and transparency in content moderation across social media platforms. Frontiers in Human Dynamics 3 (2021), 626409.
[19]
M Csikszentmihalyi. 1990. Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. (1990).
[20]
Brandon Dang, Martin J Riedl, and Matthew Lease. 2018. But who protects the moderators? the case of crowdsourced image moderation. arXiv preprint arXiv:1804.10999 (2018).
[21]
Anubrata Das, Brandon Dang, and Matthew Lease. 2020. Fast, accurate, and healthier: Interactive blurring helps moderators reduce exposure to harmful content. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 8. 33–42.
[22]
Edward L Deci. 1971. Effects of externally mediated rewards on intrinsic motivation.Journal of personality and Social Psychology 18, 1 (1971), 105.
[23]
Edward L Deci and Richard M Ryan. 2008. Facilitating optimal motivation and psychological well-being across life’s domains.Canadian psychology/Psychologie canadienne 49, 1 (2008), 14.
[24]
Oscar Deniz, Ismael Serrano, Gloria Bueno, and Tae-Kyun Kim. 2014. Fast violence detection in video. In 2014 international conference on computer vision theory and applications (VISAPP), Vol. 2. IEEE, 478–485.
[25]
Elizabeth Dwoskin. 2019. Internet gatekeepers pay a psychic toll. Post Reports, the daily podcast of The Washington Post (2019).
[26]
Jennifer Elias. 2020. Former YouTube content moderator describes horrors of the job in new lawsuit. https://www.cnbc.com/2020/09/22/former-youtube-content-moderator-describes-horrors-of-the-job-in-lawsuit.html
[27]
Paul A Frewen and Ruth A Lanius. 2006. Toward a psychobiology of posttraumatic self-dysregulation: Reexperiencing, hyperarousal, dissociation, and emotional numbing. Annals of the New York Academy of Sciences 1071, 1 (2006), 110–124.
[28]
Abhimanyu Ghoshal. 2017. Microsoft sued by employees who developed ptsd after reviewing disturbing content. The next web (2017).
[29]
Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
[30]
Joanne E Gray and Nicolas P Suzor. 2020. Playing with machines: Using machine learning to understand automated copyright enforcement at scale. Big Data & Society 7, 1 (2020), 2053951720919963.
[31]
Michael Hemphill. 1996. A note on adults’ color–emotion associations. The Journal of genetic psychology 157, 3 (1996), 275–280.
[32]
Hope Horner. 2019. The Psychology of Video: Why Video makes people more likely to buy. https://sproutvideo.com/blog/psychology-why-video-makes-people-more-likely-buy.html
[33]
Matthew Hotopf and Simon Wessely. 1997. Stress in the workplace: unfinished business.Journal of Psychosomatic Research 43, 1 (1997), 1–6.
[34]
Patrick G Hunter, E Glenn Schellenberg, and Ulrich Schimmack. 2010. Feelings and perceptions of happiness and sadness induced by music: Similarities, differences, and mixed emotions.Psychology of Aesthetics, Creativity, and the Arts 4, 1 (2010), 47.
[35]
Shagun Jhaver, Sucheta Ghoshal, Amy Bruckman, and Eric Gilbert. 2018. Online harassment and content moderation: The case of blocklists. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 2 (2018), 1–33.
[36]
Ece Kamar, Eric Horvitz, Alex Bowyer, and Grant Miller. 2016. Intervention strategies for increasing engagement in crowdsourcing: Platform, predictions, and experiments. (2016).
[37]
Sowmya Karunakaran and Rashmi Ramakrishan. 2019. Testing stylistic interventions to reduce emotional impact of content moderation workers. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 50–58.
[38]
Alethea HQ Koh, Eddie MW Tong, and Alexander YL Yuen. 2019. The buffering effect of awe on negative affect towards lost possessions. The Journal of Positive Psychology 14, 2 (2019), 156–165.
[39]
Christof Kuhbandner and Reinhard Pekrun. 2013. Joint effects of emotion and color on memory.Emotion 13, 3 (2013), 375.
[40]
Nancy Kwallek, Carol M Lewis, and Ann S Robbins. 1988. Effects of office interior color on workers’ mood and productivity. Perceptual and Motor Skills 66, 1 (1988), 123–128.
[41]
Vickie A Lambert, Clinton E Lambert, and Hiroaki Yamase. 2003. Psychological hardiness, workplace stress and related stress reduction strategies. Nursing & Health Sciences 5, 2 (2003), 181–184.
[42]
Anthony D LaMontagne, Angela Martin, Kathryn M Page, Nicola J Reavley, Andrew J Noblet, Allison J Milner, Tessa Keegel, and Peter M Smith. 2014. Workplace mental health: developing an integrated intervention approach. BMC psychiatry 14, 1 (2014), 1–11.
[43]
Peter J Lang, Margaret M Bradley, Bruce N Cuthbert, 2005. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. NIMH, Center for the Study of Emotion & Attention Gainesville, FL.
[44]
Jeongwoo Lee, Jihye Lee, Hyungsun Lim, Ji-Seon Son, Jun-Rae Lee, Dong-Chan Kim, and Seonghoon Ko. 2012. Cartoon distraction alleviates anxiety in children during induction of anesthesia. Anesthesia & Analgesia 115, 5 (2012), 1168–1173.
[45]
Kalev Leetaru. 2018. Why we still need human moderators in an AI-Powered World. https://www.forbes.com/sites/kalevleetaru/2018/09/08/why-we-still-need-human-moderators-in-an-ai-powered-world/?sh=4d05c50f1412
[46]
Sara Lindberg. 2022. What is emotional numbing?https://www.verywellmind.com/emotional-numbing-symptoms-2797372
[47]
Clare J Mackie, Natalie Castellanos-Ryan, and Patricia J Conrod. 2011. Personality moderates the longitudinal relationship between psychological symptoms and alcohol use in adolescents. Alcoholism: Clinical and Experimental Research 35, 4 (2011), 703–716.
[48]
Silvia Meyer, Alexander Grob, and Markus Gerber. 2021. No fun, no gain: The stress-buffering effect of physical activity on life satisfaction depends on adolescents’ intrinsic motivation. Psychology of Sport and Exercise 56 (2021), 102004.
[49]
[49] Online Moderation. 2019. https://www.onlinemoderation.com/human-moderators-versus-technology/
[50]
Jessica Gall Myrick. 2015. Emotion regulation, procrastination, and watching cat videos online: Who watches Internet cats, why, and to what effect?Computers in human behavior 52 (2015), 168–176.
[51]
Casey Newton. 2019. The emotional toll of content moderation. https://www.npr.org/2019/12/21/790492548/the-emotional-toll-of-content-moderation
[52]
Casey Newton. 2019. The trauma floor: The secret lives of Facebook moderators in America. The Verge 25, 02 (2019).
[53]
Casey Newton. 2020. Facebook will pay $52 million in settlement with moderators who developed PTSD on the job. https://www.theverge.com/2020/5/12/21255870.
[54]
Casey Newton. 2020. YouTube moderators are being forced to sign a statement acknowledging the job can give them PTSD. https://www.theverge.com/2020/1/24/21075830/youtube-moderators-ptsd-accenture-statement-lawsuits-mental-health
[55]
Annabelle Nyst. 2023. 134 social media statistics you need to know for 2023. https://www.searchenginejournal.com/social-media-statistics/480507/
[56]
Faculty of Biological Sciences. 2020. What are the health benefits of watching cute animals?https://biologicalsciences.leeds.ac.uk/school-biomedical-sciences/news/article/273/what-are-the-health-benefits-of-watching-cute-animals
[57]
Se-Hyung Park, So-Young Kim, Jinny Hye-Jin Choo, Won-jae Lee, and Jun-sang Kang. 2009. Using new media to create integrating art therapy: animation therapy. In ACM SIGGRAPH ASIA 2009 Educators Program. 1–5.
[58]
John Pavlopoulos, Prodromos Malakasiotis, and Ion Androutsopoulos. 2017. Deep learning for user comment moderation. arXiv preprint arXiv:1705.09993 (2017).
[59]
Emily R.2023. The Ultimate Guide to Content moderation. https://getstream.io/blog/content-moderation/
[60]
Sarah T Roberts. 2016. Commercial content moderation: Digital laborers’ dirty work. (2016).
[61]
Sarah T. Roberts. 2017. Content Moderation. Springer International Publishing, Cham, 1–4. https://doi.org/10.1007/978-3-319-32001-4_44-1
[62]
Melanie Rudd, Kathleen D Vohs, and Jennifer Aaker. 2012. Awe expands people’s perception of time, alters decision making, and enhances well-being. Psychological science 23, 10 (2012), 1130–1136.
[63]
Napa Sae-Bae, Xiaoxi Sun, Husrev T Sencar, and Nasir D Memon. 2014. Towards automatic detection of child pornography. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 5332–5336.
[64]
Anna Schmidt and Michael Wiegand. 2017. A survey on hate speech detection using natural language processing. In Proceedings of the fifth international workshop on natural language processing for social media. 1–10.
[65]
Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping pro and anti-social behavior on twitch through moderation and example-setting. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. 111–125.
[66]
Elisabeth Sherman. 2020. Therapists Explain How Cartoons Affect Your Mental Health.
[67]
Satyendra Singh. 2006. Impact of color on marketing. Management decision 44, 6 (2006), 783–789.
[68]
Miriah Steiger, Timir J Bharucha, Sukrit Venkatagiri, Martin J Riedl, and Matthew Lease. 2021. The psychological well-being of content moderators: the emotional labor of commercial moderation and avenues for improving support. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.
[69]
Mark Sullivan. 2019. Facebook is expanding its tools to make content moderation less toxic.
[70]
Tina M Sutton and Jeanette Altarriba. 2016. Color associations to emotion and emotion-laden words: A collection of norms for stimulus construction and selection. Behavior research methods 48 (2016), 686–728.
[71]
Tan Tang, Yanhong Wu, Yingcai Wu, Lingyun Yu, and Yuhong Li. 2021. Videomoderator: A risk-aware framework for multimodal video moderation in e-commerce. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2021), 846–856.
[72]
Meike K Uhrig, Nadine Trautmann, Ulf Baumgärtner, Rolf-Detlef Treede, Florian Henrich, Wolfgang Hiller, and Susanne Marschall. 2016. Emotion elicitation: A comparison of pictures and films. Frontiers in psychology 7 (2016), 180.
[73]
Magdalena MHE Van den Berg, Jolanda Maas, Rianne Muller, Anoek Braun, Wendy Kaandorp, René Van Lien, Mireille NM Van Poppel, Willem Van Mechelen, and Agnes E Van den Berg. 2015. Autonomic nervous system responses to viewing green and built settings: differentiating between sympathetic and parasympathetic activity. International journal of environmental research and public health 12, 12 (2015), 15860–15874.
[74]
Bertie Vidgen, Helen Margetts, and Alex Harris. 2019. How much online abuse is there. Alan Turing Institute 11 (2019).
[75]
Jacqueline C Vischer. 2007. The effects of the physical environment on job performance: towards a theoretical model of workspace stress. Stress and health: Journal of the International Society for the Investigation of Stress 23, 3 (2007), 175–184.
[76]
Jiaxin Wang, Xiaoxiao Fu, and Youcheng Wang. 2021. Can “bad” stressors spark “good” behaviors in frontline employees? Incorporating motivation and emotion. International journal of contemporary hospitality management 33, 1 (2021), 101–124.
[77]
Xinrui Wang and Jinze Yu. 2020. Learning to cartoonize using white-box cartoon representations. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 8090–8099.
[78]
David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: the PANAS scales.Journal of personality and social psychology 54, 6 (1988), 1063.
[79]
Webhelp. 2022. Why are human moderators still essential?https://webhelp.com/news/why-are-human-moderators-still-essential/
[80]
Jason Wise. 2023. How many Instagram posts are there in 2023?https://earthweb.com/how-many-instagram-posts-are-there/
[81]
Donghee Yvette Wohn. 2019. Volunteer moderators in twitch micro communities: How they get involved, the roles they play, and the emotional labor they experience. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.
[82]
Jing Zeng and D Bondy Valdovinos Kaye. 2022. From content moderation to visibility moderation: A case study of platform governance on TikTok. Policy & Internet 14, 1 (2022), 79–95.
[83]
Haoti Zhong, Hao Li, Anna Cinzia Squicciarini, Sarah Michele Rajtmajer, Christopher Griffin, David J Miller, and Cornelia Caragea. 2016. Content-Driven Detection of Cyberbullying on the Instagram Social Network. In IJCAI, Vol. 16. 3952–3958.
Index Terms
- Exploring Intervention Techniques to Alleviate Negative Emotions during Video Content Moderation Tasks as a Worker-centered Task Design
Recommendations
Privacy Risks, Emotions, and Social Media: A Coping Model of Online Privacy
This study proposes a novel coping model of privacy that extends prior privacy work in two important ways: first, the reconceptualization of privacy coping reflecting both problem- and emotion-focused strategies, and second, the incorporation of discrete ...
Overwhelmed by negative emotions?: maybe you are being cyber-bullied!
SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied ComputingWith the increasing number of interactions, social media users have been vulnerable to intentional aggressive acts and cyberbullying instances. In this paper, first, we carry out a message-level cyberbullying annotation on an Instagram dataset. Second, ...
Detecting negative emotions during social media use on smartphones
AsianHCI '19: Proceedings of Asian CHI Symposium 2019: Emerging HCI Research CollectionEmotions are integral to the social media user experience; we express our feelings, react to posted content and communicate with emoji. This may lead to emotional contagion and undesirable behaviors such as cyberbullying and flaming. Nearly real-time ...
Comments
Information & Contributors
Information
Published In
July 2024
3616 pages
ISBN:9798400705830
DOI:10.1145/3643834
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- National Research Foundation of Korea (NRF) by the Ministry of Science and ICT
- DGIST Start-up Fund Program
Conference
DIS '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 179Total Downloads
- Downloads (Last 12 months)179
- Downloads (Last 6 weeks)68
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in