Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3290605.3300294acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Moments of Change: Analyzing Peer-Based Cognitive Support in Online Mental Health Forums

Published: 02 May 2019 Publication History

Abstract

Clinical psychology literature indicates that reframing ir- rational thoughts can help bring positive cognitive change to those suffering from mental distress. Through data from an online mental health forum, we study how these cognitive processes play out in peer-to-peer conversations. Acknowledging the complexity of measuring cognitive change, we first provide an operational definition of a "moment of change" based on sentiment change in online conversations. Using this definition, we propose a predictive model that can identify whether a conversation thread or a post is associated with a moment of cognitive change. Consistent with psychological literature, we find that markers of language associated with sentiment and and affect are the most predictive. Further, cultural differences play an important role: predictive models trained on one country generalize poorly to others. To understand how a moment of change happens, we build a model that explicitly tracks topic and associated sentiment in a forum thread.

References

[1]
2013. Australian self harm forum app TalkLife set to shut down. (2013). http://www.abc.net.au/am/content/2013/s3727568.htm
[2]
2018. https://en.wikipedia.org /wiki/List_of_psychiatric_medications_ by_condition_treated.
[3]
2018. https://talklife.co/. CHI'19, May 2019, Glasgow, UK Y. Pruksachatkun et al.
[4]
2018. http://www.hpft.nhs.uk/media/1184/ cbt-workshop-booklet_web.pdf.
[5]
2018. XGBoost Documentation. (2018).
[6]
Tim Althoff, Kevin Clark, and Jure Leskovec. 2016. Large-scale analysis of counseling conversations: An application of natural language processing to mental health. Transactions of the Association for Computational Linguistics 4 (2016), 463.
[7]
Nazanin Andalibi, Pinar Öztürk, and Andrea Forte. 2017. Sensitive Self-disclosures, Responses, and Social Support on Instagram: The Case of# Depression. In CSCW. 1485--1500.
[8]
R Michael Bagby, Lena C Quilty, Zindel V Segal, Carolina C McBride, Sidney H Kennedy, and Paul T Costa Jr. 2008. Personality and differential treatment response in major depression: a randomized controlled trial comparing cognitive-behavioural therapy and pharmacotherapy. The Canadian Journal of Psychiatry 53, 6 (2008), 361--370.
[9]
Sairam Balani and Munmun De Choudhury. 2015. Detecting and characterizing mental health related self-disclosure in social media. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1373--1378.
[10]
Jason Baumgartner. 2015. Complete Public Reddit Comments Corpus. (2015). https://archive.org/details/2015_reddit_comments_corpus
[11]
Aaron T Beck. 1979. Cognitive therapy of depression. Guilford press.
[12]
Aaron T Beck. 2008. The evolution of the cognitive model of depression and its neurobiological correlates. American Journal of Psychiatry 165, 8 (2008), 969--977.
[13]
Dror Ben-Zeev, Michael A Young, and Joshua W Madsen. 2009. Retrospective recall of affect in clinically depressed individuals and controls. Cognition and Emotion 23, 5 (2009), 1021--1040.
[14]
Arpita Bhattacharya, Sean A Munson, Jacob O Wobbrock, and Wanda Pratt. 2017. Design Opportunities for Mental Health Peer Support Technologies.
[15]
Steven Bird and Edward Loper. 2004. NLTK: the natural language toolkit. In Proceedings of the ACL 2004 on Interactive poster and demonstration sessions. Association for Computational Linguistics, 31.
[16]
Raquel R Cabral and Timothy B Smith. 2011. Racial/ethnic matching of clients and therapists in mental health services: A meta-analytic review of preferences, perceptions, and outcomes. Journal of Counseling Psychology 58, 4 (2011), 537.
[17]
Glen Coppersmith, Mark Dredze, and Craig Harman. 2014. Quantifying mental health signals in Twitter. In Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality. 51--60.
[18]
Dan Cosley, Dan Frankowski, Loren Terveen, and John Riedl. 2007. SuggestBot: using intelligent task routing to help people find work in wikipedia. In Proceedings of the 12th international conference on Intelligent user interfaces. ACM, 32--41.
[19]
Pim Cuijpers, Annemieke Van Straten, and Gerhard Andersson. 2008. Internet-administered cognitive behavior therapy for health problems: a systematic review. Journal of behavioral medicine 31, 2 (2008), 169-- 177.
[20]
Munmun De Choudhury, Scott Counts, and Eric Horvitz. 2013. Social media as a measurement tool of depression in populations. In Proceedings of the 5th Annual ACM Web Science Conference. ACM, 47--56.
[21]
Munmun De Choudhury and Sushovan De. 2014. Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity. In ICWSM.
[22]
Munmun De Choudhury, Michael Gamon, Scott Counts, and Eric Horvitz. 2013. Predicting depression via social media. ICWSM 13 (2013), 1--10.
[23]
Munmun De Choudhury and Emre Kiciman. 2017. The language of social support in social media and its effect on suicidal ideation risk. In Proceedings of the... International AAAI Conference on Weblogs and Social Media. International AAAI Conference on Weblogs and Social Media, Vol. 2017. NIH Public Access, 32.
[24]
Munmun De Choudhury, Emre Kiciman, Mark Dredze, Glen Coppersmith, and Mrinal Kumar. 2016. Discovering shifts to suicidal ideation from mental health content in social media. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 2098-- 2110.
[25]
Munmun De Choudhury, Sanket S Sharma, Tomaz Logar, Wouter Eekhout, and René Clausen Nielsen. 2017. Gender and cross-cultural differences in social media disclosures of mental illness. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 353--369.
[26]
Guilherme de Oliveira. 2016. Text Summarization. https://github.com/ g-deoliveira/TextSummarization.
[27]
Robert J DeRubeis, Mark D Evans, Steven D Hollon, Michael J Garvey, William M Grove, and Vicente B Tuason. 1990. How does cognitive therapy work? Cognitive change and symptom change in cognitive therapy and pharmacotherapy for depression. Journal of Consulting and Clinical Psychology 58, 6 (1990), 862.
[28]
Kuntal Dey, Ritvik Shrivastava, and Saroj Kaushik. 2018. Topical Stance Detection for Twitter: A Two-Phase LSTM Model Using Attention. In European Conference on Information Retrieval. Springer, 529--536.
[29]
Sarmistha Dutta, Jennifer Ma, and Munmun De Choudhury. 2018. Measuring the Impact of Anxiety on Online Social Interactions. (2018).
[30]
Ulrich W Ebner-Priemer, Janice Kuo, Stacy Shaw Welch, Tanja Thielgen, Steffen Witte, Martin Bohus, and Marsha M Linehan. 2006. A valence-dependent group-specific recall bias of retrospective selfreports: A study of borderline personality disorder in everyday life. The Journal of nervous and mental disease 194, 10 (2006), 774--779.
[31]
Marilyn Evans, Lorie Donelle, and Laurie Hume-Loveland. 2012. Social support and online postpartum depression discussion groups: A content analysis. Patient education and counseling 87, 3 (2012), 405--410.
[32]
Ingo Feinerer and Kurt Hornik. 2017. wordnet: WordNet Interface. https://CRAN.R-project.org/package=wordnet R package version 0.114.
[33]
Ronen Feldman. 2013. Techniques and applications for sentiment analysis. Commun. ACM 56, 4 (2013), 82--89.
[34]
Brandon A Gaudiano. 2008. Cognitive-behavioral therapies: Achievements and challenges. Evidence-Based Mental Health 11, 1 (2008), 5.
[35]
CJ Hutto Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Eighth International Conference on Weblogs and Social Media (ICWSM-14).
[36]
Eric Gilbert and Karrie Karahalios. 2009. Predicting tie strength with social media. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 211--220.
[37]
Amy L Gonzales, Jeffrey T Hancock, and James W Pennebaker. 2010. Language style matching as a predictor of social dynamics in small groups. Communication Research 37, 1 (2010), 3--19.
[38]
Kathleen M Griffiths, Andrew J Mackinnon, Dimity A Crisp, Helen Christensen, Kylie Bennett, and Louise Farrer. 2012. The effectiveness of an online support group for members of the community with depression: a randomised controlled trial. PloS one 7, 12 (2012), e53244.
[39]
Christine Howes, Matthew Purver, and Rose McCabe. 2014. Linguistic indicators of severity and progress in online text-based therapy for depression. In Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality. 7--16.
[40]
Yohan Jo and Alice H Oh. 2011. Aspect and sentiment unification model for online review analysis. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 815--824.
[41]
Yohan Jo, Shivani Poddar, Byungsoo Jeon, Qinlan Shen, Carolyn Penstein Rose, and Graham Neubig. 2018. Attentive Interaction Model: Modeling Changes in View in Argumentation. In 2018 Conference Moments of Change: Analyzing Peer-Based Cognitive Support in Online Mental Health Forums CHI'19, May 2019, Glasgow, UK of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies.
[42]
Alan E Kazdin. 2007. Mediators and mechanisms of change in psychotherapy research. Annu. Rev. Clin. Psychol. 3 (2007), 1--27.
[43]
William Labov and David Fanshel. 1977. Therapeutic discourse: Psychotherapy as conversation. Academic Press.
[44]
Stephen P Lewis, Nancy L Heath, Jill M St Denis, and Rick Noble. 2011. The scope of nonsuicidal self-injury on YouTube. Pediatrics (2011), peds--2010.
[45]
Lorenzo Lorenzo-Luaces, Ramaris E German, and Robert J DeRubeis. 2015. It's complicated: The relation between cognitive change procedures, cognitive change, and symptom change in cognitive therapy for depression. Clinical psychology review 41 (2015), 3--15.
[46]
Shery Mead, David Hilton, and Laurie Curtis. 2001. Peer support: A theoretical perspective. Psychiatric rehabilitation journal 25, 2 (2001), 134.
[47]
Saif M Mohammad and Felipe Bravo-Marquez. 2017. Emotion intensities in tweets. arXiv preprint arXiv:1708.03696 (2017).
[48]
Robert R Morris, Stephen M Schueller, and Rosalind W Picard. 2015. Efficacy of a Web-based, crowdsourced peer-to-peer cognitive reappraisal platform for depression: randomized controlled trial. Journal of medical Internet research 17, 3 (2015).
[49]
Samantha Murphy. 2015. Uploading depression. New Scientist 228, 3046 (2015), 40--43.
[50]
Mark Nichter. 1981. Idioms of distress: Alternatives in the expression of psychosocial distress: A case study from South India. Culture, medicine and psychiatry 5, 4 (1981), 379--408.
[51]
Kate G Niederhoffer and James W Pennebaker. 2002. Linguistic style matching in social interaction. Journal of Language and Social Psychology 21, 4 (2002), 337--360.
[52]
Kathleen O'Leary, Stephen M Schueller, Jacob O Wobbrock, and Wanda Pratt. 2018. Suddenly, we got to become therapists for each other: Designing Peer Support Chats for Mental Health. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 331.
[53]
Akira Otani. 1989. Client resistance in counseling: Its theoretical rationale and taxonomic classification. Journal of Counseling & Development 67, 8 (1989), 458--461.
[54]
Christine A Padesky. 1993. Socratic questioning: Changing minds or guiding discovery. In A keynote address delivered at the European Congress of Behavioural and Cognitive Therapies.
[55]
Bo Pang, Lillian Lee, et al. 2008. Opinion mining and sentiment analysis. Foundations and Trends® in Information Retrieval 2, 1--2 (2008), 1--135.
[56]
Sachin R Pendse. 2018. Sochiatrist: Inferring the Relationship Between Emotion and Private Social Messages. (2018). http://cs.brown.edu/ research/pubs/theses/masters/2018/pendse.sachin.pdf
[57]
James W Pennebaker, Ryan L Boyd, Kayla Jordan, and Kate Blackburn. 2015. The development and psychometric properties of LIWC2015. Technical Report.
[58]
James W Pennebaker, Martha E Francis, and Roger J Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates 71 (2001).
[59]
Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. arXiv preprint arXiv:1802.05365 (2018).
[60]
R Raguram, Mitchell G Weiss, Harshad Keval, and SM Channabasavanna. 2001. Cultural dimensions of clinical depression in Bangalore, India. Anthropology & Medicine 8, 1 (2001), 31--46.
[61]
Stephen A Rains, Emily B Peterson, and Kevin B Wright. 2015. Communicating social support in computer-mediated contexts: A metaanalytic review of content analyses examining support messages shared online among individuals coping with illness. Communication Monographs 82, 4 (2015), 403--430.
[62]
Philip Resnik, Anderson Garron, and Rebecca Resnik. 2013. Using topic modeling to improve prediction of neuroticism and depression in college students. In Proceedings of the 2013 conference on empirical methods in natural language processing. 1348--1353.
[63]
Martha Sajatovic and Luis F Ramirez. 2012. Rating scales in mental health. JHU Press.
[64]
Eva Sharma and Munmun De Choudhury. 2018. Mental Health Support and its Relationship to Linguistic Accommodation in Online Communities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 641.
[65]
Barbara Stanley and Gregory K Brown. 2012. Safety planning intervention: a brief intervention to mitigate suicide risk. Cognitive and Behavioral Practice 19, 2 (2012), 256--264.
[66]
Chenhao Tan, Vlad Niculae, Cristian Danescu-Niculescu-Mizil, and Lillian Lee. 2016. Winning arguments: Interaction dynamics and persuasion strategies in good-faith online discussions. In Proceedings of the 25th international conference on world wide web. International World Wide Web Conferences Steering Committee, 613--624.
[67]
Andrew Trask, Phil Michalak, and John Liu. 2015. sense2vec-A fast and accurate method for word sense disambiguation in neural word embeddings. arXiv preprint arXiv:1511.06388 (2015).
[68]
Yi-Chia Wang, Moira Burke, and Robert Kraut. 2016. Modeling selfdisclosure in social networking sites. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 74--85.
[69]
Sarah Watts, Anna Mackenzie, Cherian Thomas, Al Griskaitis, Louise Mewton, Alishia Williams, and Gavin Andrews. 2013. CBT for depression: a pilot RCT comparing mobile phone vs. computer. BMC psychiatry 13, 1 (2013), 49.
[70]
Zhongyu Wei, Yang Liu, and Yi Li. 2018. Is This Post Persuasive? Ranking Argumentative Comments in the Online Forum. Association of Computational Linguistics ACL (2018).
[71]
Mitchell G Weiss, R Raguram, and SM Channabasavanna. 1995. Cultural Dimensions of Psychiatric Diagnosis: A Comparison of DSM--III-- R and Illness Explanatory Models in South India. The British Journal of Psychiatry 166, 3 (1995), 353--359.
[72]
Reza Zafarani and Huan Liu. 2015. Evaluation without ground truth in social media research. Commun. ACM 58, 6 (2015), 54--60.
[73]
Justine Zhang, Jonathan P Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Yiqing Hua, Nithum Thain, and Dario Taraborelli. 2018. Conversations Gone Awry: Detecting Early Signs of Conversational Failure. arXiv preprint arXiv:1805.05345 (2018).
[74]
Arkaitz Zubiaga, Elena Kochkina, Maria Liakata, Rob Procter, and Michal Lukasik. 2016. Stance classification in rumours as a sequential task exploiting the tree structure of social media conversations. arXiv preprint arXiv:1609.09028 (2016).

Cited By

View all
  • (2024)Understanding the Impacts of Online Mental Health Peer Support Forums: Realist SynthesisJMIR Mental Health10.2196/5575011(e55750)Online publication date: 9-May-2024
  • (2024)Towards Inclusive Futures for Worker WellbeingProceedings of the ACM on Human-Computer Interaction10.1145/36374148:CSCW1(1-32)Online publication date: 26-Apr-2024
  • (2024)"Unrest and trauma stays with you!": Navigating mental health and professional service-seeking in KashmirProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642507(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
May 2019
9077 pages
ISBN:9781450359702
DOI:10.1145/3290605
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computational clinical psychology
  2. mental health
  3. online communities
  4. social computing
  5. social media
  6. topic modeling

Qualifiers

  • Research-article

Conference

CHI '19
Sponsor:

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)122
  • Downloads (Last 6 weeks)17
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Understanding the Impacts of Online Mental Health Peer Support Forums: Realist SynthesisJMIR Mental Health10.2196/5575011(e55750)Online publication date: 9-May-2024
  • (2024)Towards Inclusive Futures for Worker WellbeingProceedings of the ACM on Human-Computer Interaction10.1145/36374148:CSCW1(1-32)Online publication date: 26-Apr-2024
  • (2024)"Unrest and trauma stays with you!": Navigating mental health and professional service-seeking in KashmirProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642507(1-17)Online publication date: 11-May-2024
  • (2024)Supporting Cognitive Reappraisal With Digital Technology: A Content Analysis and Scoping Review of Challenges, Interventions, and Future DirectionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642488(1-17)Online publication date: 11-May-2024
  • (2024)Advancing a consent-forward paradigm for digital mental health dataNature Mental Health10.1038/s44220-024-00330-12:11(1298-1307)Online publication date: 25-Oct-2024
  • (2024)Exploring linguistic features and user engagement in Chinese online mental health counselingHeliyon10.1016/j.heliyon.2024.e38042(e38042)Online publication date: Sep-2024
  • (2023)Understanding Disclosure and Support for Youth Mental Health in Social Music CommunitiesProceedings of the ACM on Human-Computer Interaction10.1145/35796297:CSCW1(1-32)Online publication date: 16-Apr-2023
  • (2023)Don't Let Netflix Drive the Bus: User's Sense of Agency Over Time and Content Choice on NetflixProceedings of the ACM on Human-Computer Interaction10.1145/35796047:CSCW1(1-32)Online publication date: 16-Apr-2023
  • (2023)Do Streamers Care about Bystanders' Privacy? An Examination of Live Streamers' Considerations and Strategies for Bystanders' Privacy ManagementProceedings of the ACM on Human-Computer Interaction10.1145/35796037:CSCW1(1-29)Online publication date: 16-Apr-2023
  • (2023)Discovering the Hidden Facts of User-Dispatcher Interactions via Text-based Reporting Systems for Community SafetyProceedings of the ACM on Human-Computer Interaction10.1145/35796027:CSCW1(1-31)Online publication date: 16-Apr-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media