Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3543507.3583863acmconferencesArticle/Chapter ViewAbstractPublication PageswebconfConference Proceedingsconference-collections
research-article

EDNet: Attention-Based Multimodal Representation for Classification of Twitter Users Related to Eating Disorders

Published: 30 April 2023 Publication History
  • Get Citation Alerts
  • Abstract

    Social media platforms provide rich data sources in several domains. In mental health, individuals experiencing an Eating Disorder (ED) are often hesitant to seek help through conventional healthcare services. However, many people seek help with diet and body image issues on social media. To better distinguish at-risk users who may need help for an ED from those who are simply commenting on ED in social environments, highly sophisticated approaches are required. Assessment of ED risks in such a situation can be done in various ways, and each has its own strengths and weaknesses. Hence, there is a need for and potential benefit of a more complex multimodal approach. To this end, we collect historical tweets, user biographies, and online behaviours of relevant users from Twitter, and generate a reasonably large labelled benchmark dataset. Thereafter, we develop an advanced multimodal deep learning model called EDNet using these data to identify the different types of users with ED engagement (e.g., potential ED sufferers, healthcare professionals, or communicators) and distinguish them from those not experiencing EDs on Twitter. EDNet consists of five deep neural network layers. With the help of its embedding, representation and behaviour modeling layers, it effectively learns the multimodalities of social media. In our experiments, EDNet consistently outperforms all the baseline techniques by significant margins. It achieves an accuracy of up to 94.32% and F1 score of up to 93.91% F1 score. To the best of our knowledge, this is the first such study to propose a multimodal approach for user-level classification according to their engagement with ED content on social media.

    References

    [1]
    Mohammad Abuhassan, Tarique Anwar, Matthew Fuller-Tyszkiewicz, K Jarman Han-nah, Adrian Shatte, Chengfei Liu, and Suku Sukunesan. 2022. Classification of Twitter users with eating disorder engagement: Learning from the biographies. Computers in Human Behavior (2022), 107519.
    [2]
    Ayelet Akselrod-Ballin, Michal Chorev, Yoel Shoshan, Adam Spiro, Alon Hazan, Roie Melamed, Ella Barkan, Esma Herzel, Shaked Naor, Ehud Karavani, 2019. Predicting breast cancer by applying deep learning to linked health records and mammograms. Radiology 292, 2 (2019), 331–342.
    [3]
    Laura Helena Andrade, J Alonso, Z Mneimneh, JE Wells, A Al-Hamzawi, G Borges, E Bromet, Ronny Bruffaerts, G De Girolamo, R De Graaf, 2014. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychological medicine 44, 6 (2014), 1303–1317.
    [4]
    Tarique Anwar, Matthew Fuller-Tyszkiewicz, Hannah K Jarman, Mohammad Abuhassan, Adrian Shatte, WIRED Team, and Suku Sukunesan. 2022. EDBase: Generating a Lexicon Base for Eating Disorders Via Social Media. IEEE Journal of Biomedical and Health Informatics (2022), 1–10. https://doi.org/10.1109/JBHI.2022.3211151
    [5]
    Tarique Anwar, Surya Nepal, Cecile Paris, Jian Yang, Jia Wu, and Quan Z. Sheng. 2022. Tracking the Evolution of Clusters in Social Media Streams. IEEE Transactions on Big Data (2022), 1–15. https://doi.org/10.1109/TBDATA.2022.3204207
    [6]
    Alina Arseniev-Koehler, Hedwig Lee, Tyler McCormick, and Megan A. Moreno. 2016. #Proana: Pro-Eating Disorder Socialization on Twitter. Journal of Adolescent Health 58, 6 (2016), 659–664.
    [7]
    American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders, 5th Edition: DSM-5. American Psychiatric Association, United States.
    [8]
    Shaojie Bai, J Zico Kolter, and Vladlen Koltun. 2018. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 (2018).
    [9]
    Ioana Baldini, Mariana Bernagozzi, Sulbha Aggarwal, Mihaela Bornea, Saksham Chawla, Joppe Geluykens, Dmitriy A Katz-Rogozhnikov, Pratik Mukherjee, Smruthi Ramesh, Sara Rosenthal, 2021. Exploring the Efficacy of Generic Drugs in Treating Cancer. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 15988–15990.
    [10]
    Brandon Ballinger, Johnson Hsieh, Avesh Singh, Nimit Sohoni, Jack Wang, Geoffrey H Tison, Gregory M Marcus, Jose M Sanchez, Carol Maguire, Jeffrey E Olgin, 2018. DeepHeart: semi-supervised sequence learning for cardiovascular risk prediction. In Thirty-Second AAAI Conference on Artificial Intelligence.
    [11]
    José Alberto Benítez-Andrades, José Manuel Alija-Pérez, Isaías García-Rodríguez, Carmen Benavides, Héctor Alaiz-Moretón, Rafael Pastor Vargas, and María Teresa García-Ordás. 2021. BERT Model-Based Approach For Detecting Categories of Tweets in the Field of Eating Disorders (ED). In 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS). IEEE, 586–590.
    [12]
    Margaret M Bradley and Peter J Lang. 1999. Affective norms for English words (ANEW): Instruction manual and affective ratings. Technical Report. Technical report C-1, the center for research in psychophysiology ….
    [13]
    Stevie Chancellor, Yannis Kalantidis, Jessica Annette Pater, Munmun De Choudhury, and David A. Shamma. 2017. Multimodal Classification of Moderated Online Pro-Eating Disorder Content. In CHI, Gloria Mark, Susan R. Fussell, Cliff Lampe, m. c. schraefel, Juan Pablo Hourcade, Caroline Appert, and Daniel Wigdor (Eds.). ACM, 3213–3226.
    [14]
    Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016. # thyghgapp: Instagram content moderation and lexical variation in pro-eating disorder communities. In Proceedings of the 19th ACM conference on computer-supported cooperative work & social computing. 1201–1213.
    [15]
    Carole E Chaski. 2001. Empirical evaluations of language-based author identification techniques. Forensic linguistics 8 (2001), 1–65.
    [16]
    Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
    [17]
    Edward Choi, Zhen Xu, Yujia Li, Michael Dusenberry, Gerardo Flores, Emily Xue, and Andrew Dai. 2020. Learning the graphical structure of electronic health records with graph convolutional transformer. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 606–613.
    [18]
    Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
    [19]
    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
    [20]
    C. G. Fairburn and S. J. Beglin. 1994. Assessment of eating disorders: interview or self-report questionnaire¿International journal of eating disorders 16, 4 (1994), 363–370.
    [21]
    Zhaoji Fu, Shenda Hong, Rui Zhang, and Shaofu Du. 2021. Artificial-intelligence-enhanced mobile system for cardiovascular health management. Sensors 21, 3 (2021), 773.
    [22]
    Shreya Ghosh and Tarique Anwar. 2021. Depression Intensity Estimation via Social Media: A Deep Learning Approach. IEEE Trans. on Computational Social Systems (2021), 1–10. https://doi.org/10.1109/TCSS.2021.3084154
    [23]
    Angela S Guarda. 2008. Treatment of anorexia nervosa: insights and obstacles. Physiology & behavior 94, 1 (2008), 113–120.
    [24]
    Tao Gui, Liang Zhu, Qi Zhang, Minlong Peng, Xu Zhou, Keyu Ding, and Zhigang Chen. 2019. Cooperative multimodal approach to depression detection in twitter. In Proceedings of the AAAI conference on artificial intelligence, Vol. 33. 110–117.
    [25]
    Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
    [26]
    Zhiheng Huang, Wei Xu, and Kai Yu. 2015. Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991 (2015).
    [27]
    Alon Jacovi, Oren Sar Shalom, and Yoav Goldberg. 2018. Understanding convolutional neural networks for text classification. arXiv preprint arXiv:1809.08037 (2018).
    [28]
    Alan E Kazdin, Ellen E Fitzsimmons-Craft, and Denise E Wilfley. 2017. Addressing critical gaps in the treatment of eating disorders. International Journal of Eating Disorders 50, 3 (2017), 170–189.
    [29]
    Therese E Kenny, Sarah L Boyle, and Stephen P Lewis. 2020. # recovery: Understanding recovery from the lens of recovery-focused blogs posted by individuals with lived experience. International Journal of Eating Disorders 53, 8 (2020), 1234–1243.
    [30]
    Colin Lea, Rene Vidal, Austin Reiter, and Gregory D Hager. 2016. Temporal convolutional networks: A unified approach to action segmentation. In European conference on computer vision. Springer, 47–54.
    [31]
    Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.
    [32]
    Pilar López-Úbeda, Flor Miriam Plaza-del Arco, Manuel Carlos Díaz-Galiano, and Maria-Teresa Martín-Valdivia. 2021. How Successful Is Transfer Learning for Detecting Anorexia on Social Media¿Applied Sciences 11, 4 (2021), 1838.
    [33]
    Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015).
    [34]
    Paulo Mann, Aline Paes, and Elton H Matsushima. 2021. Screening for depressed individuals by using multimodal social media data. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 15722–15723.
    [35]
    Mary Ann Marcinkiewicz. 1994. Building a large annotated corpus of English: The Penn Treebank. Using Large Corpora 273 (1994).
    [36]
    M. Moessner, J. Feldhege, M. Wolf, and S. Bauer. 2018. Analyzing big data in social media: Text and network analyses of an eating disorder forum. International journal of eating disorders 51, 7 (2018), 656–667.
    [37]
    Keiron O’Shea and Ryan Nash. 2015. An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458 (2015).
    [38]
    Waleed Ragheb, Jerome Aze, Sandra Bringay, and Maximilien Servajean. 2021. Negatively Correlated Noisy Learners for At-risk User Detection on Social Networks: A Study on Depression, Anorexia, Self-harm and Suicide. IEEE Trans. on Knowledge and Data Engineering (2021), 1–1. https://doi.org/10.1109/TKDE.2021.3078898
    [39]
    Diana Ramírez-Cifuentes, Marc Mayans, and Ana Freire. 2018. Early risk detection of anorexia on social media. In International Conference on Internet Science. Springer, 3–14.
    [40]
    Guozheng Rao, Chengxia Peng, Li Zhang, Xin Wang, and Zhiyong Feng. 2020. A knowledge enhanced ensemble learning model for mental disorder detection on social media. In International Conference on Knowledge Science, Engineering and Management. Springer, 181–192.
    [41]
    Ramit Sawhney, Harshit Joshi, Saumya Gandhi, and Rajiv Ratn Shah. 2021. Towards ordinal suicide ideation detection on social media. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 22–30.
    [42]
    Ashima Singh, Arwinder Dhillon, Neeraj Kumar, M Shamim Hossain, Ghulam Muhammad, and Manoj Kumar. 2021. eDiaPredict: An Ensemble-based framework for diabetes prediction. ACM Transactions on Multimidia Computing Communications and Applications 17, 2s (2021), 1–26.
    [43]
    Blanca Tébar and Anandha Gopalan. 2021. Early Detection of Eating Disorders using Social Media. In 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE). IEEE, 193–198.
    [44]
    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
    [45]
    Ning Wang, Fan Luo, Yuvraj Shivtare, Varsha D Badal, KP Subbalakshmi, Rajarathnam Chandramouli, and Ellen Lee. 2021. Learning models for suicide prediction from social media posts. arXiv preprint arXiv:2105.03315 (2021).
    [46]
    Hao Yan, Ellen E Fitzsimmons-Craft, Micah Goodman, Melissa Krauss, Sanmay Das, and Patricia Cavazos-Rehg. 2019. Automatic detection of eating disorder-related social media posts that could benefit from a mental health intervention. International Journal of Eating Disorders 52, 10 (2019), 1150–1156.
    [47]
    Cody Zacharias. 2017. Twint-twitter intelligence tool. https://pypi.org/project/twint/. Accessed: 2022-03-19.
    [48]
    Wissam Zam, Reham Saijari, and Ziad Sijari. 2018. Overview on eating disorders. Progress in Nutrition 20, 2-S (2018), 29–35.
    [49]
    Sicheng Zhou, Yunpeng Zhao, Jiang Bian, Ann F Haynos, Rui Zhang, 2020. Exploring eating disorder topics on Twitter: machine learning approach. JMIR Medical Informatics 8, 10 (2020), e18273.
    [50]
    Sicheng Zhou, Yunpeng Zhao, Rubina F. Rizvi, Jiang Bian, Ann F. Haynos, and Rui Zhang. 2019. Analysis of Twitter to Identify Topics Related to Eating Disorder Symptoms. In IEEE ICHI. IEEE, 1–4.
    [51]
    Hamad Zogan, Imran Razzak, Shoaib Jameel, and Guandong Xu. 2021. Depressionnet: A novel summarization boosted deep framework for depression detection on social media. arXiv preprint arXiv:2105.10878 (2021).

    Cited By

    View all
    • (2024)Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing ApproachesSensors10.3390/s2402034824:2(348)Online publication date: 6-Jan-2024
    • (2024)Conceptualising Fatness within HCI: A Call for Fat LiberationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642199(1-14)Online publication date: 11-May-2024
    • (2023)An Intention Inference Method for BiGRU Integrating Multi-head Self-Attention in Share Control2023 China Automation Congress (CAC)10.1109/CAC59555.2023.10451784(7880-7884)Online publication date: 17-Nov-2023

    Index Terms

    1. EDNet: Attention-Based Multimodal Representation for Classification of Twitter Users Related to Eating Disorders

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        WWW '23: Proceedings of the ACM Web Conference 2023
        April 2023
        4293 pages
        ISBN:9781450394161
        DOI:10.1145/3543507
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 30 April 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Artificial intelligence
        2. Eating disorders
        3. Mental health
        4. Multimodal deep learning
        5. Online social media

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        Conference

        WWW '23
        Sponsor:
        WWW '23: The ACM Web Conference 2023
        April 30 - May 4, 2023
        TX, Austin, USA

        Acceptance Rates

        Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)200
        • Downloads (Last 6 weeks)13
        Reflects downloads up to 27 Jul 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing ApproachesSensors10.3390/s2402034824:2(348)Online publication date: 6-Jan-2024
        • (2024)Conceptualising Fatness within HCI: A Call for Fat LiberationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642199(1-14)Online publication date: 11-May-2024
        • (2023)An Intention Inference Method for BiGRU Integrating Multi-head Self-Attention in Share Control2023 China Automation Congress (CAC)10.1109/CAC59555.2023.10451784(7880-7884)Online publication date: 17-Nov-2023

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media