Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3485447.3512013acmconferencesArticle/Chapter ViewAbstractPublication PageswebconfConference Proceedingsconference-collections
research-article
Open access

A Meta-learning based Stress Category Detection Framework on Social Media

Published: 25 April 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Psychological stress has become a wider-spread and serious health issue in modern society. Detecting stressors that cause the stress could enable people to take effective actions to manage the stress. Previous work relied on the stressor dictionary built upon words from the stressor-related categories in the LIWC (Linguistic Inquiry and Word Count), and focused on stress categories that appear frequently on social media. In this paper, we build a meta-learning based stress category detection framework, which can learn how to distinguish a new stress category with very little data through learning on frequently appeared categories without relying on any lexicon. It is comprised of three modules, i.e., encoder module, induction module, and relation module. The encoder module focuses on learning category-relevant representation of each tweet with Dependency Graph Convolutional Network and tweet attention. The induction module deploys Mixture of Experts mechanism to integrate and summarize a representation for each category. The relation module is adopted to measure the correlation between each pair of query tweets and categories. Through the three modules and the meta-training process, we can then obtain a model which learns to learn how to identify stress categories and can directly be employed to a new category with little labelled data. Our experimental results show that the proposed framework can achieve 75.3 accuracy with 3 labeled data for the rarely appeared stress categories. We also build a stress category dataset consisting of 12 stress categories with 1,553 manually labeled stressful microblogs which can help train AI models to assist psychological stress diagnosis.

    References

    [1]
    Lei Cao, Huijun Zhang, Ningyun Li, Xin Wang, Wisong Ri, and Ling Feng. 2021. Category-Aware Chronic Stress Detection on Microblogs. IEEE Journal of Biomedical and Health Informatics (2021).
    [2]
    Wanxiang Che, Zhenghua Li, and Ting Liu. 2010. Ltp: A chinese language technology platform. In Coling 2010: Demonstrations. 13–16.
    [3]
    Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. In NIPS 2014 Workshop on Deep Learning, December 2014.
    [4]
    Sheldon Cohen, Tom Kamarck, and Robin Mermelstein. 1983. A global measure of perceived stress. Journal of health and social behavior(1983), 385–396.
    [5]
    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171–4186.
    [6]
    Li Fei-Fei, Rob Fergus, and Pietro Perona. 2006. One-shot learning of object categories. IEEE transactions on pattern analysis and machine intelligence 28, 4(2006), 594–611.
    [7]
    Michael Fink. 2005. Object classification from a single example utilizing class relevance metrics. Advances in neural information processing systems 17 (2005), 449–456.
    [8]
    Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning. PMLR, 1126–1135.
    [9]
    Rui Gao, Bibo Hao, He Li, Yusong Gao, and Tingshao Zhu. 2013. Developing simplified Chinese psychological linguistic analysis dictionary for microblog. In International conference on brain and health informatics. Springer, 359–368.
    [10]
    Ruiying Geng, Binhua Li, Yongbin Li, Jian Sun, and Xiaodan Zhu. 2020. Dynamic Memory Induction Networks for Few-Shot Text Classification. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 1087–1094.
    [11]
    ZhiQiang Geng, GuoFei Chen, YongMing Han, Gang Lu, and Fang Li. 2020. Semantic relation extraction using sequential and tree-structured LSTM with attention. Information Sciences 509(2020), 183–192.
    [12]
    Reshmi Gopalakrishna Pillai, Mike Thelwall, and Constantin Orasan. 2018. Detection of stress and relaxation magnitudes for tweets. In Companion Proceedings of the The Web Conference 2018. 1677–1684.
    [13]
    Sharath Chandra Guntuku, Anneke Buffone, Kokil Jaidka, Johannes C Eichstaedt, and Lyle H Ungar. 2019. Understanding and measuring psychological stress using social media. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 214–225.
    [14]
    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, 770–778.
    [15]
    Karl Moritz Hermann and Phil Blunsom. 2013. The role of syntax in vector space models of compositional semantics. In Proceedings of the 51st annual meeting of the association for computational linguistics (volume 1: Long papers). 894–904.
    [16]
    Thomas H Holmes and Richard H Rahe. 1967. The social readjustment rating scale.Journal of psychosomatic research(1967).
    [17]
    Mengting Hu, Shiwan Zhao, Honglei Guo, Chao Xue, Hang Gao, Tiegang Gao, Renhong Cheng, and Zhong Su. 2021. Multi-Label Few-Shot Learning for Aspect Category Detection. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, 6330–6340. https://doi.org/10.18653/v1/2021.acl-long.495
    [18]
    Allen D Kanner, James C Coyne, Catherine Schaefer, and Richard S Lazarus. 1981. Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. Journal of behavioral medicine 4, 1 (1981), 1–39.
    [19]
    Diederik P Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR.
    [20]
    Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. ICLR (2017).
    [21]
    Robert B Lees. 1957. Syntactic structures.
    [22]
    Qi Li, Yuanyuan Xue, Liang Zhao, Jia Jia, and Ling Feng. 2016. Analyzing and identifying teens’ stressful periods and stressor events from a microblog. IEEE journal of biomedical and health informatics 21, 5(2016), 1434–1448.
    [23]
    Huijie Lin, Jia Jia, Quan Guo, Yuanyuan Xue, Jie Huang, Lianhong Cai, and Ling Feng. 2014. Psychological stress detection from cross-media microblog data using deep sparse neural network. In 2014 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1–6.
    [24]
    Huijie Lin, Jia Jia, Quan Guo, Yuanyuan Xue, Qi Li, Jie Huang, Lianhong Cai, and Ling Feng. 2014. User-level psychological stress detection from social media using deep neural network. In Proceedings of the 22nd ACM international conference on Multimedia. 507–516.
    [25]
    Huijie Lin, Jia Jia, Liqiang Nie, Guangyao Shen, and Tat-Seng Chua. 2016. What Does Social Media Say about Your Stress?. In IJCAI. 3775–3781.
    [26]
    Huijie Lin, Jia Jia, Jiezhong Qiu, Yongfeng Zhang, Guangyao Shen, Lexing Xie, Jie Tang, Ling Feng, and Tat-Seng Chua. 2017. Detecting stress based on social interactions in social networks. IEEE Transactions on Knowledge and Data Engineering 29, 9(2017), 1820–1833.
    [27]
    Jiaqi Ma, Zhe Zhao, Xinyang Yi, Jilin Chen, Lichan Hong, and Ed H Chi. 2018. Modeling task relationships in multi-task learning with multi-gate mixture-of-experts. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1930–1939.
    [28]
    MSE. 2020. mean square error. https://www.probabilitycourse.com/chapter9/9_1_5_mean_squared_error_MSE.php.
    [29]
    Tsendsuren Munkhdalai and Hong Yu. 2017. Meta networks. In International Conference on Machine Learning. PMLR, 2554–2563.
    [30]
    Barlian Henryranu Prasetio, Hiroki Tamura, and Koichi Tanno. 2020. Embedded Discriminant Analysis based Speech Activity Detection for Unsupervised Stress Speech Clustering. In 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR). IEEE, 1–7.
    [31]
    Sachin Ravi and Hugo Larochelle. 2016. Optimization as a model for few-shot learning. (2016).
    [32]
    Susana Rodrigues, Joana S Paiva, Duarte Dias, Gonçalo Pimentel, Mariana Kaiseler, and João Paulo S Cunha. 2018. Wearable biomonitoring platform for the assessment of stress and its impact on cognitive performance of firefighters: an experimental study. Clinical practice and epidemiology in mental health: CP & EMH 14 (2018), 250.
    [33]
    Sanay Muhammad Umar Saeed, Syed Muhammad Anwar, Muhammad Majid, and Adnan Mehmood Bhatti. 2015. Psychological stress measurement using low cost single channel EEG headset. In 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT). IEEE, 581–585.
    [34]
    Koustuv Saha and Munmun De Choudhury. 2017. Modeling stress with social media around incidents of gun violence on college campuses. Proceedings of the ACM on Human-Computer Interaction 1, CSCW(2017), 1–27.
    [35]
    Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. 2016. Meta-learning with memory-augmented neural networks. In International conference on machine learning. PMLR, 1842–1850.
    [36]
    Sina. 2020. Annual Report 2020. http://ir.weibo.com/financial-information/annual-reports.
    [37]
    Jake Snell, Kevin Swersky, and Richard Zemel. 2017. Prototypical networks for few-shot learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 4080–4090.
    [38]
    Flood Sung, Yongxin Yang, Li Zhang, Tao Xiang, Philip HS Torr, and Timothy M Hospedales. 2018. Learning to compare: Relation network for few-shot learning. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1199–1208.
    [39]
    Yla R Tausczik and James W Pennebaker. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology 29, 1 (2010), 24–54.
    [40]
    Mike Thelwall. 2017. TensiStrength: Stress and relaxation magnitude detection for social media texts. Information Processing & Management 53, 1 (2017), 106–121.
    [41]
    Elsbeth Turcan and Kathleen McKeown. 2019. Dreaddit: A Reddit Dataset for Stress Analysis in Social Media. EMNLP-IJCNLP 2019 (2019), 97.
    [42]
    Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE.Journal of machine learning research 9, 11 (2008).
    [43]
    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008.
    [44]
    Oriol Vinyals. 2017. “Model vs optimization meta learning. In NIPS 2017 Metalearning Symposium.
    [45]
    Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Daan Wierstra, 2016. Matching networks for one shot learning. Advances in neural information processing systems 29 (2016).
    [46]
    Xin Wang, Huijun Zhang, Lei Cao, and Ling Feng. 2020. Leverage Social Media for Personalized Stress Detection. In Proceedings of the 28th ACM International Conference on Multimedia. 2710–2718.
    [47]
    Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. 2020. Generalizing from a few examples: A survey on few-shot learning. ACM Computing Surveys (CSUR) 53, 3 (2020), 1–34.
    [48]
    Lilian Weng. 2018. Meta-Learning: Learning to Learn Fast. https://lilianweng.github.io/lil-log/2018/11/30/meta-learning.html.
    [49]
    Davis Wertheimer, Luming Tang, and Bharath Hariharan. 2021. Few-Shot Classification With Feature Map Reconstruction Networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8012–8021.
    [50]
    Wikipedia. 2021. Cosine similarity. https://en.wikipedia.org/wiki/Cosine_similarity.
    [51]
    Yuanyuan Xue, Qi Li, Ling Feng, Gari D Clifford, and David A Clifton. 2013. Towards a micro-blog platform for sensing and easing adolescent psychological pressures. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. 215–218.
    [52]
    Yuanyuan Xue, Qi Li, Li Jin, Ling Feng, David A Clifton, and Gari D Clifford. 2014. Detecting adolescent psychological pressures from micro-blog. In International Conference on Health Information Science. Springer, 83–94.
    [53]
    Huijun Zhang, Ling Feng, Ningyun Li, Zhanyu Jin, and Lei Cao. 2020. Video-Based Stress Detection through Deep Learning. Sensors 20, 19 (2020), 5552.
    [54]
    Liang Zhao, Qi Li, Yuanyuan Xue, Jia Jia, and Ling Feng. 2016. A systematic exploration of the micro-blog feature space for teens stress detection. Health information science and systems 4, 1 (2016), 1–12.

    Cited By

    View all
    • (2024)Towards Mental Health Analysis in Social Media for Low-resourced LanguagesACM Transactions on Asian and Low-Resource Language Information Processing10.1145/363876123:3(1-22)Online publication date: 9-Mar-2024
    • (2024)Unraveling minds in the digital era: a review on mapping mental health disorders through machine learning techniques using online social mediaSocial Network Analysis and Mining10.1007/s13278-024-01205-014:1Online publication date: 4-Apr-2024
    • (2024)Meta-Learning on Clinical Data for Diagnosis Support Systems: A Systematic ReviewResearch and Innovation Forum 202310.1007/978-3-031-44721-1_57(751-759)Online publication date: 1-Jan-2024
    • Show More Cited By

    Index Terms

    1. A Meta-learning based Stress Category Detection Framework on Social Media
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image ACM Conferences
            WWW '22: Proceedings of the ACM Web Conference 2022
            April 2022
            3764 pages
            ISBN:9781450390965
            DOI:10.1145/3485447
            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Sponsors

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            Published: 25 April 2022

            Permissions

            Request permissions for this article.

            Check for updates

            Author Tags

            1. meta-learning
            2. social media
            3. stress category detection

            Qualifiers

            • Research-article
            • Research
            • Refereed limited

            Funding Sources

            Conference

            WWW '22
            Sponsor:
            WWW '22: The ACM Web Conference 2022
            April 25 - 29, 2022
            Virtual Event, Lyon, France

            Acceptance Rates

            Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • Downloads (Last 12 months)307
            • Downloads (Last 6 weeks)19
            Reflects downloads up to 27 Jul 2024

            Other Metrics

            Citations

            Cited By

            View all
            • (2024)Towards Mental Health Analysis in Social Media for Low-resourced LanguagesACM Transactions on Asian and Low-Resource Language Information Processing10.1145/363876123:3(1-22)Online publication date: 9-Mar-2024
            • (2024)Unraveling minds in the digital era: a review on mapping mental health disorders through machine learning techniques using online social mediaSocial Network Analysis and Mining10.1007/s13278-024-01205-014:1Online publication date: 4-Apr-2024
            • (2024)Meta-Learning on Clinical Data for Diagnosis Support Systems: A Systematic ReviewResearch and Innovation Forum 202310.1007/978-3-031-44721-1_57(751-759)Online publication date: 1-Jan-2024
            • (2023)Mental Health Analysis in Social Media Posts: A SurveyArchives of Computational Methods in Engineering10.1007/s11831-022-09863-z30:3(1819-1842)Online publication date: 3-Jan-2023
            • (2022)Stress-Coping Tweets Acquisition: A Two-phase Bootstrapping Method on Patterns and Semantic Features2022 International Conference on Technologies and Applications of Artificial Intelligence (TAAI)10.1109/TAAI57707.2022.00029(113-118)Online publication date: Dec-2022
            • (2022)Experiencing Stress During COVID-19: A Computational Analysis of Stressors and Emotional Responses to StressCyberpsychology, Behavior, and Social Networking10.1089/cyber.2022.005225:9(561-570)Online publication date: 1-Sep-2022

            View Options

            View options

            PDF

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            HTML Format

            View this article in HTML Format.

            HTML Format

            Get Access

            Login options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media