Abstract
Depression, a prevalent adult symptom, can arise from various sources, including mental health conditions and social interactions. With the rise of social media, adults often share their daily experiences, potentially revealing their emotional state on social platforms, like X (formerly Twitter) and Facebook. In this study, we present Ensemble (E) of Convolutional Neural Network (C), Attention-based Long Short-Term Memory (L) Network, and Support Vector Machine (S) (E-CLS), utilizing Term Frequency-Inverse Document Frequency (TF-IDF) vectors, Global Vectors for Word Representation (GloVe) and Bidirectional Encoder Representations from Transformers (BERT) word embeddings. This model effectively identifies depressive posts. Validated with a Twitter-derived depressive dataset, E-CLS achieves an impressive \(F_{1}\)-score of 0.91, surpassing existing machine-learning and deep-learning models by 2%. This research advances the detection of depression in social media posts, holding promise for enhanced mental health monitoring. Furthermore, our work contributes to the burgeoning field of mental health informatics by leveraging state-of-the-art techniques in natural language processing. The ensemble approach synergizes the strengths of Convolutional Neural Network (CNN) for local pattern recognition, Long Short-Term Memory (LSTM) Network for sequential context understanding, and Support Vector Machine (SVM) for robust classification. The incorporation of TF-IDF vectors and GloVe embeddings enriches feature representation, enhancing the model’s ability to discern nuanced linguistic cues associated with depression. By demonstrating superior performance over established models, E-CLS showcases its potential as a valuable tool in digital mental health interventions.
Similar content being viewed by others
Data Availability
The research data will be shared as requested.
References
Al Asad N, Pranto MAM, Afreen S, Islam MM (2019) Depression detection by analyzing social media posts of user. In: 2019 IEEE international conference on signal processing, information, communication & systems (SPICSCON) (pp. 13–17). IEEE
Almeida H, Briand A, Meurs MJ (2017) Detecting early risk of depression from social media user-generated content. In: CLEF (Working Notes) (pp. 1–12)
Arun V, Prajwal V, Krishna M, Arunkumar B, Padma S, Shyam V (2018) A boosted machine learning approach for detection of depression. In: 2018 IEEE symposium series on computational intelligence (SSCI) (pp. 41–47). IEEE
Bell V (2007) Online information, extreme communities and internet therapy: Is the internet good for our mental health? J Ment Health 16:445–457
Bodenheimer T, Chen E, Bennett HD (2009) Confronting the growing burden of chronic disease: can the us health care workforce do the job? Health Aff 28:64–74
Burdisso SG, Errecalde M, Montes-y Gómez M (2019) A text classification framework for simple and effective early depression detection over social media streams. Expert Syst Appl 133:182–197
Chang B, Choi Y, Jeon M, Lee J, Han K-M, Kim A, Ham B-J, Kang J (2019) Arpnet: Antidepressant response prediction network for major depressive disorder. Genes 10. https://www.mdpi.com/2073-4425/10/11/907
Chen X, Sykora MD, Jackson TW, Elayan S (2018). What about mood swings: Identifying depression on twitter with temporal measures of emotions. In: Companion proceedings of the web conference 2018 (pp. 1653–1660)
Cohn JF, Kruez TS, Matthews I, Yang Y, Nguyen MH, Padilla MT, Zhou F, De la Torre F (2009) Detecting depression from facial actions and vocal prosody. In: 2009 3rd international conference on affective computing and intelligent interaction and workshops (pp. 1–7). IEEE
Cong Q, Feng Z, Li F, Xiang Y, Rao G, Tao C (2018) Xa-bilstm: A deep learning approach for depression detection in imbalanced data. In: 2018 IEEE international conference on bioinformatics and biomedicine (BIBM) (pp. 1624–1627). IEEE
De Choudhury M, Counts S, Horvitz E (2013) Social media as a measurement tool of depression in populations. In: Proceedings of the 5th annual ACM web science conference (pp. 47–56)
Deshpande M, Rao V (2017) Depression detection using emotion artificial intelligence. In: 2017 International conference on intelligent sustainable systems (ICISS) (pp. 858–862). IEEE
Fatima I, Mukhtar H, Ahmad HF, Rajpoot K (2018) Analysis of user-generated content from online social communities to characterise and predict depression degree. J Inf Sci 44:683–695. https://doi.org/10.1177/0165551517740835
Geelan T (2021) Introduction to the special issue-the internet, social media and trade union revitalization: Still behind the digital curve or catching up? New Technol Work Employ 36:123–139
Glinow MAV, Shapiro DL, Brett JM (2004) Can we talk, and should we? managing emotional conflict in multicultural teams. Acad Manage Rev 29:578–592
Hasib KM, Islam MR, Sakib S, Akbar MA, Razzak I, Alam MS (2023) Depression detection from social networks data based on machine learning and deep learning techniques: An interrogative survey. IEEE Trans Comput Soc Syst
Hassan AU, Hussain J, Hussain M, Sadiq M, Lee S (2017) Sentiment analysis of social networking sites (sns) data using machine learning approach for the measurement of depression. In: 2017 International conference on information and communication technology convergence (ICTC) (pp. 138–140). IEEE
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780
Hossain MR, Hoque MM, Siddique N (2023) Leveraging the meta-embedding for text classification in a resource-constrained language. Eng Appl Artif Intell 124:106586
Hossain MR, Hoque MM, Siddique N (2023) Leveraging the meta-embedding for text classification in a resource-constrained language. Eng Appl Artif Intell 124:106586. https://doi.org/10.1016/j.engappai.2023.106586. https://www.sciencedirect.com/science/article/pii/S0952197623007704
Hossain MR, Hoque MM, Siddique N, Sarker IH (2023) Covtinet: Covid text identification network using attention-based positional embedding feature fusion. Neural Comput Appl 35:13503–13527
Hosseinifard B, Moradi MH, Rostami R (2013) Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from eeg signal. Comput Methods Programs Biomed 109:339–345
Islam MR, Kamal ARM, Sultana N, Islam R, Moni MA et al (2018) Detecting depression using k-nearest neighbors (knn) classification technique. In: 2018 International conference on computer, communication, chemical, material and electronic engineering (IC4ME2) (pp. 1–4). IEEE
Jain S, Narayan SP, Dewang RK, Bhartiya U, Meena N, Kumar V (2019) A machine learning based depression analysis and suicidal ideation detection system using questionnaires and twitter. In: 2019 IEEE students conference on engineering and systems (SCES) (pp. 1–6). IEEE
Khan MRH, Afroz US, Masum AKM, Abujar S, Hossain SA (2020) Sentiment analysis from bengali depression dataset using machine learning. In: 2020 11th international conference on computing, communication and networking technologies (ICCCNT) (pp. 1–5). IEEE
Kim J, Lee M (2014). Robust lane detection based on convolutional neural network and random sample consensus. In: International conference on neural information processing (pp. 454–461). Springer
Kour H, Gupta MK (2022) An hybrid deep learning approach for depression prediction from user tweets using feature-rich cnn and bi-directional lstm. Multimed Tools Appl 81:23649–23685
Kumar KS, Srivastava S, Paswan S, Dutta AS et al (2012) Depression-symptoms, causes, medications and therapies. Pharma Innov 1:37
Lam G, Dongyan H, Lin W (2019) Context-aware deep learning for multi-modal depression detection. In: ICASSP 2019-2019 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 3946–3950). IEEE
Leiva V, Freire A (2017) Towards suicide prevention: early detection of depression on social media. In: International conference on internet science (pp. 428–436). Springer
Li D, Chaudhary H, Zhang Z (2020) Modeling spatiotemporal pattern of depressive symptoms caused by covid-19 using social media data mining. Int J Environ Res Public Health 17. https://www.mdpi.com/1660-4601/17/14/4988
Lin C, Hu P, Su H, Li S, Mei J, Zhou J, Leung H (2020) Sensemood: Depression detection on social media. In: Proceedings of the 2020 international conference on multimedia retrieval (pp. 407–411)
Lin E, Kuo PH, Liu YL, Yu YWY, Yang AC, Tsai SJ (2018) A deep learning approach for predicting antidepressant response in major depression using clinical and genetic biomarkers. Front Psychiatry 9. https://doi.org/10.3389/fpsyt.2018.00290. https://www.frontiersin.org/articles/10.3389/fpsyt.2018.00290.
Mehltretter J, Fratila R, Benrimoh D, Kapelner A, Perlman K, Snook E, Israel S, Miresco M, Turecki G (2019) Differential treatment benefit prediction for treatment selection in depression: A deep learning analysis of star*d and co-med data. BioRxiv. https://doi.org/10.1101/679779
Mehltretter J, Rollins C, Benrimoh D, Fratila R, Perlman K, Israel S, Miresco M, Wakid M, Turecki G (2020) Analysis of features selected by a deep learning model for differential treatment selection in depression. Front Artif Intell 2. https://doi.org/10.3389/frai.2019.00031. https://www.frontiersin.org/articles/10.3389/frai.2019.00031
Mumtaz W, Qayyum A (2019) A deep learning framework for automatic diagnosis of unipolar depression. Int J Med Inform 132:103983
Nadeem M (2016) Identifying depression on twitter. arXiv:1607.07384
Naslund JA, Aschbrenner KA, Marsch LA, Bartels S (2016) The future of mental health care: peer-to-peer support and social media. Epidemiol Psychiatr Sci 25:113–122
Nguyen KP, Fatt CC, Treacher A, Mellema C, Trivedi MH, Montillo A (2019) Predicting response to the antidepressant bupropion using pretreatment fmri. In: Rekik I, Adeli E, Park SH (eds) Predictive Intelligence in Medicine. Springer International Publishing, Cham, pp 53–62
Oh J, Yun K, Maoz U, Kim T-S, Chae J-H (2019) Identifying depression in the national health and nutrition examination survey data using a deep learning algorithm. J Affect Disord 257:623–631
Orabi AH, Buddhitha P, Orabi MH, Inkpen D (2018) Deep learning for depression detection of twitter users. In: Proceedings of the fifth workshop on computational linguistics and clinical psychology: from keyboard to clinic (pp. 88–97)
Park SJ, Lim YS, Sams S, Nam SM, Park HW (2011) Networked politics on cyworld: The text and sentiment of korean political profiles. Soc Sci Comput Rev 29:288–299
Peng Z, Hu Q, Dang J (2019) Multi-kernel svm based depression recognition using social media data. Int J Mach Learn Cybern 10:43–57
Rosa RL, Schwartz GM, Ruggiero WV, Rodríguez DZ (2018) A knowledge-based recommendation system that includes sentiment analysis and deep learning. IEEE Trans Industr Inform 15:2124–2135
Sadeque F, Xu D, Bethard S (2018) Measuring the latency of depression detection in social media. In: Proceedings of the eleventh acm international conference on web search and data mining (pp. 495–503)
Sak H, Senior AW, Beaufays F (2014) Long short-term memory recurrent neural network architectures for large scale acoustic modeling. In: INTERSPEECH (pp. 338–342)
Shah FM, Ahmed F, Joy SKS, Ahmed S, Sadek S, Shil R, Kabir MH (2020) Early depression detection from social network using deep learning techniques. In: 2020 IEEE region 10 symposium (TENSYMP) (pp. 823–826). IEEE
Shatte AB, Hutchinson DM, Fuller-Tyszkiewicz M, Teague SJ (2020) Social media markers to identify fathers at risk of postpartum depression: A machine learning approach. Cyberpsychol Behav Soc Netw 23:611–618
Shetty NP, Muniyal B, Anand A, Kumar S, Prabhu S (2020) Predicting depression using deep learning and ensemble algorithms on raw twitter data. Int J Electr Comput Eng 10:3751
Stieglitz S, Dang-Xuan L (2013) Emotions and information diffusion in social media-sentiment of microblogs and sharing behavior. J Manag Inf Syst 29:217–248
Wang X, Chen S, Li T, Li W, Zhou Y, Zheng J, Chen Q, Yan J, Tang B (2020) Depression risk prediction for chinese microblogs via deep-learning methods: Content analysis. JMIR Med Inform 8:e17958
Wang Z, Ho S-B, Cambria E (2020) A review of emotion sensing: categorization models and algorithms. Multimed Tools Appl 79:35553–35582
Wongkoblap A, Vadillo MA, Curcin V et al (2021) Deep learning with anaphora resolution for the detection of tweeters with depression: Algorithm development and validation study. JMIR Ment Health 8:e19824
Wu MY, Shen C-Y, Wang ET, Chen AL (2020) A deep architecture for depression detection using posting, behavior, and living environment data. J Intell Inf Syst 54:225–244
Yang L, Jiang D, Xia X, Pei E, Oveneke MC, Sahli H (2017) Multimodal measurement of depression using deep learning models. In: Proceedings of the 7th annual workshop on audio/visual emotion challenge (pp. 53–59)
Zogan H, Wang X, Jameel S, Xu G (2020) Depression detection with multi-modalities using a hybrid deep learning model on social media. arXiv:2007.02847
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors do not have any conflict of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Tiwari, S.S., Pandey, R., Deepak, A. et al. An ensemble approach to detect depression from social media platform: E-CLS. Multimed Tools Appl 83, 71001–71033 (2024). https://doi.org/10.1007/s11042-023-17971-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17971-6