A Deep Learning-based Depression Trend Analysis of Korean on Social Media

다국어 초록 (Multilingual Abstract)

The number of depressed patients in Korea and around the world is rapidly increasing every year. However, most of the mentally ill patients are not aware that they are suffering from the disease, so adequate treatment is not being performed. If depressive symptoms are neglected, it can lead to suicide, anxiety, and other psychological problems. Therefore, early detection and treatment of depression are very important in improving mental health. To improve this problem, this study presented a deep learning-based depression tendency model using Korean social media text. After collecting data from Naver KonwledgeiN, Naver Blog, Hidoc, and Twitter, DSM-5 major depressive disorder diagnosis criteria were used to classify and annotate classes according to the number of depressive symptoms. Afterwards, TF-IDF analysis and simultaneous word analysis were performed to examine the characteristics of each class of the corpus constructed. In addition, word embedding, dictionary-based sentiment analysis, and LDA topic modeling were performed to generate a depression tendency classification model using various text features. Through this, the embedded text, sentiment score, and topic number for each document were calculated and used as text features. As a result, it was confirmed that the highest accuracy rate of 83.28% was achieved when the depression tendency was classified based on the KorBERT algorithm by combining both the emotional score and the topic of the document with the embedded text. This study establishes a classification model for Korean depression trends with improved performance using various text features, and detects potential depressive patients early among Korean online community users, enabling rapid treatment and prevention, thereby enabling the mental health of Korean society. It is significant in that it can help in promotion.

참고문헌 (Reference)

1 "World Health Organization"

2 Petterson, J., "Word features for latent dirichlet allocation" NIPS 1921-1929, 2010

3 Chronis, G., "When is a bishop not like a rook? When it’s like a rabbi! Multi-prototype BERT embeddings for estimating semantic relationships" 227-244, 2020

4 Resnik, P., "Using topic modeling to improve prediction of neuroticism and depression in college students" 1348-1353, 2013

5 Zhang, L., "Using linguistic features to estimate suicide probability of Chinese microblog users" Springer 549-559, 2014

6 Danielle Mowery, "Understanding Depressive Symptoms and Psychosocial Stressors on Twitter: A Corpus-Based Study" JMIR Publications Inc. 19 (19): e48-, 2017

7 Schwartz, H. A., "Towards assessing changes in degree of depression through facebook" 118-125, 2014

8 Kitsuchart Pasupa, "Thai sentiment analysis with deep learning techniques: A comparative study based on word embedding, POS-tag, and sentic features" Elsevier BV 50 : 101615-, 2019

9 Liang, H., "Text feature extraction based on deep learning : a review" 2017 (2017): 1-12, 2017

10 Alessa, A., "Text classification of flu-related tweets using fasttext with sentiment and keyword features" 366-367, 2018

11 Shahzad Qaiser, "Text Mining: Use of TF-IDF to Examine the Relevance of Words to Documents" Foundation of Computer Science 181 (181): 25-29, 2018

12 Lilleberg, J., "Support vector machines and word2vec for text classification with semantic features" 136-140, 2015

13 Conway, M., "Social media, big data, and mental health : current advances and ethical implications" 9 : 77-82, 2016

14 Ching-Hsue Cheng, "Sentimental text mining based on an additional features method for text classification" Public Library of Science (PLoS) 14 (14): e0217591-, 2019

15 Lalithamani, N., "Sentence level sentiment polarity calculation for customer reviews by considering complex sentential structures" 3 (3): 433-438, 2014

16 Wang, Z. Y., "Research on the semantic-based co-word analysis" 90 (90): 855-875, 2012

17 Tsugawa, S., "Recognizing depression from twitter activity" 3187-3196, 2015

18 Lim, J. H., "Recent R&D trends for pretrained language model" 35 (35): 9-19, 2020

19 Nam, K. K., "Questions in, knowledge in? A study of Naver’s question answering community" 779-788, 2009

20 Coppersmith, G., "Quantifying mental health signals in Twitter" 51-60, 2014

21 Athiwaratkun, B., "Probabilistic fasttext for multi-sense word embeddings"

22 Yin, Z., "On the dimensionality of word embedding. arXiv preprint arXiv:1812.04224"

23 Zhao, J., "Learning gender-neutral word embeddings. arXiv preprint arXiv:1809.01496"

24 Blei, D. M., "Latent dirichlet allocation" 3 : 993-1022, 2003

25 Lee G., "Korean Ebedding" Acorn Publishing 2019

26 "KNU Korean Emotion Dictionary"

27 Pennington, J., "Glove: Global vectors for word representation" 1532-1543, 2014

28 Callon, M., "From translations to problematic networks : An introduction to co-word analysis" 22 (22): 191-235, 1983

29 Turney, P. D., "From frequency to meaning : Vector space models of semantics" 37 : 141-188, 2010

30 Vincent D Blondel, "Fast unfolding of communities in large networks" IOP Publishing 2008 (2008): P10008-, 2008

31 Ruas, T., "Enhanced word embeddings using multi-semantic representation through lexical chains" 532 : 16-32, 2020

32 Al Essa, A., "Efficient Text Classification with Linear Regression Using a Combination of Predictors for Flu Outbreak Detection" University of Bridgeport 2018

33 Trotzek, M., "Early detection of depression based on linguistic metadata augmented classifiers revisited" Springer 191-202, 2018

34 De Choudhury, M., "Discovering shifts to suicidal ideation from mental health content in social media" 2098-2110, 2016

35 Tadesse, M. M., "Detection of depression-related posts in reddit social media forum" 7 : 44883-44893, 2019

36 Guntuku, S. C., "Detecting depression and mental illness on social media : an integrative review" 18 : 43-49, 2017

37 Friedrich, M. J., "Depression is the leading cause of disability around the world" 317 (317): 1517-1517, 2017

38 Orabi, A. H., "Deep learning for depression detection of twitter users" 88-97, 2018

39 Kim Y., "Convolutional neural networks for sentence classification" 1746-1751, 2014

40 Louis Martin, "CamemBERT: a Tasty French Language Model" Association for Computational Linguistics 2020

41 Coppersmith, G., "CLPsych 2015 shared task: Depression and PTSD on Twitter" 31-39, 2015

42 Gang Liu, "Bidirectional LSTM with attention mechanism and convolutional layer for text classification" Elsevier BV 337 : 325-338, 2019

43 Resnik, P., "Beyond LDA: exploring supervised topic modeling for depression-related language in Twitter" 99-107, 2015

44 Devlin, J., "Bert: Pre-training of deep bidirectional transformers for language understanding"

45 Aizawa, A., "An information-theoretic perspective of tf–idf measures" 39 (39): 45-65, 2003

46 Yun-tao, Z., "An improved TF-IDF approach for text classification" 6 (6): 49-55, 2005

47 Eunyoung Moon, "A qualitative method to find influencers using similarity-based approach in the blogosphere" Inderscience Publishers 1 (1): 56-78, 2011