A Study on Social Media Depression Detection Methods Based on Multi-Level User Representation Learning
DOI:
https://doi.org/10.54097/28m97662Keywords:
Depression Detection, Social Media, Multi-Level User Representation Learning, Graph Neural Networks, Contrastive LearningAbstract
Social-media posts record not only what users say but also when and how they participate. These two sources of evidence can support computational screening for depression-related patterns, although the task is complicated by indirect language, overlapping class boundaries, and incomplete behavioral records. This study examines whether combining information at several levels produces more informative user representations than relying on isolated posts. The proposed workflow begins with BERT-based encoding of post content. Random downsampling is used in the pre-trained-model experiments to reduce the imbalance between the two labels. Posting frequency, activity-time distribution, and historical-post volume are then mapped into the same feature space as the text representation. Post-level vectors are aggregated for each user, and a graph neural network is applied to a similarity graph so that the final representation also reflects relationships among users. A supervised contrastive objective is included to encourage compact within-class representations and clearer separation between classes. Across the reported test results, user-level models were markedly stronger than tweet-level baselines. The user-level BERT + GNN configuration obtained an accuracy of 0.9404, an F1-score of 0.9399, and an AUC of 0.9703. These results suggest that historical context and relational structure are useful for this classification setting; they should not, however, be interpreted as a substitute for clinical assessment.
Downloads
References
[1] Shen, G., Jia, J., Nie, L., et al. (2017). Depression detection via harvesting social media: A multimodal dictionary learning solution. Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).
[2] Orabi, A. H., Buddhitha, P., Orabi, M. H., et al. (2018). Deep learning for depression detection of Twitter users.Proceedings of the ACL Workshop.
[3] Zogan, H., Razzak, I., Wang, X., et al. (2021). Explainable depression detection with multi-aspect features using social media data. IEEE Access, 9, 102154–102166.
[4] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 4171–4186.
[5] Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., et al. (2019). RoBERTa: A robustly optimized BERT pretraining approach [Preprint]. arXiv. https://arxiv.org/abs/1907.11692
[6] Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. Proceedings of the 37th International Conference on Machine Learning (ICML), 1597–1607.
[7] Hamilton, W. L., Ying, R., & Leskovec, J. (2017). Inductive representation learning on large graphs. Advances in Neural Information Processing Systems (NeurIPS), 30, 1024–1034.
[8] Sawhney, R., Manchanda, P., Mathur, P., et al. (2018). Exploring and learning suicidal ideation connotations on social media with deep learning. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 168–175.
[9] Yang, C., Chen, H., Li, Z., et al. (2023). A survey on depression detection via social media: Recent advances and challenges. IEEE Transactions on Affective Computing, 14(4), 2745–2764.
[10] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., et al. (2017). Attention is all you need. Advances in Neural Information Processing Systems (NeurIPS), 30, 5998–6008.
[11] Kipf, T. N., & Welling, M. (2017). Semi-supervised classification with graph convolutional networks [Preprint]. arXiv. https://arxiv.org/abs/1609.02907
[12] Gao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple contrastive learning of sentence embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6387–6397.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Frontiers in Computing and Intelligent Systems
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
