Deep Learning-Driven Text Sentiment Analysis: Research Progress, Challenges, and Future Trends in the Past Five Years
DOI:
https://doi.org/10.54097/9y4deh13Keywords:
Text Sentiment Analysis, Deep Learning, Domain Adaptation, Multimodal FusionAbstract
Text sentiment analysis has developed from a single text classification task into a complex multimodal fusion system that can achieve cross-scenario sentiment understanding with the help of deep learning technology. In this article, we will review the cutting-edge studies from 2020 to 2025 on domain adaptation, low-resource learning, complex semantic modeling, multimodal fusion, and ethical fairness based on review papers in leading journals (e. g., IEEE TPAMI, Nature) and at top conferences (e. g., ACL, NeurIPS). It has been found that the combination of domain knowledge graphs reduces the performance drop caused by cross-domains by 60%, causal reasoning increases the accuracy of mixed sentiment disentanglement by 12.4%, and multimodal dynamic alignment improves precision by 8% in conflicting scenarios. This article shows that technological development has a transversal and fused trend of "knowledge promotion-causal modelling-modal collaboration" and lightweight mechanism as well as fair mechanism are important in practical engineering implementation.
Downloads
References
[1] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Minneapolis, MN, USA. pp. 4171-4186.
[2] Sheoran, A., Joshi, A., & Bhattacharyya, P. (2020). Domain Adaptation for Sentiment Analysis: A Survey. Journal of Machine Learning Research, 21(123), 1–50.
[3] Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., ... & Liang, P. (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258.
[4] Poria, S., Cambria, E., Hazarika, D., & Majumder, N. (2020). Multimodal sentiment analysis: A survey and taxonomic study. ACM Computing Surveys (CSUR), 53(12), 1–38.
[5] Pei, J., Men, A., Liu, Y., Zhuang, X., & Chen, Q. (2024). Evidential multi-source-free unsupervised domain adaptation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(8), 5288-5305.
[6] Zhou, C., Li, B., Fei, H., Li, F., Teng, C., & Ji, D. (2024). Revisiting structured sentiment analysis as latent dependency graph parsing. arXiv preprint arXiv:2407.04801.
[7] Lin, Z., Liu, Z., Xia, Z., Wang, X., Wang, Y., Qi, S., ... & Zhu, C. (2024). Rcbevdet: Radar-camera fusion in bird's eye view for 3D object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA. pp. 14928-14937.
[8] Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., ... & Lempitsky, V. (2016). Domain-adversarial training of neural networks. Journal of machine learning research, 17(59), 1-35.
[9] Chalkidis, I., Androutsopoulos, I., & Aletras, N. (2019). Legal named entity recognition with deep neural networks. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL). Florence, Italy. pp. 6318–6324.
[10] Chen, Z., Wang, L. X., Wu, Y. B., Liao, X., Tian, Y., & Zhong, J. (2024). An effective deployment of diffusion LM for data augmentation in low-resource sentiment classification (Paper presentation). Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Miami, FL, United States. pp. 1-14.
[11] Li, B., Zhou, C., Chen, X., & Wang, Y. (2021). Meta-learning for few-shot cross-domain sentiment analysis. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP). Punta Cana, Dominican Republic.
[12] Kusner, M. J., Loftus, J., Russell, C., & Silva, R. (2017). Counterfactual fairness. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS). Long Beach, CA, USA. pp. 4066–4076.
[13] Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016). Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT). San Diego, CA, USA. pp. 1480–1489.
[14] Strizhkova, V., Kachmar, H., Chaptoukaev, H., Kalandadze, R., Kukhilava, N., Tsmindashvili, T., ... & Ferrari, L. M. (2024). Mvp: Multimodal emotion recognition based on video and physiological signals. In European Conference on Computer Vision. Cham: Springer Nature, Switzerland. pp. 101-116.
[15] Zhu, X., Liu, Y., Zhang, L., & Wu, F. (2022). Lightweight multimodal sentiment analysis via knowledge distillation. IEEE Transactions on Affective Computing, 14(3), 1158-1171.
[16] Wang, H., Zhang, Y., Li, J., & Song, D. (2021). Causal structure learning for aspect-based sentiment analysis. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics (ACL). Bangkok, Thailand.
[17] Ungless, E. L., Ross, B., & Belle, V. (2023). Queerphobic bias in sentiment analysis. Social Science Computer Review, 41(6), 1234–1250.
[18] Chakraborty, S., Qiu, J., Yuan, H., Koppel, A., Huang, F., Manocha, D., ... & Wang, M. (2024). MaxMin-RLHF: Alignment with diverse human preferences. arXiv preprint arXiv:2402.08925.
[19] Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2020). Federated learning for privacy-preserving sentiment analysis. IEEE Transactions on Knowledge and Data Engineering, 33(12), 4850-4863.
[20] Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019). Albert: A lite bert for self-supervised learning of language representations. arXiv preprint arXiv: 1909. 11942.
[21] Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., ... & Lempitsky, V. (2016). Domain-adversarial neural networks. Journal of Machine Learning Research, 17(1), 2096-2030.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Frontiers in Computing and Intelligent Systems
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
