Chinese text sentiment classification method based on dual-channel attention capsule network

Authors

  • Chunjia Liu
  • Xinyu Zhang
  • Juan Li
  • Jingwen Chen
  • Chang Li

DOI:

https://doi.org/10.54097/zkby0v57

Keywords:

convolutional neural network; deep learning; word vector; capsule network; sentiment analysis.

Abstract

In recent years, text sentiment analysis has received close attention from researchers. The CNN-based neural network is frequently used in this field. Capsule network can overcome the problem of information loss caused by pooling layer in CNN-based neural network, but the capsule network cannot selectively focus on important words in the text. To solve this problem, this paper proposes a text sentiment analysis method based on the attention mechanism of the capsule network. First, use the cw2vec model and the SAT model to train word vectors and use them as the input of the two channels of the method, then combine the attention mechanism and the convolutional neural network to extract the characteristics of the two channels, and then input the capsule network to realize the emotion classification. The static routing mechanism is also used to reduce the complexity of the model, and it has a higher accuracy than the dynamic routing mechanism. We verified the effectiveness of the model on the Tan Songbo hotel review data set and we further crawls a large amount of public opinion data related to Meteorology and early warning from Weibo to form different fields. the model is also better than many sentiment analysis methods.

Downloads

Download data is not yet available.

References

Cao, S., Lu, W., Zhou, J., & Li, X cw2vec: Learning chinese word embeddings with stroke n-gram information. In Thirty-Second AAAI Conference on Artificial Intelligence. 2018.

Niu, Y., Xie, R., Liu, Z., & Sun, M Improved word representation learning with sememes. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2017, Vol. 1, pp 2049-58.

Sabour S, Frosst N, Hinton G E. Dynamic routing between capsules[C]//Advances in neural information processing systems. 2017: 3856-3866.

YANG M , ZHAO W , YEJB , etal.Investigating capsule networks with dynamic routing for text classification [C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Brussels , Belgium: ACL ,2018 : 3110 3119.

Yujia Wu, Jing Li, Jia Wu, Jun Chang, Siamese capsule networks with global and local features for text classification, Neurocomputing,2020

Jaeyoung Kim, Sion Jang, Eunjeong Park, Sungchul Choi,Text classification using capsules, Neurocomputing, Volume 376, 2020, Pages 214-221

GUO Bao-zhen,ZUO Wan-li,WANG Ying. Double CNN sentence classification model with attention mechanism of word embeddings [J]. Journal of Zhejiang University (Engineering Science),2018,52 (09): 1729-1737.

Downloads

Published

30-06-2024

How to Cite

Liu, C., Zhang, X., Li, J., Chen, J., & Li, C. (2024). Chinese text sentiment classification method based on dual-channel attention capsule network. Highlights in Science, Engineering and Technology, 105, 56-61. https://doi.org/10.54097/zkby0v57