Research on Sentiment Analysis of Micro-blog based on Attention-BiLSTM

Fangxu Yan; Jianhui Wang

doi:10.54097/dzdmrr39

Authors

Fangxu Yan
Jianhui Wang

DOI:

https://doi.org/10.54097/dzdmrr39

Keywords:

Sentiment Analysis, BiLSTM, Attention Mechanism

Abstract

The rapid development of the Internet gives birth to massive data. These data have the characteristics of multiple types, low density, and fast transmission speed. As one of the products of the era of big data, micro-blog provides users with a highly interactive platform. In order to explore the value and sentiment contained in micro-blog comment texts, and solve the problem of semantic loss and over-reliance on manual work in traditional text sentiment analysis, this paper proposes a deep learning model based on Attention-BiLSTM. In the embedding layer, the CBOW method of Word2vec is used to transform the text data into word vectors, and the attention mechanism is integrated to dynamically weight the input word vectors. Secondly, BiLSTM is used to extract text features, then fuse them in concat layer. After that the classification is realized by Softmax whose results of the output text are positive or negative. Finally, by comparing with TextCNN, LSTM and BiLSTM, the result shows that the Attention-BiLSTM model does have better classification effect, strong generalization and practicability.

Downloads

Download data is not yet available.

References

Xiong W, Zuo Y, Zhang M, et al. Research on Sentiment Analysis of E-commerce Live Comments based on Text Mining[J]. Frontiers in Computing and Intelligent Systems, 2023, 6(3): 34-36.

Miao Q, Li Q, Dai R. AMAZING: A sentiment mining and retrieval system[J]. Expert Systems with Applications, 2009, 36(3): 7192-7198.

Narayanan R, Liu B, Choudhary A. Sentiment analysis of conditional sentences[C]//Proceedings of the 2009 conference on empirical methods in natural language processing. 2009: 180-189.

Bo Pang, Lillian Lee, Shivakumar Vaithyanathan. Thumbs up? sentiment classification using machine learning techniques [C]// Proceedings of the ACL-02 conference on Empirical methods in natural language processing. 2002: 79–86.

Whitelaw C, Garg N, Argamon S. Using appraisal groups for sentiment analysis[C]//Proceedings of the 14th ACM international conference on Information and knowledge management. 2005: 625-631.

Elman J L. Finding structure in time[J]. Cognitive science, 1990, 14(2): 179-211.

Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need [J]. Advances in neural information processing systems, 2017, 30.

Zhang J, Zhang X, Liu Z, et al. A Network Intrusion Detection Model Based on BiLSTM with Multi-Head Attention Mechanism[J]. Electronics, 2023, 12(19): 4170.

Zhang B. COVID-19 forecast and bank credit decision model based on BiLSTM-attention network[J]. International Journal of Computational Intelligence Systems, 2023, 16(1): 159.