Text Sentiment Classification Method Based on Bilstm

Wenliang Wang

doi:10.54097/hbem.v21i.14737

Authors

Wenliang Wang

DOI:

https://doi.org/10.54097/hbem.v21i.14737

Keywords:

Text sentiment analysis; Bi-directional Long Short-Term Memory; Word2Vec.

Abstract

In the booming age of digital communication and natural language processing(NLP), understanding user sentiments expressed in texts has become increasingly vital. This research addresses the challenge of classifying text sentiments into three distinct categories: positive, neutral, and negative. Recognizing the nuances of human emotion in textual content is paramount for enhancing user experiences and tailoring personalized digital interactions. This study trains a BiLSTM model, supplemented with optimization strategies to adaptively learn from a diverse dataset. Additionally, a large number of baseline experiments were conducted to compare its efficacy with traditional algorithms such as Logistic Regression. The BiLSTM model demonstrated a good accuracy of 78.21% on the test set. Conclusively, while the proposed model shows significant potential, further refinements could be made, emphasizing data augmentation and model regularization to achieve optimal performance.

Downloads

Download data is not yet available.

References

Ma C.L., Osherenko A., Prendinger H., et al. A chat system based on emotion estimation from text and embodied conversational messengers. In Proc of the 4th Int Conf on Active Media Technology, 2005: 546-548. Piscataway, NJ: IEEE.

Aman S., Szpakowicz S. Identifying expressions of emotion in text. Proc of the 10th Int Conf on Text, Speech and Dialogue. Berlin: Springer, 2007: 196-205.

Hogenboom A., Heerschop B., Frasincar F., et al. Multi-lingual support for lexicon-based sentiment analysis guided by semantics. Decision Support Systems, 2014, 62(1): 43-53.

Pang B., Lee L., & Vaithyanathan S. Proceedings of Empirical Methods in Natural Language Processing (EMNLP2010), 2002: 79-86.

Tang D., Wei F., Qin B., et al. Cooooll: A deep learning system for Twitter sentiment classification. In Proc of the 8th int Workshop on Semantic Evaluation, 2014: 208-212. Stroudsburg, PA: ACL.

Ouyang Chunping, Yang Xiaohua, Lei Longyan, et al. Multi-strategy Approach for Fine-Grained Sentiment Analysis of Chinese Microblog. Acta Scientiarum Naturalium Universitatis Pekinensis, 2014, 50(01): 67-72.

Teng Z., Vo D.T., & Zhang Y. Context-Sensitive Lexicon Features for Neural Sentiment Analysis. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016: 1629-1638.

Wang Liya, Liu Changhui, Cai Chunbo, et al. Chinese text sentiment analysis based on character-level two-channel composite network. Application Research of Computers, 2020, 37(09): 1-6.

Mikolov T., Sutskever I., Chen K., et al. Distributed Representations of Words and Phrases and their Compositionality. In NIPS’13 Proceedings of the 26th International Conference on Neural Information Processing Systems, 2013: 3111-3119.

Hinton G. E., McClelland J. L., & Rumelhart D. E. Distributed representations. In Parallel distributed processing: explorations in the microstructure of cognition, 1986, Vol. 1: 77-109. MIT Press.

Cortes C., & Vapnik V. Support-vector networks. Machine Learning, 1995, 20(3): 273-297.