Comparison Of Neural Network and Traditional Classifiers for Twitter Sentiment Analysis

Authors

  • Haolan Guo

DOI:

https://doi.org/10.54097/hset.v38i.5996

Keywords:

Deep learning; machine learning; semantic analysis; neural network.

Abstract

Sentiment analysis has been a popular topic of study in the field of social media analysis, particularly when it comes to analyzing the emotions expressed in online comments. This is particularly relevant when it comes to IMDb Movie reviews, where users often express their opinions on the films they have watched. By using sentiment analysis techniques, researchers can gain insights into the overall sentiment of a movie and how it is perceived by the public. This information can be useful for movie studios and producers, as it can help them gauge the success of their films and make decisions about future productions. In this analysis, the performance of neural network models is compared with that of traditional classification methods when applied to the task of sentiment classification of tweets. A dataset of tweets collected from IMDb movie reviews is used for training. Three different models are trained on this dataset: a sequential neural network with two dense layers activated by ReLU and SoftMax functions, logistic regression, and random forest. The performance of these models is evaluated using a variety of metrics, including confusion matrices, AUC graphs, and accuracy and loss curves. It is found that the neural network model achieves an accuracy of approximately 90%, outperforming the logistic regression and random forest models, which achieve accuracies of approximately 90% and 83%, respectively.

Downloads

Download data is not yet available.

References

Feldman R. Techniques and applications for sentiment analysis. Communications of the ACM. 2013, 56(4):82-89.

Whitelaw C, Garg N, Argamon S. Using appraisal groups for sentiment analysis. In Proceedings of the 14th ACM international conference on Information and knowledge management 2005, 625-631.

Ortigosa A, Martín JM, Carro RM. Sentiment analysis in Facebook and its application to e-learning. Computers in human behavior. 2014, 31:527-41.

Jain AP, Dandannavar P. Application of machine learning techniques to sentiment analysis. In 2016 2nd International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT) 2016, 628-632.

Smailović J, Grčar M, Lavrač N, Žnidaršič M. Predictive sentiment analysis of tweets: A stock market application. InInternational workshop on human-computer interaction and knowledge discovery in complex, unstructured, big data 2013, 77-88.

Yenter A, Verma A. Deep CNN-LSTM with combined kernels from multiple branches for IMDb review sentiment analysis. In2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON) 2017, 540-546.

García-Cumbreras MÁ, Montejo-Ráez A, Díaz-Galiano MC. Pessimists and optimists: Improving collaborative filtering through sentiment analysis. Expert Systems with Applications. 2013, 40(17):6758-65.

Kumar HM, Harish BS, Darshan HK. Sentiment Analysis on IMDb Movie Reviews Using Hybrid Feature Extraction Method. International Journal of Interactive Multimedia & Artificial Intelligence. 2019, 5(5):109-114.

Hudlicka E. To feel or not to feel: The role of affect in human–computer interaction. International journal of human-computer studies. 2003, 59(1-2):1-32.

Lakshmipathi. IMDB Dataset of 50K Movie Reviews. 2018. URL: https://www.kaggle.com/lakshmi25npathi/imdb-dataset-of-50k-movie-reviews

Downloads

Published

16-03-2023