Cyber Violence Text Classification Model Based on Graph Convolutional Networks and Syntactic Parsing

Authors

  • Binting Qi
  • Hanming Zhai
  • Yunyang Bu
  • Zhuxuan Han
  • Fanliang Bu

DOI:

https://doi.org/10.54097/xq0zek31

Keywords:

Graph Convolutional Network, Cyber Violence, Text Classification, BERT, Syntactic Parsing

Abstract

There are problems such as semantic sparsity and incomplete context in cyber violence texts in social media, and the current research on the refinement and classification of cyber violence texts is insufficient. This paper constructs a text classification model based on graph neural networks to improve the fine-grained classification effect of multi category cyber violence texts in social media. Introducing dependency relationships into BERT through syntactic analysis for deep semantic representation learning enhances the model's contextual understanding ability and better captures fine-grained features in sentences. Build a graph structure containing two different node types, words and documents, to propagate semantic information through GCN and strengthen the relationships between nodes. By combining large-scale pre-trained models with GCN, complementary advantages can be achieved to improve the overall performance of the model. The experimental results show that the method achieves a classification accuracy of 84.77% on publicly available cyber violence text datasets, which is 2.36% higher than the baseline model. It can effectively and accurately identify multiple types of cyber violence texts.

Downloads

Download data is not yet available.

References

[1] Drucker H, Wu D, Vapnik V N. Support vector machines for spam categorization[J]. IEEE Transactions on Neural networks, 1999, 10(5): 1048-1054.

[2] McCallum A, Nigam K. A comparison of event models for naive bayes text classification[C]//AAAI-98 workshop on learning for text categorization. 1998, 752(1): 41-48.

[3] Cover T, Hart P. Nearest neighbor pattern classification[J]. IEEE transactions on information theory, 1967, 13(1): 21-27.

[4] Kotsiantis S B. Decision trees: a recent overview[J]. Artificial Intelligence Review, 2013, 39: 261-283.

[5] Kim Y. Convolutional Neural Networks for Sentence Classification[C]//Proceedings of Conference on Empirical Methods in Natural Language Processing, 2014.

[6] Tang D, Qin B, Liu T. Document modeling with gated recurrent neural network for sentiment classification[C]// Proceedings of the 2015 conference on empirical methods in natural language processing. 2015: 1422-1432.

[7] Vaswani A. Attention is all you need[J]. Advances in Neural Information Processing Systems, 2017.

[8] Devlin J. Bert: Pre-training of deep bidirectional transformers for language understanding[J]. arxiv preprint arxiv: 1810. 04805, 2018.

[9] Wu Z, Pan S, Chen F, et al. A comprehensive survey on graph neural networks[J]. IEEE transactions on neural networks and learning systems, 2020, 32(1): 4-24.

[10] Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks[J]. arxiv preprint arxiv: 1609. 02907, 2016.

[11] Yao L, Mao C, Luo Y. Graph convolutional networks for text classification[C]//Proceedings of the AAAI conference on artificial intelligence. 2019, 33(01): 7370-7377.

[12] Velickovic P, Cucurull G, Casanova A, et al. Graph attention networks [J]. stat, 2017, 1050(20): 10-48550.

[13] Linmei H, Yang T, Shi C, et al. Heterogeneous graph attention networks for semi-supervised short text classification[C]// Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). 2019: 4821-4830.

[14] Lin Y, Meng Y, Sun X, et al. Bertgcn: Transductive text classification by combining gcn and bert[J]. arxiv preprint arxiv: 2105.05727, 2021.

[15] Dinakar K, Reichart R, Lieberman H. Modeling the detection of textual cyberbullying[C] //Proceedings of the International AAAI Conference on Web and Social Media. 2011, 5(3): 11-17.

[16] Chavan V S, Shylaja S S. Machine learning approach for detection of cyber-aggressive comments by peers on social media network[C]//2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI). IEEE, 2015: 2354-2358.

[17] Squicciarini A, Rajtmajer S, Liu Y, et al. Identification and characterization of cyberbullying dynamics in an online social network [C]//Proceedings of the 2015 IEEE/ACM international conference on advances in social networks analysis and mining 2015. 2015: 280-285.

[18] Agrawal S, Awekar A. Deep learning for detecting cyberbullying across multiple social media platforms[C] // European conference on information retrieval. Cham: Springer International Publishing, 2018: 141-153.

[19] Daraghmi E Y, Qadan S, Daraghmi Y, et al. From Text to Insight: An Integrated CNN-BiLSTM-GRU Model for Arabic Cyberbullying Detection[J]. IEEE Access, 2024.

[20] Huang R. Implementation of a Network Violent Language Detection System[D]. WuHan: School of information and communication engineering, Huazhong University of Science and Technology,2016.

[21] Qiang L. Research on Cyberbullying Language Based on Social Networks[D]. TaiYuan: North University of China,2020

[22] Wang R, Zhang P, Gu N, et al. Intelligent Intervention Methods for Cyberbullying in Online Communities: Landscapes, Challenges and Prospects[J]. Journal of Chinese Computer Systems,2024,45(10):2312-2326.

[23] Wang J, Fu K, Lu C T. Sosnet: A graph convolutional network approach to fine-grained cyberbullying detection[C] //2020 IEEE International Conference on Big Data (Big Data). IEEE, 2020: 1699-1708.

Downloads

Published

21-01-2025

Issue

Section

Articles

How to Cite

Qi, B., Zhai, H., Bu, Y., Han, Z., & Bu, F. (2025). Cyber Violence Text Classification Model Based on Graph Convolutional Networks and Syntactic Parsing. Frontiers in Computing and Intelligent Systems, 11(1), 29-34. https://doi.org/10.54097/xq0zek31