Weibo New Word Recognition Based on the Fusion of Word Frequency Features and Adjacent Changes
DOI:
https://doi.org/10.54097/ajst.v7i3.13404Keywords:
Weibo new word recognition; Word frequency characteristics; Number of adjacency changes; language change.Abstract
Weibo as an informal communication and information dissemination tool, has constantly emerged with a large number of new words. Identifying new words in Weibo is of great significance for in-depth understanding and research on social hotspots and language changes. This article proposes a method for integrating word frequency features and adjacency changes to recognize new words in Weibo text. The experimental results show that this method has achieved good results in Weibo new word recognition tasks.
Downloads
References
Su Ning. Based on word features and search engine for Chinese new word identification [J], Journal of Wuhan University, 2010, volume fifty-sixth, issue sixth, 704-710.
Li Chengcheng,Xu Yuanfang, Based on support vector and word features new word discovery research, proceedings of 2012 IEEE International Conference on Computer Science and Automation Engineering ,2012,166-168.
Feng Yong, Li Hua. Based on Adaptive Chinese word segmentation and approximation of SVM text classification algorithm [J], computer science, volume thirty-seventh, 2010, first, 251-254, 293.
Huang Xiuli, Wang Yu.SVM in unbalanced data set [J], computer technology and development, 2009, volume nineteenth, issue sixth, 190-193.
Jian-Yun Nie, Unknown Word Detection and Segmentation of Chinese using Statistical and heuristic Knowledge. Communications of COLIPS,2008,5(I&2),47-57.
Han Xiulong. Research on Weibo New Word Discovery Based on SVM and Feature Correlation [J], Computer Knowledge and Technology, 2018,14,66-69.
Qian Qiuyin, Zhang Zhenglan. A method based on multiple SVM classification method of relevance feedback image retrieval [J], computer technology and development, 2009, volume nineteenth, issue eighth, 66-69.
Fu Lina, Xiao He, Ji Donghong. New Emotional Word Recognition Based on OC-SVM [J], Computer Application Research, 2015,71946-1048.
