Letter2vec+Freq2vec: A Comprehensive Approach to Text Vectorization and Predicting Word Difficulty
DOI:
https://doi.org/10.54097/hset.v60i.10343Keywords:
Freq2vec Letter2vec, BERT, biKmeans, Natural Language Processing.Abstract
This paper introduces the self-developed word embedded algorithm Letter2vec+Freq2vec. It combines with biKmeans and Stacking algorithm to judge word difficulty in Wordle. The algorithm combines Letter2vec, which models letter interactions and context, and Freq2vec, which calculates letter frequencies at different positions of words to produce a more comprehensive text vectorization method. The results show that this algorithm can get better results than BERT algorithm in small sample size when vectorizing a single word. Overall, this paper provides insights into the development and application of new algorithms for text vectorization and the prediction of word difficulty.
Downloads
References
Peters, M. E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018). Deep contextualized word representations. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 2227-2237).
Baidu releases semantic understanding framework ERNIE 2.0 and pre-training model [J]. Smart City, 2019,5(14):26.
LU Jianyun, SHAO Junming, ZHANG Wei. Parameter-free DBSCAN algorithm based on RAPIDS[J]. Data acquisition and processing,2023,38(02): 426-438.
SHEN Qiuping, ZHANG Qinghua, GAO Man, DAI Yongyang. Three DBSCAN algorithms based on local radius[J/OL]. Computer Science:1-14[2023-04-30].
ZHANG Ximei, XIE Bin, XU Tongtong, ZHANG Chunhao. Weighted Kmeans Clustering Intrusion Detection Algorithm Based on Inverse K-Nearest Neighbor and Density Peak Initialization[J]. Journal of Nanjing University of Science and Technology,2023,47(01): 56-65.
CUI Peng, YANG Haifeng, CAI Jianghui, WANG Yupeng. Kmeans-DETR target detection method for multi-scale local clustering[J/OL]. Small microcomputer system:1-9[2023-04-30].
WANG Yi, HUANG Ruiting, LU Jingyi. Application of Kmeans++ Model in TV Program Classification and Analysis[J]. Radio and Television Technology,2022,49(11): 11-16.
XI Ningli, ZHU Lijia, WANG Lutong, CHEN Jun, WAN Xiaorong. An implementation method of Word vector model constructed by Word2vec[J]. Computer and Information Technology, 2023,31(01): 43-46.
ZHANG Yan, BAO Shengli, WANG Xiaofei. Stacking algorithm based on dynamic clustering and its application[J]. Computer application,2022,42(S2):100-104.
LUO Chunfang, ZHANG Guohua, LIU Dehua, ZHU Dinghuan. Research on XGBoost ensemble algorithm based on Kmeans clustering[J]. Computer age,2020(10): 12-14.
WANG Li, WANG Tao, XIAO Wei, PAN Chao. Feature selection algorithm based on Catboost[J]. Journal of Changchun University of Technology,2021,42(01): 34-39.
DAI Jinhui, ZHONG Xuan, *WANG Mengen. Used car valuation based on LightGBM and random forest algorithm[J]. Journal of Science and,2022,42(12):15-22.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
