Recommendation Approach Based on TwinBERT Model

Authors

  • Zheng Luo

DOI:

https://doi.org/10.54097/vt045216

Keywords:

TwinBERT model, recommendation services, dataset, user comments, text information.

Abstract

In order to provide more personalized recommendation services for users as well as improve the platform's traffic and user satisfaction, a recommendation method based on the TwinBERT model has been proposed. As a matter of fact, this method combines not only the basic information of users and items but also user comments or item text information to predict users' behaviors and make more accurate recommendations. The text information in the dataset is encoded in sentences using the BERT model, and the encoded text features are fused with other features to obtain a representation of user and item embedding vectors. These vectors are then used to predict the user's rating of the item and recommend relevant items for the user. The proposed method was tested on the Amazon review dataset and the MovieLens dataset, and the experimental results showed that it improved over traditional recommendation algorithms in terms of accuracy and efficiency.

Downloads

Download data is not yet available.

References

H. Li, J. Yao and C. Chen, arXiv preprint arXiv:1205. 6700 (2012).

Q. Feng, and R. Cai, Journal of World Architecture, 5 (6), 52 - 61 (2021).

G. Adomavicius and A. Tuzhilin, IEEE transactions on knowledge data engineering, 17 (6), 734 - 749 (2005).

A. Xu and M. Raginsky, Advances in neural information processing systems, 30 (2017).

C. F. G. D. Santos and J. P. Papa, ACM Computing Surveys (CSUR), 54 (10s), 1 - 25 (2022).

J. Gao, G. Tian, A. Sorniotti, A. E. Karci and R. di Palo, Applied Thermal Engineering, 147, 177 - 187 (2019).

Y. Koren, ACM Transactions on Knowledge Discovery from Data, 4 (1), 1 - 24 (2010).

8. Ben-Shimon, D., Rokach, L., & Shapira, B. (2016). An ensemble method for top-N recommendations from the SVD. Expert Systems with Applications, 64, 84 - 92.

T. Liu, and D. Tao, IEEE Transactions on Neural Networks Learning Systems, 27 (9), 1851 - 1863 (2015).

X. Ren, M. Song, E. Haihong, and J. Song, Neurocomputing, 241, 38 - 55 (2017).

P. Huang, X. He, J. Gao, L. Deng, A. Acero and L. Heck, Proceedings of the 22nd ACM international conference on Information & Knowledge Management (2013).

H. Guo, R. Tang, Y. Ye, et al., arXiv preprint arXiv. 04247 (2017).

S. Rendle, 2010 IEEE International conference on data mining (2010).

E. Martínez-Morillo, C. Childs, B. P. García, et al., Neurofilament medium polypeptide (NFM) protein concentration is increased in CSF and serum samples from patients with brain injury. Clinical Chemistry Laboratory Medicine, 53 (10), 1575 - 1584 (2015).

W. Lu, J. Jiao and R. Zhang, Proceedings of the 29th ACM International Conference on Information & Knowledge Management (2020).

B. Batou, Steel Composite Structures, An International Journal, 33 (5), 699 - 716 (2019).

B. P. Staresina and M. Wimber, Trends in cognitive sciences, 23 (12), 1071 - 1085 (2019).

R. He and J. McAuley, Proceedings of the 25th international conference on world wide web (2016).

F. M. Harper and J. A. Konstan, ACM transactions on interactive intelligent systems, 5 (4), 1 - 19 (2015).

H. P. Luhn, IBM Journal of research and development, 1 (4), 309 - 317 (1957).

S. Abnar and W. Zuidema, arXiv preprint arXiv. 00928 (2020).

V. Nair and G. E. Hinton, Proceedings of the 27th international conference on machine learning (ICML-10) (2010).

C. Cortes, M. Mohri, and A. Rostamizadeh, arXiv preprint arXiv:1205.2653. (2012).

D. M. Allen, Technometrics, 1 3(3), 469 - 475 (1971).

G. Li, W. Chang, and H. Yang, IEEE Access, 8, 141432 - 141445 (2020).

T. Chai, and R. R. Draxler, Geoscientific model development, 7 (3), 1247 - 1250 (2014).

T. Thongtan and T. Phienthrakul, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (2019).

P. Z. Salam and S. Najafi, DIVA, 17 (2016).

NicolasHug. Surprise-recommender-systems (2017).

W. Chen, Z. Huang, J. C. N. Liang and Z. Xu, Open Review, 11 (2023).

B. Şeref, G. E. Bostanci and M. S. Güzel, Turkish Journal of Electrical Engineering and Computer Sciences, 29 (1), 62 - 77 (2021).

F. Dai, X. Gu, Z. Wang, et al., Paper presented at the Proceedings of the 2021 International Conference on Multimedia Retrieval (2021).

J. Xiao, H. Ye, X. He, H. Zhang, F. Wu and T. S. Chua, Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv: 1708. 04617 (2017).

A. Aggarwal, M. Mittal and G. Battineni, International Journal of Information Management Data Insights, 1 (1), 100004 (2021).

L. Girin, S. Leglaive, X. Bie, J. Diard, T. Hueber and X. Alameda-Pineda, arXiv preprint arXiv: 12595 (2020).

X. Wu, Y. Lao L. Jiang, et al., arXiv preprint arXiv: 2210.05666. (2022).

Downloads

Published

13-03-2024

How to Cite

Luo, Z. (2024). Recommendation Approach Based on TwinBERT Model. Highlights in Science, Engineering and Technology, 85, 757-768. https://doi.org/10.54097/vt045216