The Application of Large Language Models in Vertical Domains: learning assistance

Dehou Lin; Ping Li

doi:10.54097/sk4p8931

Authors

Dehou Lin Wenzhou Polytechnic, Wenzhou 325006, China
Ping Li Wenzhou Polytechnic, Wenzhou 325006, China

DOI:

https://doi.org/10.54097/sk4p8931

Keywords:

Large Language Models, vertical domains, learning assistance AI.

Abstract

Although the performance of many large language models (LLMs) is excellent in the general field, with the popularity of LLMs, more and more people find that the performance of LLMs in vertical domains is not satisfactory. Therefore, this paper decided to study the application of LLM in a vertical domains and use LLM to assist volunteer learning. This research plan uses the general LLM in combination with learning methodology, the knowledge enhancement of Skills and Retrieval-augmented Generation (RAG) along with structured guidance of the teaching process, to build a learning assistance AI. This study recruited 10 volunteers to use learning assistance AI to learn new textbooks, and most of them reported that they had improved through the learning of this system, could quickly get started, and quickly gained a preliminary understanding of new knowledge. Therefore, this study concludes that learning assistance AI is effective.

Downloads

Download data is not yet available.

References

[1] Ye, J., Chen, X., Xu, N., et al. (2023). A comprehensive capability analysis of GPT-3 and GPT-3.5 series models. arXiv preprint arXiv:2303.10420. https://doi.org/10.48550/arXiv.2303.10420

[2] Chen, L., Zaharia, M., & Zou, J. (2023). Analyzing ChatGPT’s behavior shifts over time. arXiv preprint arXiv:2307.09009. https://doi.org/10.48550/arXiv.2307.09009

[3] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. https://doi.org/10.48550/arXiv.1706.03762

[4] Achiam, J., Adler, S., Agarwal, S., et al. (2023). GPT-4 technical report. arXiv preprint arXiv:2303.08774. https://doi.org/10.48550/arXiv.2303.08774

[5] Zeng, W., Ren, X., Su, T., et al. (2021). Pangu-α: Large-scale autoregressive pretrained Chinese language models with auto-parallel computation. arXiv preprint arXiv:2104.12369. https://doi.org/10.48550/arXiv.2104.12369

[6] Liu, J., Zhao, X., Shang, X., & Shen, Z. (2026). Dive into Claude code: the design space of today's and future ai agent systems. arXiv preprint arXiv:2604.14228. https://doi.org/10.48550/arXiv.2604.14228

[7] Yang, A., Li, A., Yang, B., et al. (2025). Qwen3 technical report. arXiv preprint arXiv:2505.09388. https://doi.org/10.48550/arXiv.2505.09388

[8] Lialin, V., Deshpande, V., Yao, X., & Rumshisky, A. (2023). Scaling down to scale up: a guide to parameter-efficient fine-tuning. arXiv preprint arXiv:2303.15647. https://doi.org/10.48550/arXiv.2303.15647

[9] Han, Z., Gao, C., Liu, J., Zhang, J., & Zhang, S. Q. (2024). Parameter-efficient fine-tuning for large models: a comprehensive survey. arXiv preprint arXiv:2403.14608. https://doi.org/10.48550/arXiv.2403.14608

[10] Kasneci, E., Seßler, K., Küchemann, S., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

[11] Dong, B., Bai, J., Xu, T., & Zhou, Y. (2024). Large language models in education: a systematic review. In 2024 IEEE International Conference on Artificial Intelligence and Education (pp. 131–134). IEEE.

[12] Tabarsi, B., Yasir, T., Reichert, H., et al. (2024). Herald of advancement, disruption, or both: a systematic literature review on student-facing llm tools in undergraduate computing education. Authorea Preprints. https://doi.org/10.22541/au.17123456.1

[13] Cibu, B., Crăciun, L., Molănescu, A. G., & Cotfas, L. (2025). Exploring the educational applications of large language models: a systematic review and topic analysis. Electronics, 14(23), 4683. https://doi.org/10.3390/electronics14234683

[14] Lee, U., Jeong, Y., Lee, C., et al. (2026). Llama-polya: instruction tuning for large language model based on polya's problem-solving. arXiv preprint arXiv:2602.10597. https://doi.org/10.48550/arXiv.2602.10597

[15] Sharma, M., Pea, R., & Subramonyam, H. (2026). Convolearn: a learning sciences grounded dataset for fine-tuning dialogic ai tutors.

[16] Li, Z., Wang, Z, Wang, W., Hung, K., Xie, H., & Wang, F. L. (2025). Retrieval-augmented generation for educational application: a systematic survey. Computers and Education: Artificial Intelligence, 8, 100417. https://doi.org/10.1016/j.caeai.2025.100417

[17] Yahaya, N., Ngah, W., Jailani, W. A., et al. (2025). Ai-powered learning content generation through retrieval-augmented generation for improved accuracy and personalisation. Jurnal Pendidikan Malaysia, 50(2), 45–62.

[18] David, J., & Ghosh, S. (2026). Intellicode: a multi-agent llm tutoring system with centralized learner modeling. In Proceedings of the 2026 International Conference on Educational Artificial Intelligence (pp. 129–138). IEEE.

[19] Liu, Y., Song, Z., Lou, J., Wu, C., & Li, J. (2025). Agenttutor: empowering personalized learning with multi-turn interactive teaching in intelligent education systems. arXiv preprint arXiv:2601.04219. https://doi.org/10.48550/arXiv.2601.04219

[20] Robinson, F. P. (1946). Effective study (Rev. ed.). Harper & Brothers.

[21] Memory, O. K. C. (n.d.). Memory: a contribution to experimental psychology.

[22] Lewis, P., Perez, E., Piktus, A., et al. (2020). Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 33, 9459–9474. https://doi.org/10.48550/arXiv.2005.11401