Research on the Construction of Medical Critical Thinking Assessment Gauge Driven by Generative AI

Authors

  • Liang Ying
  • Zixun Dai
  • Xiaoqing Qiu
  • Zhe Ouyang
  • Yuzhu Pan
  • Xin Fang
  • Jiahe Li
  • Yutong Sun
  • Xiaona Guan

DOI:

https://doi.org/10.54097/zefyw181

Keywords:

Generative AI, Critical Thinking, Measurement Gauge, SOAP Framework

Abstract

With the rapid development of artificial intelligence (AI) technology, major changes have taken place in the field of medical education in China. In recent years, in order to respond to the training requirements of “new medicine” for compound talents, the demand for systematic evaluation of critical thinking ability of medical students in China is increasing. Based on SOAP clinical reasoning framework and integrating existing critical thinking theory, this study established a medical critical thinking assessment gauge covering six dimensions of “interpretation-analysis-evaluation-inference-self-adjustment-clinical adaptation”, each dimension has five levels, presenting a path from information processing to clinical decision-making ability, and introducing evidence-based medicine tools (such as AGREE II), cognitive bias and other professional concepts enhance the professionalism and consistency of evaluation, which can be used as the core quantitative basis of the generative AI-driven critical thinking education system. Meanwhile, the gauge realizes the paradigm transformation from static evaluation to dynamic diagnosis and from general scoring to personalized intervention, providing a reliable path for the cultivation of medical high-order thinking ability.

Downloads

Download data is not yet available.

References

[1] Cui Liyuan, Zhu Yaxin, Qu Bo.Application and prospect of critical thinking scale in medical education [J].Fudan Education Forum, 2021, 19 (02):106-112.DOI:10. 13397/j. cnki. fef.2021.02.016.

[2] Wartman S A. Medicine, machines, and medical education[J]. Academic Medicine, 2021, 96(7): 947-950.DOI:10. 1097/ ACM. 0000000000004113.

[3] Jiang Liming, Liu Yujie, Luo Fang.Critical Thinking Assessment Based on Real Problem Situations: Status and Challenges [J].China Distance Education, 2022,(12):58-67+ 77+ 83. DOI:10.13541/j.cnki.chinade.2022.12.006.

[4] Zhang Kehui, Zhang Wei.Evolution and Trend Analysis of Medical Artificial Intelligence Research Hotspots at Home and Abroad [J/OL]. Hygiene Soft Science, 1 -8[2025-10-13]. https:// link.cnki.net/urlid/53.1083.R.20250916.1721.017.

[5] Huang J, Zhang H, Fan X S, et al. Application of SOAP teaching method combined with Mini-CEX in outpatient medical record writing teaching of standardized training for dental residents [J].Zhejiang Medical Education, 2023, 22 (04): 237-241. DOI: 10.20019/j.cnki. 1672-0024.2023. 04. 237. 05.

[6] Naqvi W M, Ganjoo R, Rowe M, et al. Critical thinking in the age of generative AI: implications for health sciences education [J]. Frontiers in Artificial Intelligence, 2025, 8: 1571527.

[7] Calm down, Lu Honghuan, Dailin.Generative AI Enabling Critical Thinking Assessment--An Applied Experiment Based on ChatGPT [J]. Modern Distance Education Research, 2024, 36 (06): 102-111.DOI:CNKI: SUN:XDYC.0.2024-06-011.

[8] Richard Paul, Linda Elder.Critical Thinking Tools (3rd Edition) [J].Enterprise Observer, 2018,(09):120-121. DOI:CNKI: SUN: QYGC. 0.2018-09-051.

[9] F. D H. Thought and Knowledge: An Introduction to Critical Thinking[M]. Taylor and Francis:2013-11-07: DOI: 10.4324/ 9781315885278.

[10] Calm down, Lu Xiaoxu.A Study on Critical Thinking Ability of Item Bank Game Evaluation [J].Open Education Research, 2020, 26 (01):82-89. DOI:10.13966/j.cnki.kfjyyj.2020.01.009.

[11] Liu Wei, Zhou Ning, Zhang Fangfang.Research on text-based information visualization method [J].Modern Library and Information Technology, 2003,(02):34-36+ 47. DOI:CNKI: SUN: XDTQ.0.2003-02-009.

[12] Li Qiaojun, Yan Jin, Zhang Zhonglin, et al. An Empirical Study on Core Evaluation Index System of Hospitalization Service Quality Based on Value Care [J]. China Health Economics, 2020, 39 (08):79- 80. DOI: CNKI:SUN:WEIJ.0.2020-08-023.

Downloads

Published

27-11-2025

Issue

Section

Articles