Intelligent Assisted Diagnosis and Treatment System for Vascular Infarction Based on YOLO-SAM and Unique3D

Dongcai He; Quanwang Jing; Chenyang Wang; Yehua Hu; Beining Guo; Tao Xue

doi:10.54097/jcyene97

Authors

Dongcai He
Quanwang Jing
Chenyang Wang
Yehua Hu
Beining Guo
Tao Xue

DOI:

https://doi.org/10.54097/jcyene97

Keywords:

Vascular Plaque Detection, Medical Image Segmentation, 3D reconstruction, Deep Learning, Auxiliary Diagnosis

Abstract

Cardiovascular and cerebrovascular diseases have become the leading cause of death among chronic diseases in China. To address this, an intelligent vascular plaque detection and thrombosis risk prediction system was designed, integrating image recognition and 3D modeling into a multi-stage diagnostic framework. First, the YOLO model performs real-time plaque detection within vascular images, feeding the detected regions as input to the SAM model for precise segmentation. Subsequently, the segmented regions undergo high-fidelity 3D reconstruction using Unique3D technology to restore the spatial structure of vessels and plaques. Finally, an LSTM-based machine learning algorithm is trained using the 3D morphology and clinical labels to predict the probability of plaque-induced vascular infarction, thereby completing the closed-loop auxiliary diagnosis system.

Downloads

Download data is not yet available.

References

[1] Qing Xu, Jiaxuan Li, Xiangjian He, Ziyu Liu, Zhen Chen, Wenting Duan, Chenxin Li, Maggie M. He, Fiseha B. Tesema, Wooi P. Cheah, Yi Wang, Rong Qu, Jonathan M. Garibaldi. ESP-MedSAM: Efficient Self-Prompting SAM for Universal Domain-Generalized Medical Image Segmentation. , 2024.

[2] Xu Zhao, Wenchao Ding, Yongqi An, Yinglong Du, Tao Yu, Min Li, Ming Tang, Jinqiao Wang. Fast Segment Anything. , 2023.

[3] Renrui Zhang, Zhengkai Jiang, Ziyu Guo, Shilin Yan, Junting Pan, Xianzheng Ma, Hao Dong, Peng Gao, Hongsheng Li. Personalize Segment Anything Model with One Shot. , 2023.

[4] Zhiheng Ma, Xiaopeng Hong, Qinnan Shangguan. Can SAM Count Anything? An Empirical Study on SAM Counting. , 2023.

[5] Tianrun Chen, Lanyun Zhu, Chaotao Ding, Runlong Cao, Yan Wang, Zejian Li, Lingyun Sun, Papa Mao, Ying Zang. SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and More. , 2023.

[6] Wu Tong, Hu Haoji, Feng Yang, Luo Qiong, Xu Dong, Zheng Weizeng, Jin Neng, Yang Chen, Yao Jingcao. Application of the Segmentation All Models (SAM) Approach in Medical Image Segmentation [J]. Chinese Journal of Lasers, 2024, 51(21): 1-15. DOI:10.3788/CJL240614.

[7] Rahima Khanam, Muhammad Hussain. YOLOv11: An Overview of the Key Architectural Enhancements. , 2024.

[8] Wang Kai, Wang Wei, Jiang Zhiwei. Detection of Small Targets in Remote Sensing Based on an Improved YOLO Model [J]. Electro-Optics and Control, 2023, 30(6): 60.

[9] Chun-Tse Chien, Rui-Yang Ju, Kuang-Yi Chou, Enkaer Xieerke, Jen-Shiun Chiang. YOLOv8-AM: YOLOv8 Based on Effective Attention Mechanisms for Pediatric Wrist Fracture Detection., 2024.

[10] Liu Z, Wang N, Zhang C, Wei G. [Cardiac magnetic resonance image segmentation based on lightweight network and knowledge distillation strategy]. Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2024 Dec 25;41(6):1204-1212. Chinese. doi: 10.7507/1001-5515.202312015. PMID: 40000210; PM CID: PMC11955363.

[11] QinDian, BuJia-Jun, LiuZhe, ShenXin, ZhouSheng, GuJing-Jun, WangZhi-Hua, WuLei, DaiHui-Fen. Efficient Medical Image Segmentation Based on Knowledge Distillation. IEEE Transactions on Medical Imaging, 40(12): 3820–3831, 2021. DOI: 10.1109/tmi.2021.3098703.

[12] Cao Liang, Xiao Wei, Li Xiangli. YOLO Algorithm and Its Applications in Crop Recognition and Pest Detection: A Review [J/OL]. Journal of Zhongkai Institute of Agricultural Engineering, 1-14[2025-04-20]. http://kns.cnki.net/kcms/ detail/ 44. 1660. S.20250418.1342.002.html.

[13] Su Qinghua, Zhou Yufei, Qin Zhenbo, Mu Siyu, Yang Xuedong. Detection of COVID-19 Disease Based on YOLOv5 [J]. Biomedical Science, 2022, 12(4): 271-278. DOI:10. 12677/ hjbm. 2022.124033.

[14] XieHaozhe, YaoHongxun, SunXiaoshuai, ZhouShangchen, ZhangShengping. Pix2vox: Context-aware 3d reconstruction from single and multi-view images. //Proceedings of the IEEE/ CVF international conference on computer vision, 2019.

[15] Maken P, Gupta A. 2D-to-3D: A Review for Computational 3D Image Reconstruction from X-ray Images[J]. Archives of Computational Methods in Engineering, 2023, 30: 85–114. DOI: 10.1007/s11831-022-09790-z.

[16] Weng Gaoyi, Yao Jianmin, Chen Enguo, et al. Research on 2D-to-3D Conversion Technology Based on Saliency Maps [J]. Information Technology and Informatization, 2025, (02): 183-186.

[17] Tian Yuling. Research on Visualization Conversion Technology from 2D Parameters to 3D Rendering of Turned Collars [D]. Donghua University, 2009.

[18] Li Jinfang, Shi Fazhong. BOX Display Method in Conversion from 2D Views to 3D Geometric Models [J]. Computer Engineering, 2005, (19): 182-183+188.

[19] l-SherbiniAdham H, CoroneosStefania, ZidanAli, OthmanMaha. Machine learning as a diagnostic and prognostic tool for predicting thrombosis in cancer patients: a systematic review. //Seminars in Thrombosis and Hemostasis, 2024.

[20] X, Li Y, Yan F, et al. Automatic coronary plaque detection, classification, and stenosis grading using deep learning and radiomics on computed tomography angiography images: a multi-center multi-vendor study[J]. European radiology, 2022, 32(8): 5276-5286.

[21] Yao Chunxiao. Research on a Cerebrovascular Disease Prediction System Based on Long Short-Term Memory Neural Networks [D]. Beijing Jiaotong University, 2019. DOI:10. 26944/ d.cnki.gbfju.2019.000978.

[22] Wu Li, Luo Yefangxin, Shi Wenting, et al. Establishment and Evaluation of a Machine Learning-Based Early Warning Model for Lower Limb Deep Vein Thrombosis Risk in Hemorrhagic Stroke Patients [J]. Journal of Zunyi Medical University, 2024, 47(09): 903-909. DOI:10.14169/j. cnki. zunyixuebao. 2024.0118.

[23] Lu Yanqiao, Shen Lan, He Ben. Application of Artificial Intelligence in the Auxiliary Diagnosis and Treatment of Cardiovascular Diseases [J]. Journal of Shanghai Jiao Tong University (Medical Edition), 2020, 40(2): 123-128. DOI: 10. 3969/j. issn.1674-8115.2020.02.019.