Review of Semi-Supervised Medical Image Segmentation based on the U-Net

Lina Dai; Md Gapar Md Johar; Mohammed Hazim Alkawaz

doi:10.54097/gmhkht38

Authors

Lina Dai
Md Gapar Md Johar
Mohammed Hazim Alkawaz

DOI:

https://doi.org/10.54097/gmhkht38

Keywords:

Semi Supervised, U-Net, Medical Image Segmentation.

Abstract

Medical image segmentation is a core task in the field of medical image processing. It aims to separate areas of interest such as organs, tissues, and lesions from the background in medical images to facilitate further analysis, diagnosis, and treatment planning. Accurate image segmentation is crucial for improving the accuracy of disease diagnosis, assessing disease progression, and developing personalized treatment plans. However, fully supervised segmentation methods face the challenge of high annotation costs. With the emergence of the U-Net architecture, semi-supervised medical image segmentation based on U-Net is receiving increasing attention. This article reviews semi-supervised segmentation methods, the design concept and structure of the U-Net network, how it has been extended, and its application in semi-supervised medical image segmentation. The article also identifies the challenges faced by semi-supervised medical image segmentation techniques based on U-Net and speculates on possible future research directions. In conclusion, the article summarizes the potential of semi-supervised medical image segmentation technology based on U-Net as an accurate and efficient tool for medical diagnosis and treatment.

Downloads

Download data is not yet available.

References

Akbar, A. S., Fatichah, C., Suciati, N. J. J. o. K. S. U.-C., & Sciences, I. (2022). Single level UNet3D with multipath residual attention block for brain tumor segmentation. 34(6), 3247-3258.

Alom, M. Z., Hasan, M., Yakopcic, C., Taha, T. M., & Asari, V. K. J. a. p. a. (2018). Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation.

Anand, V., Gupta, S., Koundal, D., & Singh, K. J. E. S. w. A. (2023). Fusion of U-Net and CNN model for segmentation and classification of skin lesion from dermoscopy images. 213, 119230.

Awan, R., Sirinukunwattana, K., Epstein, D., Jefferyes, S., Qidwai, U., Aftab, Z., . . . Rajpoot, N. J. S. r. (2017). Glandular morphometrics for objective grading of colorectal adenocarcinoma histology images. 7(1), 16852.

Bortsova, G., Dubost, F., Hogeweg, L., Katramados, I., & De Bruijne, M. (2019). Semi-supervised medical image segmentation via learning consistency under transformations. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part VI 22.

Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., & Wang, M. (2022). Swin-unet: Unet-like pure transformer for medical image segmentation. Paper presented at the European conference on computer vision.

Chaitanya, K., Karani, N., Baumgartner, C. F., Becker, A., Donati, O., & Konukoglu, E. (2019). Semi-supervised and task-driven data augmentation. Paper presented at the Information Processing in Medical Imaging: 26th International Conference, IPMI 2019, Hong Kong, China, June 2–7, 2019, Proceedings 26.

Chaudhury, S., Krishna, A. N., Gupta, S., Sankaran, K. S., Khan, S., Sau, K., . . . Medicine, M. M. i. (2022). Effective image processing and segmentation-based machine learning techniques for diagnosis of breast cancer. 2022.

Chen, D., Ao, Y., & Liu, S. J. S. (2020). Semi-supervised learning method of U-net deep learning network for blood vessel segmentation in retinal images. 12(7), 1067.

Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016). 3D U-Net: learning dense volumetric segmentation from sparse annotation. Paper presented at the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Athens, Greece, October 17-21, 2016, Proceedings, Part II 19.

Du, G., Cao, X., Liang, J., Chen, X., Zhan, Y. J. J. o. I. S., & Technology. (2020). Medical Image Segmentation based on U-Net: A Review. 64(2).

Han, K., Liu, L., Song, Y., Liu, Y., Qiu, C., Tang, Y., . . . Informatics, H. (2022). An effective semi-supervised approach for liver CT image segmentation. 26(8), 3999-4007.

Hu, X., Zeng, D., Xu, X., & Shi, Y. (2021). Semi-supervised contrastive learning for label-efficient medical image segmentation. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24.

Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., . . . Wu, J. (2020). Unet 3+: A full-scale connected unet for medical image segmentation. Paper presented at the ICASSP 2020-2020 IEEE international conference on acoustics, speech and signal processing (ICASSP).

Huisi, W., Chen, G., Wen, Z., & Qin, J. (2021). Collaborative and adversarial learning of focused and dispersive representations for semi-supervised polyp segmentation. Paper presented at the Proceedings of the IEEE/CVF International Conference on Computer Vision.

Huisi, W., Wang, Z., Song, Y., Yang, L., & Qin, J. (2022). Cross-patch dense contrastive learning for semi-supervised segmentation of cellular nuclei in histopathologic images. Paper presented at the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Ibtehaz, N., & Rahman, M. S. J. N. n. (2020). MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation. 121, 74-87.

Iqbal, A., & Sharif, M. J. E. S. w. A. (2023). UNet: A semi-supervised method for segmentation of breast tumor images using a U-shaped pyramid-dilated network. 221, 119718.

Jiacheng, W., Li, X., Han, Y., Qin, J., Wang, L., & Qichao, Z. (2022). Separated contrastive learning for organ-at-risk and gross-tumor-volume segmentation with limited annotation. Paper presented at the Proceedings of the AAAI Conference on Artificial Intelligence.

Jiao, R., Zhang, Y., Ding, L., Xue, B., Zhang, J., Cai, R., . . . Medicine. (2023). Learning with limited annotations: a survey on deep semi-supervised learning for medical image segmentation. 107840.

Jinyong, H., Ding, X., & Deng, J. D. (2022). Semi-supervised semantic segmentation of vessel images using leaking perturbations. Paper presented at the Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision.

Lei, Z., Yang, K., Zhang, M., Chan, L. L., Ng, T. K., & Ooi, B. C. (2021). Semi-supervised unpaired multi-modal learning for label-efficient medical image segmentation. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24.

Liu, D., Sheng, N., Han, Y., Hou, Y., Liu, B., Zhang, J., . . . Applications. (2023). SCAU-net: 3D self-calibrated attention U-Net for brain tumor segmentation. 35(33), 23973-23985.

Luo, X., Chen, J., Song, T., & Wang, G. (2021). Semi-supervised medical image segmentation through dual-task consistency. Paper presented at the Proceedings of the AAAI conference on artificial intelligence.

Luo, X., Hu, M., Song, T., Wang, G., & Zhang, S. (2022). Semi-supervised medical image segmentation via cross teaching between cnn and transformer. Paper presented at the International Conference on Medical Imaging with Deep Learning.

Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., . . . Kainz, B. J. a. p. a. (2018). Attention u-net: Learning where to look for the pancreas.

Renzhen, W., Wu, Y., Chen, H., Wang, L., & Meng, D. (2021). Neighbor matching for semi-supervised learning. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24.

Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. Paper presented at the Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18.

Ryalat, M. H., Dorgham, O., Tedmori, S., Al-Rahamneh, Z., Al-Najdawi, N., Mirjalili, S. J. N. C., & Applications. (2023). Harris hawks optimization for COVID-19 diagnosis based on multi-threshold image segmentation. 35(9), 6855-6873.

Said, Y., Alsheikhy, A. A., Shawly, T., & Lahza, H. J. D. (2023). Medical images segmentation for lung cancer diagnosis based on deep learning architectures. 13(3), 546.

Seibold, C. M., Reiß, S., Kleesiek, J., & Stiefelhagen, R. (2022). Reference-guided pseudo-label generation for medical semantic segmentation. Paper presented at the Proceedings of the AAAI conference on artificial intelligence.

Shaojie, L., Zhang, Y., & Yang, X. (2021). Semi-supervised cardiac mri segmentation based on generative adversarial network and variational auto-encoder. Paper presented at the 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

Shi, Y., Zhang, J., Ling, T., Lu, J., Zheng, Y., Yu, Q., . . . Gao, Y. J. I. t. o. m. i. (2021). Inconsistency-aware uncertainty estimation for semi-supervised medical image segmentation. 41(3), 608-620.

Srivastava, A., Jha, D., Chanda, S., Pal, U., Johansen, H. D., Johansen, D., . . . Informatics, H. (2021). MSRF-Net: a multi-scale residual fusion network for biomedical image segmentation. 26(5), 2252-2263.

Su, R., Zhang, D., Liu, J., & Cheng, C. J. F. i. G. (2021). Msu-net: Multi-scale u-net for 2d medical image segmentation. 12, 639930.

Tarvainen, A., & Valpola, H. J. A. i. n. i. p. s. (2017). Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. 30.

Upadhyay, A. K., Bhandari, A. K. J. I. T. o. R., & Sciences, P. M. (2023). Semi-supervised modified-UNet for lung infection image segmentation.

Xiaoyan, W., Yuan, Y., Guo, D., Huang, X., Cui, Y., Xia, M., . . . Chen, S. J. M. I. A. (2022). SSA-Net: Spatial self-attention network for COVID-19 pneumonia infection segmentation with semi-supervised few-shot learning. 79, 102459.

Xiaoyu, C., Zhou, H.-Y., Liu, F., Guo, J., Wang, L., & Yu, Y. J. M. I. A. (2022). MASS: Modality-collaborative semi-supervised segmentation by exploiting cross-modal consistency from unpaired CT and MRI images. 80, 102506.

Xinrong, H., Zeng, D., Xu, X., & Shi, Y. (2021). Semi-supervised contrastive learning for label-efficient medical image segmentation. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24.

Xu, X., Sanford, T., Turkbey, B., Xu, S., Wood, B. J., & Yan, P. J. I. T. o. M. I. (2021). Shadow-consistent semi-supervised learning for prostate ultrasound segmentation. 41(6), 1331-1345.

Yang, J., Tao, Y., Xu, Q., Zhang, Y., Ma, X., Yuan, S., . . . Informatics, H. (2022). Self-supervised sequence recovery for semi-supervised retinal layer segmentation. 26(8), 3872-3883.

Zhang, S., Zhang, J., Tian, B., Lukasiewicz, T., & Xu, Z. J. M. I. A. (2023). Multi-modal contrastive mutual learning and pseudo-label re-learning for semi-supervised medical image segmentation. 83, 102656.

Zheng, H., Lin, L., Hu, H., Zhang, Q., Chen, Q., Iwamoto, Y., . . . Wu, J. (2019). Semi-supervised segmentation of liver using adversarial learning with deep atlas prior. Paper presented at the Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part VI 22.

Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018). Unet++: A nested u-net architecture for medical image segmentation. Paper presented at the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4.