SC-UneXt: Nested UNeXt Architecture based on Medical Image Segmentation
DOI:
https://doi.org/10.54097/fcis.v6i2.07Keywords:
Lightweight, Edge Feature Fusion, Multi-branch Feature Fusion, Medical Image SegmentationAbstract
UNet and its various variants are commonly used methods in medical image segmentation tasks; however, many network parameters, complex calculations, and slow usage are problems that need to be overcome. These problems hinder the specific application of fast image segmentation in real-time tasks. At the same time, the lesion area has problems such as small size, irregular shape, and blurred edges, which makes the network feature extraction difficult and the segmentation accuracy needs to be improved. At the same time, medical image segmentation provides a variety of effective methods for the accuracy and robustness of organ segmentation, lesion detection, and classification. Medical images have fixed structures, simple semantics, and diverse details, so integrating rich multi-scale features can improve segmentation accuracy. Given that the density of diseased tissue may be comparable to that of surrounding normal tissue, both global and local information are crucial to segmentation results. To this end, we propose an image segmentation method (SC -UNe X t) based on edge feature extraction and multi-scale feature fusion of convolutional multi-layer perceptron (MLP). The network is a deeply supervised encoder-decoder network, in which the encoder and decoder pass through a series of nested, multiple jump paths to reduce the semantic gap between the feature maps of the encoder and decoder sub-networks.; Multi - scale feature fusion is introduced based on the UNe Finally, we evaluate our model approach on the LIDC dataset public dataset. Experiments have proven the effectiveness of this method. Our model's similarity coefficient and intersection ratio reached 86.44% and 90.86% respectively. Compared with UNet and UNe X t, the network proposed in this article has improved in accuracy, intersection ratio of real values and predicted values, similarity coefficient, and segmentation effect.
Downloads
References
O. C. Eidheim, L. Aurdal, T. Omholt-Jensen, T. Mala, and B. Edwin, ‘‘Segmentation of liver vessels as seen in MR and CT images,’’ Int. Congr. Ser., vol. 1268, pp. 201–206, Jun. 2004. [Online]. Available: http://www. sciencedirect. com/science/ article/pii/S0531513104006132.
A. Bert et al., ‘‘An automatic method for colon segmentation in CT colonography,’’ Computerized Med. Imag. Graph., vol. 33, no. 4, pp. 325–331, Jun. 2018. [Online]. Available: http:// www.sciencedirect. com/science/article/pii/ S089561110900 0226
T. Klinder, J. Ostermann, M. Ehm, A. Franz, R. Kneser, and C. Lorenz, ‘‘Automated model-based vertebra detection, identification, and segmentation in CT images,’’ Med. Image Anal., vol. 13, no. 3, pp. 471–482, Jun. 2009. [Online]. Available: http://www.sciencedirect.com/science/ article/pii/ S1361841509000085
H. Lu, Y. Li, M. Chen, H. Kim, and S. Serikawa, ‘‘Brain intelligence: Go beyond artificial intelligence,’’ Mobile Netw. Appl., vol. 23, no. 2, pp. 368–375, Apr. 2018. doi: 10.1007/ s11036-017-0932-8.
M. Chen, X. Shi, Y. Zhang, D. Wu, and M. Guizani, ‘‘Deep features learning for medical image analysis with convolutional autoencoder neural network,’’ IEEE Trans. Big Data, to be published.
Y. Zhang, M. Qiu, C.-W. Tsai, M. M. Hassan, and A. Alamri, ‘‘HealthCPS: Healthcare cyber-physical system assisted by cloud and big data,’’ IEEE Syst. J., vol. 11, no. 1, pp. 88–95, Mar. 2017.
J. Long, E. Shelhamer, and T. Darrell, ‘‘Fully convolutional networks for semantic segmentation,’’ in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 3431–3440.
O. Ronneberger, P. Fischer, and T. Brox, ‘‘U-net: Convolutional networks for biomedical image segmentation,’’ in Proc. Int. Conf. Med. Image Comput. Comput-Assist. Intervent. (MICCAI), Nov. 2015, pp. 234–241.
Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, ‘‘Gradient-based learning applied to document recognition,’’ Proc. IEEE, vol. 86, no. 11, pp. 2278–2324, Nov. 1998.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, ‘‘Imagenet classification with deep convolutional neural networks,’’ Commun. ACM, vol. 60, no. 6, pp. 84–90, Jun. 2012.
Jha, D., et al. Doubleu-net: A deep convolutional neural network for medical image segmentation. In 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS) (2020).
Liu, T. et al. Residual convolutional neural network for cardiac image segmentation and heart disease diagnosis. IEEE Access. 8, 82153–82161 (2020).
Wu, B., Fang, Y. & Lai, X. Lef ventricle automatic segmentation in cardiac MRI using a combined CNN and U-net approach. Comput. Med. Imaging Graph. 82, 101719 (2020).
Galati, F. & Zuluaga, M. A. Efcient model monitoring for quality control in cardiac image segmentation. FIMH 20, 101–111 (2021).
Ronneberger, O., Fischer, P., & Brox, T. U-Net: Convolutional networks for biomedical image segmentation. In MICCAI 2015. Part III 18, 234–241 (2015).
Milletari, F., Navab, N., & Ahmadi, S. A. V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 Fourth International Conference on 3D Vision (3DV). 565–571 (2016).
Zhou, Z., et al. UNet++: A nested U-Net architecture for medical image segmentation. DLMIA/ML-CDS@MICCAI 2018. 3–11 (2018).
Zhang, J., et al. MDU-Net: Multi-scale densely connected U-Net for biomedical image segmentation. arXiv:1812.00352 (arXiv preprint) (2018).
Hu, J., Shen, L., & Sun, G. Squeeze-and-excitation networks. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Rec ognition. 7132–7141 (2018).
Hou, Q., Zhou, D., & Feng, J. Coordinate attention for efcient mobile network design. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 13708–13717 (2021).
Woo, S., Park, J., Lee, J. Y., & Kweon, I. S. Cbam: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision (ECCV) (2018).
Tu, Z., et al. Maxim: Multi-axis mlp for image processing[C]. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5769–5780 (2022).
Valanarasu, J. M. J. & Patel, V. M. UNeXt: MLP-based rapid medical image segmentation network. MICCAI 5, 23–33 (2022).
Tyagi, T., Gupta, P., & Singh, P. A hybrid multi-focus image fusion technique using SWT and PCA. In 2020 10th International Conference on Cloud Computing, Data Science and Engineering (Confuence). 491–497 (2020).
Ramlal, S. D., Sachdeva, J., Ahuja, C. K. & Khandelwal, N. An improved multimodal medical image fusion scheme based on hybrid combination of nonsubsampled contourlet transform and stationary wavelet transform. Int. J. Imaging Syst. Technol. 29(2), 146–160 (2019).
Joshi, K., Kirola, M., Chaudhary, S., Diwakar, M., & Joshi, N. K. Multi-focus image fusion using discrete wavelet transform method. In International Conference on Advances in Engineering Science Management & Technology (ICAESMT)-2019, Uttaranchal Univer sity, Dehradun, India (2019).
Mao, R., et al. Multi-directional laplacian pyramid image fusion algorithm[C]. In 2018 3rd International Conference on Mechanical, Control and Computer Engineering (ICMCCE). IEEE, 2018. 568–572 (2018).
Long, J., Shelhamer, E., & Darrell, T. Fully convolutional networks for semantic segmentation. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3431–3440 (2015).
