Medical Image Segmentation Based on TransUnet and A2B

Authors

  • Zijian Liu
  • Yufan Liu

DOI:

https://doi.org/10.54097/9xmqk107

Keywords:

Medical image segmentation, Transformer, Attention in attention.

Abstract

The objective of medical picture segmentation technology is to accurately delineate and partition regions affected by pathology, which is of great significance to medical diagnosis and treatment. Thanks to deep learning's quick development, prior efforts mainly utilize the convolutional neural networks equipped with powerful feature representation capability. In this paper, to make the segmentation performance a petter appearance, we introduce a new model in medical image segmentation technology, TransUNet, which combines Transformer and U-Net and uses labeled and unlabeled images for training. To enhance the feature quality and boost the accuracy and robustness of the segmentation results, we further introduce the A2B (Attention in Attention Block) attention mechanism in the TransUNet backbone network. At the same time, we use the CNN-Transformer hybrid model and conduct ablation experiments to verify the improvement effect of the performance indicators. The empirical findings show that TransUNet has accomplished success in tasks requiring medical picture segmentation and can help doctors and researchers more accurately identify and locate key structures.

Downloads

Download data is not yet available.

References

Parmar, N., A. Vaswani, J. Uszkoreit, L. Kaiser, N. Shazeer, A. Ku, and D. Tran. "Image Transformer." In Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholm, SWEDEN, Jul 10-15 2018.

Yuan Meifang, Yang Yi, Zhao Biao et al. Research on automatic segmentation of thyroid based on dense residual U-net neural network in localized CT images [J]. Beijing Biomedical Engineering, 2022, 41 (01): 42-48.

Zhang Xiaoyue, Wang Yongxiong, Zhang Jiapeng, etc. Early gastric cancer screening algorithm based on activation layer pre-compressed excitation residual network [J]. Journal of Southern Medical University, 2021, 41 (11): 1616-1622.

Wang Fang, Qiao Ruiping. SPAM: Spatial segmentation attention module in deep convolutional neural network for image classification [J / OL]. Journal of Xi'an Jiaotong University, 2023 (09): 1-8 [2023-08-30].

Fang Yunhua. Research on the neural mechanism of the correlation between visual attention function and TCM constitution and age based on functional magnetic resonance technology [D]. Fujian University of Traditional Chinese Medicine, 2017.

Jie Hu, Li Shen, and Gang Sun. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7132–7141, 2018.

Liu Kewen, Ma Yuan, Xiong Hongxia, etc. Medical image super-resolution reconstruction method based on residual channel attention network [J]. Progress in laser and optoelectronics, 2020, 57 (02): 161-169.

Wang Jing.Research on attention mechanism for pathological image super-resolution [D]. Beijing Jiaotong University, 2022.

Wang Dongfei. Application of convolutional neural network based on channel attention in image super-resolution reconstruction [J]. Broadcast and television technology, 2018, 45 (06): 63-66.

Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, and Zicheng Liu. Dynamic convolution: Attention over convolution kernels. In Proceedings ofthe IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11030–11039, 2020.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin.Attention Is All You Need.arXiv, 2017.

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth16x16 words: Transformers for image recognition at scale. In: ICLR, 2021.

Wang Jinxiang, Fu Lijun, Yin Pengbin, etc. Medical image segmentation based on CNN and Transformer [J]. Computer system application, 2023, 32 (04): 141-148.

Downloads

Published

15-12-2023