A Tongue Segmentation Algorithm Based on Deeplabv3+ Network Model


  • Weifeng Bu
  • Mingchuan Zhang




Convolutional neural network, Semantic seg- mentation, Deep learning, Tongue segmentation


When collecting tongue images in an open en- vironment with a mobile portable collection device, there will be problems of different shooting angles and unstable lighting. Due to the strong mobility of the portable acquisition device, the captured images will inevitably be blurred by jitter, which further increases the difficulty of segmentation. This paper applies neural network to tongue images segmentation, and proposes a tongue images segmentation method based on deep convolutional neural network. This method is a tongue images segmentation method based on the semantic segmentation framework of DeeplabV3+. First, we modify the output category of the network. Because only the tongue region is segmented, segmentation targets can be divided into two categories when performing tongue images segmentation. One is the tongue region and the other is the background region. Then we replace the backbone network of DeeplabV3+ with a lightweight network and add an attention mechanism. Finally, we use the collected tongue images in the open environment to train the network. After the network obtains the initial segmentation result, tongue images are restored according to the same type of label, so as to obtain the required tongue images only containing tongues. The experimental results show that the method has higher segmentation accuracy for tongue images in open environment, and can better meet the needs of people for tongue images segmentation.


Wodecki, Andrzej. Artificial intelligence methods and tech- niques[J]. Artificial Intelligence in Value Creation, 2019, 2: 71- 132.

Vitsios, Dimitrios. Prioritizing non-coding regions based on human genomic constraint and sequence context with deep learning[J]. Nature communications, 2021, 12(1): 1-14.

Lin A, Chan G , Hu Y , et al. Internationalization of traditional Chinese medicine: current international market, internationalization challenges and prospective suggestions[J]. Chinese Medicine, 2018, 13(1): 1-6.

Ye Y, Wei L . Design and Implementation of the Traditional Chinese Medicine Constitution System Based on the Diagnosis of Tongue and Consultation[J]. IEEE Access, 2020, (99): 4266- 4278.

Ku J , Harakeh A , Waslander S L . In Defense of Classical Image Processing: Fast Depth Completion on the CPU[C]. Conference on Computer and Robot Vision, 2018, 16-22.

ESTEVA A, KUPREL B, NOVOA R A, et al. Dermatologist- level classification of skin cancer with deep neural networks[J]. Nature, 2017, 542(7639): 115-118.

Xu T, Zhang W, Qian B. The role and challenge of artificial intelligence in new coronavirus pneumonia ct diagnosis[J]. TMR Modern Herbal Med, 2020, 3(3): 165-172.

Anthimopoulos M, Christodoulidis S, Ebner L, et al. Semantic segmentation of pathological lung tissue with dilated fully con- volutional networks[J]. IEEE journal of biomedical and health informatics, 2018, 23(2): 714-722.

Long J, Shelhamer E, Darrell T. Fully Convolutional Networks for Semantic Segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 39(4): 640-651.

Cai Y, Wang T , Liu W , et al. A robust interclass and intraclass loss function for deep learning based tongue segmentation[J]. Concurrency and Computation: Practice and Experience, 2020, 32(22): 5849.

Liu B, Hu G, Zhang X, et al. Application of an improved grab cut method in tongue image segmentation[C]. International Conference on Intelligent Computing, 2018, 484-495.

WANG M, ZHANG Q, ZHU J, et al. A New Computerized Tongue Diagnosis Method with Optimized Outline Extraction Algorithm Using HSV Color Model[J]. Journal of Computa- tional & Theoretical Nanoscience, 2014, 11(6): 1556-1562.

Xie J, Jing C, Zhang Z, et al. Digital tongue image analyses for health assessment[J]. Medical Review, 2021, 1(2): 172-198.

Tania M H, Lwin K, Hossain M A. Advances in automated tongue diagnosis techniques[J]. Integrative Medicine Research, 2019, 8(1): 42-56.

Fan S, Chen B, Zhang X, et al. Machine learning algorithms in classifying TCM tongue features in diabetes mellitus and symptoms of gastric disease[J]. European Journal of Integrative Medicine, 2021, 43: 101288.

Tsai C, Lo Y, Chiang J Y, et al. Digital education and dynamic assessment of tongue diagnosis based on Mashup technique[J]. Chinese Journal of Integrative Medicine, 2017: 1-7.

Zhao Q, Zhang D, Zhang B. Digital tongue image analysis in medical applications using a new tongue ColorChecker[C]. IEEE International Conference on Computer and Communications, 2016: 803-807.

Fu S, Zheng H, Yang Z, et al. Computerized tongue coating nature diagnosis using convolutional neural network[C]. Inter- national Conference on Big Data Analysis, 2017: 730-734.

Chen L C, Zhu Y, Papandreou G, et al. Encoder-decoder with atrous separable convolution for semantic image segmen- tation[C]. Proceedings of the European conference on computer vision, 2018: 801-818.







How to Cite

Bu, W., & Zhang, M. (2023). A Tongue Segmentation Algorithm Based on Deeplabv3+ Network Model. Journal of Computing and Electronic Information Management, 10(3), 46-50. https://doi.org/10.54097/jceim.v10i3.8680

Similar Articles

1-10 of 95

You may also start an advanced similarity search for this article.