Research Progress of Image Segmentation

Authors

  • Jiyuan Ran

DOI:

https://doi.org/10.54097/80whkc51

Keywords:

Image segmentation; open-vocabulary segmentation; referring image segmentation.

Abstract

Image segmentation is an essential and challenging task in CV. It can be used in a massive scope including automatic driving, medical analysis and geological detection. In the early stage of the research, some researchers based on the geometry of the image, color space and other ways of semantic segmentation results are poor. Fortunately, with the flourishing of deep learning, great improvement has been gained in various deep learning-based image segmentation fields. At the same time, in the open world, semantic segmentation research is not limited to fixed categories or known categories, and some open-world semantic segmentation methods and reference semantic segmentation methods based on text description have also made great breakthroughs. This paper summarizes commonly used datasets for segmentation and introduces main ideas of popular algorithms in traditional, open-vocabulary and referring segmentation respectively. In the end, the important contribution of the paper is summarized and some suggestions regarding the future improvement of existing algorithms are given.

Downloads

Download data is not yet available.

References

He K, Gkioxari G, Dollár P, et al. Mask r-cnn. Proceedings of the IEEE international conference on computer vision. 2017: 2961-2969.

Ren S, He K, Girshick R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 2015, 28.

Kirillov A, Mintun E, Ravi N, et al. Segment anything. Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023: 4015-4026.dd.

Liu C, Lin Z, Shen X, et al. Recurrent multimodal interaction for referring image segmentation. Proceedings of the IEEE international conference on computer vision. 2017: 1271-1280.

Jing Y, Kong T, Wang W, et al. Locate then segment: A strong pipeline for referring image segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 9858-9867.

He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 770-778.

Lin T Y, Dollár P, Girshick R, et al. Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 2117-2125.

Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 3431-3440.

Cai Z, Vasconcelos N. Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 6154-6162

Chen K, Pang J, Wang J, et al. Hybrid task cascade for instance segmentation. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2019: 4974-4983.

Radford A, Kim J W, Hallacy C, et al. Clip: Learning transferable visual models from natural language supervision. arXiv preprint arXiv:2103.00020, 2021.

Hochreiter S, Schmidhuber J. Long short-term memory. Neural computation, 1997, 9(8): 1735-1780.

Downloads

Published

26-06-2024