A new method of ship detection in complex background of SAR images based on YOLO

Authors

  • Xinyu Zhang
  • Hua Huo

DOI:

https://doi.org/10.54097/

Keywords:

Synthetic Aperture Radar (SAR), YOLOv7, Ship detection, Small target

Abstract

Synthetic Aperture Radar (SAR) is a remote sensing technology capable of high-resolution imaging of the ground surface under any weather and light conditions. SAR image ship detection is a technique that uses the ship target features in SAR images to identify and locate ships, which is of great value for applications in the fields of maritime traffic management, marine environment monitoring, and maritime security and defence. However, SAR image ship detection also faces some challenges, such as complex sea surface background, low signal-to-noise ratio, and the diversity and density of ship targets, which lead to the shortcomings of traditional feature extraction and classifier-based detection methods in terms of accuracy and efficiency. To address these challenges, this paper proposes a new method for ship detection in SAR images based on YOLOv7. When dealing with SAR images containing clutter interference and complex backgrounds, many models face the dual challenge of insufficient real-time and accuracy. To address this problem, this study proposes a new PCAN aggregation network, which firstly introduces the SimAM attention mechanism, which significantly enhances the model's ability to identify the differences between ships and background clutter, further improves the ability of focusing on target features, and effectively It further improves the ability to focus on target features, effectively reduces the interference of background noise, and improves the detection accuracy in complex scenes. At the same time, the PConv strategy is added to further lighten the model structure, thus accelerating the computation process and improving the inference efficiency. We trained and tested the model on the SAR-Ship-Dataset dataset, and achieved an accuracy of 91.1%, an F1 score of 92.9, and an FPS of 46, demonstrating its excellent detection capability. By comparing and analysing the model with several classical and cutting-edge methods in the current field, the proposed model in this study demonstrates obvious performance advantages, and in addition, through ablation experiments, we further confirm the effectiveness and contribution of PCAN.

References

Lang H, Xi Y, Zhang X. Ship Detection in High-Resolution SAR Images by Clustering Spatially Enhanced Pixel Descriptor [J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(8): 5407-5423.

Chen S, Zhan R, Wang W, Zhang J. Learning Slimming SAR Ship Object Detector Through Network Pruning and Knowledge Distillation [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14: 1267-1282.

Leng X, Ji K, Kuang G. Radio Frequency Interference Detection and Localization in Sentinel-1 Images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(11): 9270-9281.

Zhang P, Luo H, Ju M, et al. Brain-Inspired Fast Saliency-Based Filtering Algorithm for Ship Detection in High-Resolution SAR Images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 1-9.

Wang C, Jiang S, Zhang H, et al. Ship Detection for High-Resolution SAR Images Based on Feature Analysis [J]. IEEE Geoscience and Remote Sensing Letters, 2014, 11(1): 119-123.

Carmassi C, Porta I, Bertelloni C A, et al. PTSD and post-traumatic stress spectrum in the Italian Navy Operational Divers Group and corps of Coast Guard Divers employed in search and rescue activities in the Mediterranean refugees emergences and Costa Concordia shipwreck [J]. J Psychiatr Res, 2020, 129: 141-146.

Zhang, Zhang, Shi, Wei. Depthwise Separable Convolution Neural Network for High-Speed SAR Ship Detection [J]. Remote Sensing, 2019, 11(21).

Song S, Xu B, Yang J. SAR Target Recognition via Supervised Discriminative Dictionary Learning and Sparse Representation of the SAR-HOG Feature [J]. Remote Sensing, 2016, 8(8).

Yang F, Xu Q, Li B. Ship Detection From Optical Satellite Images Based on Saliency Segmentation and Structure-LBP Feature [J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(5): 602-606.

Salembier P, Liesegang S, Lopez-Martinez C. Ship Detection in SAR Images Based on Maxtree Representation and Graph Signal Processing [J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(5): 2709-2724.

Moreira A, Prats-Iraola P, Younis M, et al. A tutorial on synthetic aperture radar [J]. IEEE Geoscience and Remote Sensing Magazine, 2013, 1(1): 6-43.

Chang Y-L, Anagaw A, Chang L, et al. Ship Detection Based on YOLOv2 for SAR Imagery [J]. Remote Sensing, 2019, 11(7).

Liu T, Zhang J, Gao G, et al. CFAR Ship Detection in Polarimetric Synthetic Aperture Radar Images Based on Whitening Filter [J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58(1): 58-81.

Tang G, Liu S, Fujino I, et al. H-YOLO: A Single-Shot Ship Detection Approach Based on Region of Interest Preselected Network [J]. Remote Sensing, 2020, 12(24).

Brusch S, Lehner S, Fritz T, et al. Ship Surveillance With TerraSAR-X [J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(3): 1092-1103.

Feng Y, Chen J, Huang Z, et al. A Lightweight Position-Enhanced Anchor-Free Algorithm for SAR Ship Detection [J]. Remote Sensing, 2022, 14(8).

Solberg A H S, Storvik G O, Solberg R, Volden E. Automatic detection of oil spills in ERS SAR images [J]. IEEE Trans Geosci Remote Sens, 1999, 37: 1916-1924.

Kang M, Ji K, Leng X, Lin Z. Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection [J]. Remote Sensing, 2017, 9(8).

Tings B, Bentes C, Velotto D, Voinov S. Modelling ship detectability depending on TerraSAR-X-derived metocean parameters [J]. CEAS Space Journal, 2018, 11(1): 81-94.

Wang Y, Wang C, Zhang H. Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images [J]. Remote Sensing Letters, 2018, 9(8): 780-788.

Jiang Q, Aitnouri E, Wang S, Ziou D. Automatic Detection for Ship Target in SAR Imagery Using PNN-Model [J]. Canadian Journal of Remote Sensing, 2000, 26: 297 - 305.

Seong-In H, Ouchi K. On a Novel Approach Using MLCC and CFAR for the Improvement of Ship Detection by Synthetic Aperture Radar [J]. IEEE Geoscience and Remote Sensing Letters, 2010, 7(2): 391-395.

Kronauge M, Rohling H. Fast Two-Dimensional CFAR Procedure [J]. IEEE Transactions on Aerospace and Electronic Systems, 2013, 49: 1817-1823.

Biao H, Xingzhong C, Licheng J. Multilayer CFAR Detection of Ship Targets in Very High Resolution SAR Images [J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(4): 811-815.

Sugimoto M, Ouchi K, Nakamura Y. On the novel use of model-based decomposition in SAR polarimetry for target detection on the sea [J]. Remote Sensing Letters, 2013, 4(9): 843-852.

Kaplan L M. Improved SAR target detection via extended fractal features [J]. IEEE Transactions on Aerospace and Electronic Systems, 2001, 37: 436-451.

Huang X, Yang W, Zhang H, Xia G-S. Automatic Ship Detection in SAR Images Using Multi-Scale Heterogeneities and an A Contrario Decision [J]. Remote Sens, 2015, 7: 7695-7711.

Huo W, Huang Y, Pei J, et al. Ship Detection from Ocean SAR Image Based on Local Contrast Variance Weighted Information Entropy [J]. Sensors (Basel, Switzerland), 2018, 18.

Wang C, Wang Y, Liao M. Removal of azimuth ambiguities and detection of a ship: using polarimetric airborne C-band SAR images [J]. International Journal of Remote Sensing, 2011, 33(10): 3197-3210.

Wang S, Sun L, Fan W-L, et al. An automated CNN recommendation system for image classification tasks [J]. 2017 IEEE International Conference on Multimedia and Expo (ICME), 2016: 283-288.

Bappy J H, Roy-Chowdhury A K. CNN based region proposals for efficient object detection [J]. 2016 IEEE International Conference on Image Processing (ICIP), 2016: 3658-3662.

Deng L, Yang M, Qian Y, et al. CNN based semantic segmentation for urban traffic scenes using fisheye camera [J]. 2017 IEEE Intelligent Vehicles Symposium (IV), 2017: 231-236.

Redmon J, Divvala S K, Girshick R B, Farhadi A. You Only Look Once: Unified, Real-Time Object Detection [J]. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015: 779-788.

Liu W, Anguelov D, Erhan D, et al. SSD: Single Shot MultiBox Detector; proceedings of the European Conference on Computer Vision, F, 2015 [C].

Girshick R B, Donahue J, Darrell T, Malik J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation [J]. 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2013: 580-587.

Ren S, He K, Girshick R B, Sun J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 39: 1137-1149.

Sun Z, Leng X, Lei Y, et al. BiFA-YOLO: A Novel YOLO-Based Method for Arbitrary-Oriented Ship Detection in High-Resolution SAR Images [J]. Remote Sensing, 2021, 13(21).

Li Y, Zhang S, Wang W-Q. A Lightweight Faster R-CNN for Ship Detection in SAR Images [J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1-5.

Cui Z, Li Q, Cao Z, Liu N. Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57: 8983-8997.

Zhu H, Xie Y, Huang H, et al. DB-YOLO: A Duplicate Bilateral YOLO Network for Multi-Scale Ship Detection in SAR Images [J]. Sensors (Basel), 2021, 21(23).

Sun K, Liang Y, Ma X, et al. DSDet: A Lightweight Densely Connected Sparsely Activated Detector for Ship Target Detection in High-Resolution SAR Images [J]. Remote Sensing, 2021, 13(14).

Tang G, Zhuge Y, Claramunt C, Men S. N-YOLO: A SAR Ship Detection Using Noise-Classifying and Complete-Target Extraction [J]. Remote Sensing, 2021, 13(5).

Cui J, Jia H, Wang H, Xu F. A Fast Threshold Neural Network for Ship Detection in Large-Scene SAR Images [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15: 6016-6032.

Wang H, Zhang S, Li Y. A Robust and Lightweight Detector for Ship Target with Complex Background in SAR Image [J]. Journal of Sensors, 2022, 2022: 1-16.

Wang C-Y, Bochkovskiy A, Liao H-Y M. YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors [J]. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022: 7464-7475.

Chen J, Kao S-H, He H, et al. Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks [J]. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023: 12021-12031.

Yang L, Zhang R-Y, Li L, Xie X. SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks [Z]//MARINA M, TONG Z. Proceedings of the 38th International Conference on Machine Learning. Proceedings of Machine Learning Research; PMLR. 2021: 11863--11874

Zheng Z, Wang P, Liu W, et al. Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression; proceedings of the AAAI Conference on Artificial Intelligence, F, 2019 [C].

Wang Y, Wang C, Zhang H, et al. A SAR Dataset of Ship Detection for Deep Learning under Complex Backgrounds [J]. Remote Sensing, 2019, 11(7).

Cai Z, Vasconcelos N. Cascade R-CNN: Delving Into High Quality Object Detection [J]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2017: 6154-6162.

Lin T-Y, Goyal P, Girshick R B, et al. Focal Loss for Dense Object Detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 42: 318-327.

Zhou X, Wang D, Krähenbühl P. Objects as Points [J]. ArXiv, 2019, abs/1904.07850.

Zhang T, Zhang X, Ke X. Quad-FPN: A Novel Quad Feature Pyramid Network for SAR Ship Detection [J]. Remote Sens, 2021, 13: 2771.

Nie J, Anwer R M, Cholakkal H, et al. Enriched Feature Guided Refinement Network for Object Detection [J]. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019: 9536-9545.

Guo H, Yang X, Wang N, Gao X. A CenterNet++ model for ship detection in SAR images [J]. Pattern Recognit, 2021, 112: 107787.

Gao J-K. Research on ship frameless detection in SAR image based on multi-scale feature fusion [D]. Liaoning Technical University, 2022.

Jiao J, Zhang Y, Sun H, et al. A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection [J]. IEEE Access, 2018, 6: 20881-20892.

Cui Z, Li Q, Cao Z, Liu N. Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57: 8983-8997.

Zhao Y, Zhao L, Xiong B, Kuang G. Attention Receptive Pyramid Network for Ship Detection in SAR Images [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 13: 2738-2756.

Dai J, Qi H, Xiong Y, et al. Deformable Convolutional Networks [J]. 2017 IEEE International Conference on Computer Vision (ICCV), 2017: 764-773.

Wei S, Su H, Ming J, et al. Precise and Robust Ship Detection for High-Resolution SAR Imagery Based on HR-SDNet [J]. Remote Sens, 2020, 12: 167.

Liu S, Qi L, Qin H, et al. Path Aggregation Network for Instance Segmentation [J]. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018: 8759-8768.

Downloads

Published

30-03-2024

Issue

Section

Articles

How to Cite

Zhang, X., & Huo, H. (2024). A new method of ship detection in complex background of SAR images based on YOLO. Journal of Computing and Electronic Information Management, 12(2), 60-69. https://doi.org/10.54097/

Similar Articles

1-10 of 34

You may also start an advanced similarity search for this article.