Research on Camouflage Target Detection in Two-Branch Multi-Source Remote Sensing Images

Heng Zhang

doi:10.54097/6grm5235

Authors

Heng Zhang

DOI:

https://doi.org/10.54097/6grm5235

Keywords:

Camouflaged Object Detection; Image Fusion; Remote Sensing Image; Two-Branch Network

Abstract

In military operations, the accurate detection of enemy camouflaging targets is of great significance to improve our combat capability. Most of the existing camouflage target detection methods are aimed at a single kind of natural image, and their ability to detect military camouflage image in complex combat environment is limited. In order to solve this problem, this paper proposes a two-branch multi-source remote sensing image camouflage detection method. By combining the fine-grained features of the target in infrared and visible images, the method fuses the camouflage target information to improve the detection capability. Experiments show that the accuracy, recall rate and mAP@.5 of the proposed method are 0.88, 0.859 and 0.923, respectively, which are 0.054, 0.099 and 0.096 higher than the values of YOLOv5s, YOLOv7 and mAP@.5 based on IFCNN method, respectively. Therefore, the method proposed in this paper has outstanding performance in the detection of pedestrian and vehicle camouflage targets, and provides a new method in the field of multi-source information fusion camouflage targets detection.

References

[1] Zhang Dongdong, Wang Chunping, Fu Qiang. Research Progress on Camouflaged Target Detection. Laser Journal, 2024, 45(03): 1-13.

[2] Fan D P, Ji G P, Sun G L, et al. Camouflaged object detection. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, 2020:2777-2787.

[3] Mei H Y, Ji G P, Wei Z Q, et al. Camouflaged object segmentation with distraction mining. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, TN, USA: IEEE, 2021:8772-8781.

[4] Fan D P, Ji G P, Cheng M M, et al. Concealed object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2021, 44(10): 6024-6042.

[5] Li, S., Li, Y., Li, Y., et al. YOLO-FIRI: Improved YOLOv5 for Infrared Image Object Detection. IEEE Access 2021, 9, 141861–141875.

[6] Sun M, Zhang H, Huang Z, et al. Road infrared target detection with I‐YOLO. IET Image Processing, 2022 Jan;16(1):92-101.

[7] Jiang, X.; Cai, W.; Yang, Z.; Xu, P.; Jiang, B. IARet: A Lightweight Multiscale Infrared Aerocraft Recognition Algorithm. Arab. J. Sci. Eng. 2022, 47, 2289–2303.

[8] Tang Linfeng, Zhang Hao, Xu Han. A Review of Image Fusion Methods Based on Deep Learning. Journal of Image and Graphics, 2023,28(01):3-36.

[9] J. Ma, L. Tang, M. Xu, H. Zhang, G. Xiao, STDFusionNet: An infrared and visible image fusion network based on salient target detection, IEEE Trans. Instrum. Meas. 70 (2021) 5009513.

[10] Wang C Y, Bochkovskiy, LIAO H.Y.M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 2023, 7464-7475.

[11] Alexander Toet. The TNO Multiband Image Data Collection. 2017.

[12] L. Tang, J. Yuan, H. Zhang, et al. Piafusion: A progressive infrared and visible image fusion network based on illumination aware. Inf. Fusion, 2022, 83, 79–92.

[13] Sun Y, Cao B, Zhu P, et al. Drone-Based RGB-Infrared Cross-Modality Vehicle Detection Via Uncertainty-Aware Learning. IEEE Trans. Circuits Syst. Video Technol, 2022, 32, 6700–6713.

[14] Zhan W, Sun C, Wang M, et al. An improved Yolov5 real-time detection method for small objects captured by UAV. Soft Comput, 2022, 26, 361–373.

[15] Y. Zhang, Y. Liu, P. Sun, et al. IFCNN: A general image fusion framework based on convolutional neural network. Inf. Fusion, 2020, 54, 99–118.