Spatial Variance of Fusion and Physics-Aware for Single Image Dehazing
DOI:
https://doi.org/10.54097/r3t6kv73Keywords:
Image Dehazing, Deep Learning, Spatial Variance Fusion, Physics-awareAbstract
Currently, most image dehazing algorithms overlook the local details of the image and fail to fully exploit different levels of features, resulting in color distortion, decreased contrast, and residual haze in the restored haze-free images. To tackle these issues, this paper proposes a method that dynamically enhances pixels by utilizing the spatial variation of image dark channel prior in images. For regions with high haze density where local information is insufficient, a Transformer is employed to learn the global dependencies of the input features. Conversely, for regions with low haze density where local information is effective, parallel multi-scale attention is used to extract local features. When enhancing each pixel, we dynamically determine the contribution of non-local and local information based on the image features. Furthermore, to better reflect the physical process of haze formation in the image and improve the interpretability of the feature space, a dual-branch physics-aware unit is established. It learns the features related to atmospheric scattering in the image and captures the visual characteristics. In the experiments, a large dataset of dehazing images is used for training and testing, and comparisons are made with other existing dehazing methods. The results demonstrate that this method, which takes into account both local and global information, significantly improves the dehazing performance of the model.
Downloads
References
[1] Wei-Ting Chen, I-Hsiang Chen, Chih-Yuan Yeh, Hao Hsiang Yang, Jian-Jiun Ding, and Sy-Yen Kuo. Sjdl-vehicle: Semi-supervised joint defogging learning for foggy vehicle re-identification. In AAAI, 2022.
[2] Christos Sakaridis, Dengxin Dai, Simon Hecker, and Luc Van Gool. Model adaptation with synthetic and real data for semantic dense foggy scene understanding. In ECCV, pages 687–704, 2018.
[3] Mccartney, E.J.: Scattering phenomena (book reviews: optics of the atmosphere. scattering by molecules and particles). Science 196, 1084–1085 (1977).
[4] Berman, Dana, T. Treibitz , and S. Avidan . "Non-local Image Dehazing." 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) IEEE, 2016.
[5] Raanan, and Fattal. "Dehazing Using Color-Lines." ACM Transactions on Graphics (TOG) 34.1(2014).
[6] He, Kaiming, et al. "Single Image Haze Removal Using Dark Channel Prior." IEEE Transactions on Pattern Analysis & Machine Intelligence 33.12(2011):2341-2353.
[7] Zhu, Qingsong, J. Mai , and L. Shao . "A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior." IEEE Transactions on Image Processing 24.11(2015):3522-3533.
[8] Li B , Peng X , Wang Z ,et al.AOD-Net: All-in-One Dehazing Network [C]//2017 IEEE International Conference on Computer Vision (ICCV).IEEE, 2017.DOI: 10.1109/ ICCV. 2017. 511.
[9] Zhang H, Patel V M .Densely Connected Pyramid Dehazing Network[J].IEEE, 2018.DOI:10.1109/CVPR.2018.00337.
[10] Qin X, Wang Z , Bai Y ,et al. FFA-Net: Feature Fusion Attention Network for Single Image Dehazing[J]. 2019.DOI: 10. 48550/arXiv.1911.07559.
[11] Dong H , Pan J , Xiang L ,et al.Multi-Scale Boosted Dehazing Network with Dense Feature Fusion[J].arXiv, 2020.DOI: 10.1109/CVPR42600.2020.00223.
[12] Wu H, Qu Y , Lin S ,et al.Contrastive Learning for Compact Single Image Dehazing[J]. 2021.DOI:10. 48550/ arXiv. 2104. 09367.
[13] Song Y, He Z , Qian H ,et al.Vision Transformers for Single Image Dehazing[J].arXiv e-prints, 2022.DOI:10. 48550/ arXiv. 2204. 03883.
[14] GUO C L, YAN Q X, ANWAR S, et al. Image dehazing transformer with transmission-aware 3d position embedding [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Jun 18-24, 2022. Washington: IEEE Conputer Society, 2022: 5802–5810.
[15] Woo S, Park J, Lee J Y, et al. Cbam: Convolutional block attention module[C]//Proceedings of the European conference on computer vision (ECCV). 2018: 3-19.
[16] Song Y , He Z , Qian H ,et al.Vision Transformers for Single Image Dehazing[J].arXiv e-prints, 2022.DOI: 10.48550/ arXiv. 2204.03883.
[17] He K , Sun J , Tang X .Single Image Haze Removal Using Dark Channel Prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011.DOI:10. 1109/ CVPRW. 2009. 5206515.
[18] Li B, Peng X , Wang Z ,et al.AOD-Net: All-in-One Dehazing Network[C]//2017 IEEE International Conference on Computer Vision (ICCV).IEEE, 2017.DOI:10. 1109/ ICCV. 2017. 511.
[19] Qin X, Wang Z , Bai Y ,et al.FFA-Net: Feature Fusion Attention Network for Single Image Dehazing[J]. 2019. DOI: 10.48550/arXiv.1911.07559.
[20] Dong H , Pan J , Xiang L ,et al.Multi-Scale Boosted Dehazing Network with Dense Feature Fusion[J].arXiv, 2020.DOI: 10.1109/CVPR42600.2020.00223.
[21] Wu H, Qu Y , Lin S ,et al.Contrastive Learning for Compact Single Image Dehazing[J]. 2021.DOI:10. 48550/ arXiv. 2104. 09367.
[22] Chun-Le Guo, Qixin Yan, Saeed Anwar, Runmin Cong, Wenqi Ren, and Chongyi Li. Image dehazing transformer with transmission-aware 3d position em-bedding. In Proceedings ofthe IEEE/CVFConference on Computer Vision and Pattern Recognition, pages5812–5820, 2022. 2, 3, 6.
[23] Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. Bench-marking single-image dehazing and beyond. IEEE Transactions on Image Processing, 28(1):492–505,2018.
[24] Liu X, Ma Y , Shi Z ,et al.GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV).IEEE, 2020.DOI:10.1109/ICCV.2019.00741.
[25] Liu Z, Lin Y , Cao Y ,et al.Swin Transformer: Hierarchical Vision Transformer using Shifted Windows[J]. 2021.DOI: 10. 48550/ arXiv.2103.14030.
[26] Liang J , Cao J , Sun G ,et al.SwinIR: Image Restoration Using Swin Transformer [J]. IEEE, 2021.DOI:10.1109/ ICCVW 54120. 2021.00210.
[27] Zhendong Wang, Xiaodong Cun, Jianmin Bao, and Jianzhuang Liu. Uformer: A general u-shaped transformer for image restoration. In CVPR, 2022.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Frontiers in Computing and Intelligent Systems
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
