A Super-resolution Algorithm for Remote Sensing Images based on Data Enhancement and Generative Adversarial Networks
DOI:
https://doi.org/10.54097/fcis.v4i2.9856Keywords:
Data Enhancement, Super-resolution, Remote Sensing Images, Generative Adversarial NetworksAbstract
In this paper, a new algorithm is proposed to address the problem of excessive errors in current super-resolution algorithms for remote sensing images, which optimizes the processing effect of generative adversarial networks by increasing the type and size of training data with data enhancement techniques. First, the algorithm constructs a more reasonable degradation model for the problem of lacking data sets of paired images, and randomly mixes and washes the degraded prior knowledge (such as blur, noise, downsampling, etc.) in the imaging process to simulate the generation process of low-resolution remote sensing images in natural scenes, and generates realistic low-resolution images for training; meanwhile, the algorithm uses ResNet34 and CNN as the basis to enhance the texture details of remote sensing images, thus richer features can be extracted from the images. The results of experiments conducted on the Alsat2 B real dataset show that the method reduces the time and cost required for sample data acquisition, optimizes the processing speed, enhances the temporal and spatial resolution of remote sensing images, and improves the effect of super-resolution processing.
Downloads
References
DONG C,LOY C C,HE K, et al. Learning a Deep Convolutional Network for Image Super-Resolution [C]// LNCS 8692: Proceedings of the 13th European Conference on Computer Vision, Zurich,Sep 6-12,2014.Cham:Springer, 2014: 184-199.
KIM J, LEE J K, LEE K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, Jun 27-30,2016.Washington:IEEE Computer Society,2016:1646-1654.
HE K, ZHANG X,REN S,et al.Deep residual learning for image recognition [C]// Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, LasVegas, Jun 27-30, 2016.Washington: IEEE Computer Society, 2016: 770-778.
GOODFELLOW I,POUGET-ABADIE J,MIRZA M, et al. Generative Adversarial Networks[C]//Proceedings of the Annual Conference on Neural Information Processing Systems 2014,Montreal,Dec 8-13,2014.Red Hook:Curran Associates, 2014: 2672-2680.
LEDIG C,THEIS L,HUSZAR F,et al.Photo-realistic single image super-resolution using a generative adversarial network [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition,2017:4681-4690.
VU T,LUU T M,YOO C D. Perception-enhanced image super-resolution via relativistic generative adversarial networks [C]// LNCS 11133:Proceedings of the 15th European Conference on Computer Vision,Munich,Sep 8-14, 2018. Cham: Springer, 2018: 98-113.
ZHANG K, LIANG J Y,GOOL L V,et al.Blind Image Super-Resolution[EB/OL].(2021-03-25)[2021-07-06]. https:// arxiv. org/ abs/2103.14006.
GAO G, ZHANG J,LV X M,et al.Analysis of Multiplicative Noise Models in SAR Imagery[J].Signal Precessing,2008, 24 (2): 161-167.
SEFI B K, ASSAF S,MICHAL I.Blind super-resolution kernel estimation using an internal-gan[C]//Advances in Neural Information Processing Systems.2019:284-293.
GU J J, LU H N,ZUO W M, et a1.Blind Super-Resolution With Iterative Kernel Correction[C]//Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2019
ZHANG N, WANG Y C,ZHANG X,et a1.A Multi- Degradation Aided Method for Unsupervised Remote Sensing Image Super-Resolution With Convolution Neural Networks [J]. IEEE Transactions on Geoscience and Remote Sensing, 2020.
ZHU X, TALEBI H,SHI X W,et a1.Super-resolution commercial satellite imagery using realistic training data[C]// International Conference on Image Processing. IEEE, 2020: 498-502.