Studies Advanced in Image Super-resolution Reconstruction based on Deep Learning
DOI:
https://doi.org/10.54097/hset.v39i.6759Keywords:
Image Super-resolution Reconstruction; GAN; Deep Learning.Abstract
Image super-resolution reconstruction (SR) has always been a research hotspot in the computer vision community, whose purpose is to convert low-resolution (LR) images into high-resolution (HR) images by algorithms without changing the hardware. Early SR works were mainly based on manual features and mathematical statistical models, relying on interpolation to achieve high-resolution image reconstruction. Thanks to the rapid development of convolutional neural networks, SR based on deep learning has achieved breakthroughs in both accuracy and speed. This paper first introduces the basic principles of image super-resolution reconstruction, including the basic framework and loss function of SR. Then, we introduce the representative super-resolution reconstruction methods such as SRCNN, SRGAN, and TTSR. We also introduce the common public datasets and evaluation indexes, and compare the performance of several SR methods to analyze their advantages and disadvantages. Finally, we summarize the existing challenges in the image super-resolution reconstruction, and give a look out for the future development direction of SR.
Downloads
References
Yuan QQ, Li Y, Li JC, et al. Remote sensing image super-resolution via regional spatially adaptive total variation model. Proceedings of 2014 IEEE Geoscience and Remote Sensing Symposium. Quebec City: IEEE, 2014. 3073–3076.
ZHANG L P, ZHANG H Y, SHEN H F, et al. A super-resolution reconstruction algorithm for surveillance images [J]. Signal Processing, 2010, 90(3): 848-859.
GREENSPAN H. Super- resolution in medical imaging[J]. The Computer Journal, 2009, 52(1): 43-63.
CHAO D, CHEN C L, HE K M, et al. Learning a deep convolutional network for image super-resolution[C]//LNCS 8692: Proceedings of the 13th European Conference on Computer Vision, Zurich, Sep 6-12, 2014. Cham: Springer, 2014: 184-199.
LEDIG C, THEIS L, HUSZAR F, et al. Photo-realistic single image super-resolution using a generative adversarial network [C]//Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Jul 21-26, 2017. Washington: IEEE Computer Society, 2017: 105-114.
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo; Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 5791-5800.
Huang JB, Singh A, Ahuja N. Single image super-resolution from transformed self-exemplars. Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015. 5197–5206.
Martin D, Fowlkes C, Tal D, et al. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the 8th IEEE International Conference on Computer Vision. Vancouver: IEEE, 2001. 416–423.
Ogawa T, Otsubo A, Narita R, et al. Object detection for comics using Manga109 annotations. arXiv: 1803.08670, 2018.
Arbeláez P, Maire M, Fowlkes C, et al. Contour detection and hierarchical image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(5): 898–916. [doi: 10.1109/ TPAMI. 2010. 161]
Dong C, Loy CC, He KM, et al. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2): 295–307. [doi: 10.1109/ TPAMI. 2015. 2439281]
Tolosana R, Vera-Rodriguez R, Fierrez J, et al. Deepfakes and beyond: A survey of face manipulation and fake detection. Information Fusion, 2020, 64: 131–148. [doi: 10.10 16/j.inffus.2020.06.014]
Agustsson E, Timofte R. NTIRE 2017 challenge on single image super-resolution: Dataset and study. Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu: IEEE, 2017. 1122-1131.
Lim B, Son S, Kim H, et al. Enhanced deep residual networks for single image super-resolution. Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu: IEEE, 2017. 1132-1140.
Almohammad A, Ghinea G. Stego image quality and the reliability of PSNR. Proceedings of the 2010 2nd International Conference on Image Processing Theory, Tools and Applications. Paris: IEEE, 2010. 215-220.
Marabini R, Sorzano COS, Matej S, et al. 3-D reconstruction of 2-D crystals in real space. IEEE Transactions on Image Processing, 2004, 13(4): 549–561. [doi: 10.1109/TIP.2003.82 2620]
Viswanathan M, Viswanathan M. Measuring speech quality for text-to-speech systems: Development and assessment of a modified mean opinion score (MOS) scale. Computer Speech & Language, 2005, 19 (1) 55–83.
WANG X T, YU K, WU S X, et al. ESRGAN: enhanced super- resolution generative adversarial networks [C] // LNCS 11133: Proceedings of the 15th European Conference on Computer Vision Workshops, Munich, Sep 8-14, 2018. Cham: Springer, 2018: 63-79.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
