Studies Advanced in Image Style Transfer based on Deep Learning
DOI:
https://doi.org/10.54097/hset.v39i.6754Keywords:
Image Style Transfer; Deep Learning; GAN.Abstract
Image style transfer (IST) is a hot topic in the computer vision community, which refers to learning the distribution of a given style image to convert any image into corresponding image style while the content of the original image is preserved as much as possible. Early style transfer mainly utilizes texture features. Thanks to the great improvement of deep learning technology, researches on IST based on convolutional neural networks (CNN) have achieved breakthroughs in accuracy and speed. Focusing on the topic of deep learning-based IST, we will introduce the latest algorithms in detail, including their basic ideas, key steps, advantages, and disadvantages. Also, we will give an analysis of the performance of representative methods. Furthermore, we discuss the problems to be solved in style transfer and summarize the challenges and development trends in the future.
Downloads
References
Efros A A, Freeman W T. Image quilting for texture synthesis and transfer[C]//Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 2001: 341-346.
Hertzmann A, Jacobs C E, Oliver N, et al. Image analogies[C]//Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 2001: 327-340.
Ashikhmin, N. (2003). Fast texture transfer. IEEE Computer Graphics and Applications, 23(4), 38-43.
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016). Image style transfer using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2414-2423).
Li Chuan, Wand M. Combining Markov random fields and convolutional neural networks for image synthesis [C]// Proc of IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ: IEEE Press,2016: 2479-2486.
Nikulin Y, Novak R. Exploring the neural algorithm of artistic style[J]. arXiv preprint arXiv:1602.07188, 2016.
Li Y, Wang N, Liu J, et al. Demystifying neural style transfer[J]. arXiv preprint arXiv:1701.01036, 2017.
Risser E, Wilmot P, Barnes C. Stable and controllable neural texture synthesis and style transfer using histogram losses[J]. arXiv preprint arXiv:1701.08893, 2017.
Li Chuan, Wand M. Combining Markov random fields and convolutional neural networks for image synthesis [C]// Proc of IEEE Conference on Computer Vision and Pattern Recognition, Piscataway, NJ: IEEE Press, 2016: 2479-2486.
Liao J, Yao Y, Yuan L, et al. Visual attribute transfer through deep image analogy[J]. arXiv preprint arXiv: 1705.01088, 2017.
Bao F, Neumann M, Vu N T. CycleGAN-Based Emotion Style Transfer as Data Augmentation for Speech Emotion Recognition[C]//INTERSPEECH. 2019: 2828-2832.
Johnson J, Alahi A, Fei-Fei L. Perceptual losses for real-time style transfer and super-resolution [C]// European conference on computer vision. Springer, Cham, 2016: 694-711.
Dumoulin V, Shlens J, Kudlur M. A learned representation for artistic style[J]. arXiv preprint arXiv: 1610. 07629, 2016.
Chen D, Yuan L, Liao J, et al. Stylebank: An explicit representation for neural image style transfer [C]// Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 1897-1906.
Briakou E, Agrawal S, Zhang K, et al. A Review of Human Evaluation for Style Transfer, 10.18653/ v1/ 2021.gem-1.6[P]. 2021.
Yin R . Content Aware Neural Style Transfer:, 10.48550/arXiv.1601.04568[P]. 2016.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
