Cross-age face synthesis based on conditional adversarial autoencoder

Authors

  • Yifan Yan
  • Weiwei Yu

DOI:

https://doi.org/10.54097/fcis.v3i1.6026

Keywords:

Face aging, Generative adversarial networks, Conditional adversarial autoencoder, Deep learning, Multi-scale discriminator

Abstract

Face aging aims to render face images with desired age attribute. It has tremendous impact to a wide-range of applications, e.g., criminal investigation, entertainment. The rapid development of generative adversarial networks (GANs) has shown impressive results in face aging. Among them, the Conditional Adversarial Autoencoder (CAAE) proposed in 2017 has achieved good results in face aging. However, the generated faces still have the problems that the aging features are not obvious and the identity information are not well maintained. In addition, research have shown that the human aging process is affected by genes. Different races have different external characteristics of aging. However, the current research does not take the racial factor into account, ignores the racial differences in the aging process. It affects the accuracy of transformation. To solve the above problems, this paper proposes a cross-age face synthesis based on conditional adversarial autoencoder: First, a conditional adversarial autoencoder is used as the infrastructure to build a cross-age face synthesis model based on race constraints. Secondly, the discriminator is composed of a discriminant network and a classification network, and a category loss function is designed to generate a real face that matches the target age; Finally, the model uses a identity feature extractor and a discriminator of the multi-scale architecture. Through multi-level discrimination from pixel values to high-level semantic information, the loss of personal identity features is minimized. UTKFace and MegaAge-Asian datasets are used in the experiment. Three comparative experiments are designed for the above improvements. The results show that the racial constraints make the generated images effectively maintain the racial characteristics, such as skin color and texture; The classification function of the discriminator improves the aging effect; The design of the multi-scale discriminator enables the generated face to have more stable local structure and identity information. Through qualitative and quantitative analysis, it is shown that this method has higher aging accuracy and identity retention than the CAAE method.

Downloads

Download data is not yet available.

References

Wu Y, Kalra P, Moccozet L, et al. Simulating wrinkles and skin aging[J]. VisualComputer, 1999, 15(4):183-198.

Sadick N S, Karcher C, Palmisano L. Cosmetic dermatology of the aging face[J]. Clinics in Dermatology, 2009, 27(3-supp-S).

Suo J, Zhu S C, Shan S, et al. A compositional and dynamic model for face aging[J]. IEEE Transactions on Pattern Anal-ysis and Machine Intelligence, 2009, 32(3): 385-401.

Burt D M, Perrett D I. Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information[J]. Proc Biol Sci, 1995, 259(1355):137-143.

Kemelmacher-Shlizerman I , Suwajanakorn S , Seitz S M . Illumination-Aware Age Progression[J]. Proceedings / CVPR, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2014.

WANG W, CUI Z, Yan Y, et al. Recurrent Face Aging[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE Press, 2016: 2378-2386.

Goodfellow I, Pouget-Abadie J, Mirza M, et al. Generative adversarial nets[C]//Advances in neural information processing systems. 2014: 2672-2680.

Wang Z, Tang X, Luo W, et al. Face Aging with Identity-Preserved Conditional Generative Adversarial Networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018: 7939-7947.

Zhang Z, Song Y, Qi H. Age progression/regression by conditional adversarial autoencoder[C]. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 5810-5818.

Simonyan K, Zisserman A. Very deep convolutional net-works for large-scale image recognition[J]. arXiv preprint arXiv:1409.1556, 2014.

SONG H Z,WU X J. High-quality image generation model for face aging / processing[J]. Journal of Image and Graphics. 2019,24(04):592-602. 10.19678/j.issn.1000-3428.0062018

Berthelot D , Schumm T , Metz L . BEGAN: Boundary Equilibrium Generative Adversarial Networks[J]. arXiv, 2017.

CHENG Z K,SUN R,SUN Q J,ZHANG X D. Cross-age face synthesis based on conditional adversarial autoencoder[J/OL]. Computer Engineering:1-13[2022-0428].

https://doi.org/10.19678/j.issn.1000-3428.0062018.

ZHANG J Q. Face Aging and Rejuvenation Based on Generative Adversarial Network[D]. University of Electronic Science and Technology of China,2021.

Qawaqneh Z, Mallouh A A, Barkana B D. Deep convolutional neural network for age estimation based on VGG-face model[EB/OL].[20180423].

MAKHZANI A, SHLENS J, JAITLY N, et al. Adversarial autoencoders [EB/OL]. (2015-11-18)[ 2021-06-06]

Mirza M, Osindero S. Conditional generative adversarial nets[J]. ar Xivpreprint ar Xiv:1411.1784, 2014.

The effect of age on skin color and color heterogeneity in four ethnic groups[J]. Skin Research & Technology, 2010, 16(2):168-178.

Venkatesh S , Maymone M , Vashi N A . Aging in Skin of Color[J]. Clinics in Dermatology, 2019, 37(4):351-357.

Vashi NA, de Castro Maymone MB, Kundu RV. Aging Differences in Ethnic Skin. J Clin Aesthet Dermatol. 2016 Jan;9(1):31-8.

Zhang Z, Song Y, Qi H. Age progression/regression by conditional adversarial autoencoder[C]. Proceedings of the IEEE conference on computer vision and pattern recognition. 2017:4352-4360

Yunxuan Zhang, Li Liu, Cheng Li, Chen Change Loy. Quantifying Facial Age by Posterior of Age Comparisons, In British Machine Vision Conference (BMVC), 2017.

KINGMA D P, BA J. ADAM: A method for stochastic optimization. [J]. Computer Science, 2014.

DONG L Y. Research on the synthesis of face aging combined with age estimation[D]. Shanghai Normal University.2021

Face++ research toolkit. https://www.faceplusplus.com/.

Downloads

Published

17-03-2023

Issue

Section

Articles

How to Cite

Yan, Y., & Yu, W. (2023). Cross-age face synthesis based on conditional adversarial autoencoder. Frontiers in Computing and Intelligent Systems, 3(1), 65-71. https://doi.org/10.54097/fcis.v3i1.6026