Kinship Verification Method of Face Image Deep Feature Fusion
DOI:
https://doi.org/10.54097/ajst.v5i1.5348Keywords:
Kinship verification, ResNet50, Vision Transformers, Siamese neural network, Deep learning.Abstract
Kinship verification is an important and challenging problem in computer vision. How to extract discriminative features is the key to improve the accuracy of kinship verification. At present, convolutional neural networks (CNNs) for feature extraction in the field of computer vision has achieved remarkable success, making it the most scholars used to study kinship verification related issues. However, few people use the self-attention mechanism with global capture capability to build a backbone feature classification network. Therefore, this paper proposes a backbone feature extraction network model based on a non-convolution, which expands the selection range of traditional classification networks for kinship verification related issues. Specifically, the paper proposes to use Vision Transformers as the basic backbone feature extraction network, combined with CNN with local attention mechanism, to provide a unique integrated solution in kinship verification. The proposed GLANet model is used for kinship verification and can verify 11 kinship pairs. The final experimental results show that in the FIW dataset, compared with the RFIW2020 challenge leading method, the proposed method has better verification effect in kinship, and the accuracy rate can reach 79.6 %.
Downloads
References
DeBruine L M, Smith F G, Jones B C, et al. Kin recognition signals in adult faces[J]. Vision research, 2009, 49(1): 38-43.
Fang R,Tang K D,Snavely N,et al.Towards computational models of kinship verification[C]//2010 IEEE International conference on image processing. IEEE, 2010: 1577-1580.
YAN H,LU J,DENG W,et al.Discriminative multimetric learning for kinship verification[J].IEEE Transactions on Information Forensics and Security,2014,9(7): 1169-1178.
ZHOU X Z,JIN K,XU M,et al. Learning Deep Compact Similarity Metric for Kinship Verification from Face Images [J]. Information Fusion,2019,48:84-94.
LU J,ZHOU X,TAN Y P,et al.Neighborhood repulsed metric learning for kinship verification[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014,36(2):331-345.
Dornaika F, Arganda-Carreras I, Serradilla O. Transfer learning and feature fusion for kinship verification[J]. Neural Computing and Applications, 2020, 32(11): 7139-7151.
Robinson J P, Yin Y, Khan Z, et al. Recognizing families in the wild (RFIW): The 4th edition[C]//2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020). IEEE, 2020: 857-862.
Dahan E, Keller Y. A unified approach to kinship verification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 43(8): 2851-2857.
Wang W, Xie E, Li X, et al. Pyramid vision transformer: A versatile backbone for dense prediction without convolutions[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021: 568-578.
He K, Zhang X, Ren S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 770-778.
Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16x16 words: Transformers for image recognition at scale[J]. arXiv preprint arXiv:2010.11929, 2020.
Deng J, Dong W, Socher R, et al. Imagenet: A large-scale hierarchical image database[C]//2009 IEEE conference on computer vision and pattern recognition. Ieee, 2009: 248-255.
De Boer P T, Kroese D P, Mannor S, et al. A tutorial on the cross-entropy method[J]. Annals of operations research, 2005, 134(1): 19-67.
Wen Y, Zhang K, Li Z, et al. A discriminative feature learning approach for deep face recognition[C]//European conference on computer vision. Springer, Cham, 2016: 499-515.
Robinson J P, Shao M, Wu Y, et al. Visual kinship recognition of families in the wild[J]. IEEE Transactions on pattern analysis and machine intelligence, 2018, 40(11): 2624-2637.
