Summary of Research on Facial Expression Recognition
DOI:
https://doi.org/10.54097/hset.v44i.7200Keywords:
Facial expression, human thinking, human-computer interaction, feature extractionAbstract
Facial expression recognition allows computers to understand expressions according to human thinking. It is an important component of human-computer interaction. However, with the rapid development of deep learning, the research of deep learning technology in the field of facial expressions has also become a research hotspot, so is deep learning. It is necessary to analyze the application of technology in facial expression recognition and the results obtained. Firstly, several commonly used expression data sets are summarized; then the expression recognition methods based on deep learning are classified from the aspects of feature extraction and feature classification, and several network improvements in expression recognition based on deep learning are analyzed from the aspect of network improvement. Method; Finally, the challenges and future development in the field of facial expression recognition are described.
Downloads
References
Shen Lidi. Research on facial expression recognition method combining deep learning and sparse representation [J]. Techniques of Automation and Applications, 2019, 38 (10): 93-97.
Mehrabian A. Communication without words [J]. Psychology Today, 1968, 2(4): 53-56.
EKMAN P, FRIESENWV. Constants across cultures in the face and emotion [J]. Journal of personality and social psychology, 1971, 17(2): 124-129.
SUW A M, SUGIE N, FUJIMORA K. A preliminary note on pattern recognition of human emotion expression [C] //Proceeding of the 4th International Joint Conference on Pattern Recognition, 1978: 408-410
LIU Dong, LI Su, CAO Zhidong. Overview of deep learning and its application in image object classification and detection [J]. Computer science, 2016, 43(12): 13-23.
Wang Zhongmin, Liu Ge, Song Hui. Speech emotion recognition based on multi-core learning feature fusion [J]. Computer Engineering, 2019, 45(8): 248-254.
Cao N T, Ton-That A H. Speech emotion recognition using a fuzzy approach [J]. Journal of Intelligent and Fuzzy Systems: Applications in Engineering and Technology, 2019, 36(2): 1587-1597
Chen Jingxia, Wang Liyan, Jia Xiaoyun, et al. Emotion recognition of EEG signals based on deep convolution neural network [J]. Computer Engineering and Application, 2019, 55 (18): 103-110.
Du Zhaohui, Si Yujuan. Pulse signal emotion recognition based on hierarchical support vector machine[J]. Journal of Jilin University (Information Science Edition), 2017, 35 (1): 37-42.
Momennezhad A. EEG-based emotion recognition utilizing wavelet coefficients [J]. Multimedia Tools and Applications, 2018, 77 (20): 27089-27106.
Zhang Yang, Liu Xiaoxia, Sun Kailong, et al. Research on text tendency recognition based on emotional description [J]. Computer Engineering and Application, 2015, 51(4): 158-161, 195.
Li Yang, Pan Quan, Yang Tao. Sensitive information recognition based on short text sentiment analysis[J]. Journal of Xi’an Jiaotong University, 2016, 50(9): 80-84.
Yan Jingjie, Zheng Wenming, Xin Minghai, et al. Bimodal emotion recognition of expression and gesture [J]. Journal of Image and Graphics, 2013, 18 (9): 1101-1106
ZHOU Wei, CHENG Yong, CAO Xuehong. Face recognition based on illumination normalization and segment-complete LBP feature [J]. Computer engineering and application, 2015, (11): 145-149.
OJALAT, PIETIKINEN M, HARWOODD. A Comparative Study of Texture Measures with Classification Based on Feature Distributions [J]. Pattern Recognition, 1996, 29: 51-59.
WANG Xian, ZHANG Yan, MU Xin, et al. Improved LBP face recognition algorithm [J]. Optoelectronic engineering, 2012, 39 (7): 12-13.
JABIDT, KABIRMH, CHAEO. Robust facial expression recognition based on local directional pattern [J]. ETRI journal, 2010, 32(5): 784-794.
LEETS. Image representation using 2D Gabor wavelets [J]. IEEE transactions on pattern analysis and machine intelligence, 1996, 18(10): 959-971.
WU X G, LUO L M. An improved optical flow field calculation method [J]. Acta electronica sinica, 2000(1): 130-131.
LIEW C F, YAIRI T. Facial expression recognition and analysis: a comparison study of feature descriptors [J]. IPSJ transactions on computer vision and applications, 2015, 7: 104-120.
WANG Xiaohua, XIA Chen, Hu Min, et al. Video sequence facial expression recognition with spatio-temporal features [J]. Journal of electronics and information, 2018, 40(3): 626-632.
FENG Xiaorong, HUI Kang-hua, LIU Zhendong. Face recognition based on convolution feature and Bayesian classifier [J]. Journal of intelligent systems, 2018, 13(5): 769-775.
XIA Tian, ZHANG Yifeng, LIU Yuan. Expression recognition based on feature points and multi-network training [J]. Journal of computer aided design and graphics, 2019, 31(4): 552-559.
HOCHREITER S, SCHMIDHUBER J. Long short-term memory [J]. Neural Computation, 1997, 9(8): 1735-1780.
YU Z, LIU G, LIU Q, et al. Deng, Spatio - temporal convolutional features with nested lstm for facial expression recognition [J]. Neuro computing, 2018, 317: 50-57.
YAO A, CAI D, HU P, et al. HoloNet: towards robust emotion recognition in the wild [C]//The 18th ACM International Conference. ACM, 2016: 472-478.
ZHANG Z, LUO P, LOY C C, et al. From Facial Expression Recognition to Interpersonal Relation Prediction [J]. International Journal of Computer Vision, 2018, 126(5): 1-20.
KAHOU S E, BOUTHILLIER X, LAMBLIN P, et al. Emonets: Multimodal deep learning approaches for emotion recognition in video [J]. Journal on Multimodal User Interfaces, 2016, 10(2): 99-111.
YU Z, LIU Q, LIU G. Deeper cascaded peak - piloted network forweak expression recognition [J]. The Visual Computer, 2017 (6-8): 1-9.
SUN Ning, et al. Deep spatial-temporal feature fusion for facial expression recognition in static images [J]. Pattern Recognition Letters, 2017, (119): 49-61.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
