Research on Deep Learning-based Group Recognition

Authors

  • Songchen Xu

DOI:

https://doi.org/10.54097/55emqr27

Keywords:

group recognition, deep learning, convolutional neural network, recurrent neural network.

Abstract

The task of group recognition is a process of automatically recognizing and analyzing individuals or groups from a large population using computer vision and machine learning techniques. Currently, the main methods for group recognition using deep networks can be divided into four categories: methods based on convolutional neural networks (CNN), methods based on recurrent neural networks (RNN), combined CNN-RNN-based methods, as well as pose analysis methods. This article specifically analyzes these four categories of methods: CNN-based, RNN-based, and pose analysis, and summarizes the characteristics and functions of iterative deep learning models, graph convolutional network models, long short-term memory models, pose models, and skeleton models. In addition, a detailed introduction to commonly used datasets in group recognition is provided, and the main evaluation metrics are analyzed. Finally, important research directions in group recognition are discussed, followed by a conclusion of the entire article.

Downloads

Download data is not yet available.

References

Wei, Qingdi, et al. Group Action Recognition Using Space-Time Interest Points. State Key Laboratory of Pattern Recognition, 2009, 1 - 11.

Yin, Yafeng, et al. Small group human activity recognition. IEEE International Conference on Image Processing, 2013, 1 - 13.

Zhao, Fang, et al. Relevance Topic Model for Unstructured Social Group Activity Recognition. 2013, 2580 - 2588.

Zaidenberg, Sofia, B. Boulay, and F. Bremond. A Generic Framework for Video Understanding Applied to Group Behavior Recognition. IEEE 2012.

Shah, Syed Afaq Ali, M. Bennamoun, F. Boussaid. Iterative deep learning for image set based face and object recognition. Neurocomputing 174. JAN. 22PT.B, 2016: 866 - 874.

Azar, Sina Mokhtar Zadeh, M. G. Atigh, A. Nickabadi. A Multi-Stream Convolutional Neural Network Framework for Group Activity Recognition, 2018.

Kuang, Zijian, and X. Tie. Improved Actor Relation Graph based Group Activity Recognition, 2020.

Bellot, Rotimi Williams, et al. Behavior Recognition of Group-ranched Cattle from Video Sequences using Deep Learning. Indian Journal of Animal Research, 2022 4: 56.

Deng, Zhiwei, et al. Deep Structured Models for Group Activity Recognition. arXiv 2015.

Liu, Tianshan, et al. Visual-semantic graph neural network with pose-position attentive learning for group activity recognition. Neurocomputing 2022, 491: 217 - 231.

Ibrahim, Moustafa, et al. A Hierarchical Deep Temporal Model for Group Activity Recognition., 10.48550/arXiv.1511.06040. 2015.

A, S. A. Vahora, and N. C. C. B. Deep neural network model for group activity recognition using contextual relationship. Engineering Science and Technology, an International Journal 2019, 22. 1:47 - 54.

Deng, Zhiwei, et al. Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition. Neurocomputing, 2016.

A, Rudy Cahyadi H. P, J. F. B, and H. K. P. A. Group Behavior Recognition Based on Dictionary and Hierarchical Learning. Procedia Computer Science 2018, 144: 52 - 59.

Wang, Chunyu, Yizhou Wang, and Alan L. Yuille. An approach to pose-based action recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 2013.

Huang, Zhiwu, et al. Deep Learning on Lie Groups for Skeleton-based Action Recognition. IEEE Computer Society, 2016.

Agahian, Saeid, Farhood Negin, and Cemal Köse. An efficient human action recognition framework with pose-based spatiotemporal features. Engineering Science and Technology, an International Journal 2020, 23.1: 196 - 203.

Angelini, Federico, et al. 2D pose-based real-time human action recognition with occlusion-handling. IEEE Transactions on Multimedia 2019, 22.6: 1433 - 1446.

Li, Chuankun, et al. A two-stream neural network for pose-based hand gesture recognition. IEEE Transactions on Cognitive and Developmental Systems 2021, 14.4: 1594 - 1603.

Downloads

Published

15-12-2023