Video-based Student Classroom Classroom Behavior State Analysis


  • Yinggan Cheng



Education, Classroom behavioral states, Video images, Computer vision technology, Instructional feedback.


Looking back on the development of education, education has evolved along with the development of human society, and the development of science and technology has been the fundamental force driving the change of education. And with the increasing demand for personalized education for students, the focus of education and teaching has gradually shifted to the direction of personalization and specialization of students. In the teaching process, students' classroom behavior is an important reference indicator for evaluating students' classroom learning, but teachers cannot pay attention to each student's classroom behavior in time, and can only derive students' classroom learning status from their homework or exams. Many subjective factors can easily affect teachers' judgment of students' learning status, and the evaluation obtained is not always comprehensive and objective enough. In traditional teaching activities, teachers mainly identify and control students' classroom videos manually, but this method is not only time-consuming and labor-intensive, but also affects teachers' classroom quality. Therefore, it is urgent to study an intelligent and effective system for analyzing students' classroom behavior status. It is of great significance to improve the quality of students' classroom learning and to assist teachers in obtaining teaching feedback information. At present, the rapid development of artificial intelligence is reshaping the world's industrial ecology and pushing human society into the era of intelligence. Artificial intelligence is deeply integrating with education and promoting innovation in educational philosophy, teaching methods and management modes, and is expected to lead systematic changes in education. In fact, the development of artificial intelligence technology cannot be separated from the continuous research of computer vision technology. How to make the computer obtain external information through video acquisition device to simulate human for analysis and recognition is the main research content of computer vision technology, and its research direction includes target tracking, object recognition, human behavior recognition, etc. In this paper, through the combination of artificial intelligence technology and computer vision technology, we analyze the video images of students' classes in classroom scenes, identify students' classroom behavior status, build a judgment system on students' classroom learning status, and assist teachers to obtain teaching feedback information.


Download data is not yet available.


Xia Shihong. Three-dimensional human motion simulation and video analysis system for sports training [J]. High Technology and Industrialization, 2008(09): 28.

Ma Yuxi, Tan Li, Dong Xu, Yu Chongzhong. Behavior recognition for intelligent surveillance [J]. Chinese Journal of Graphic Graphics, 2019, 24(02): 282-290.

Lu, Zhujun, Li, Jile, Liang, Satellite, Chen, Pingping. Research on 3D medical image assisted diagnosis and treatment system based on Kinect[J]. Software Guide, 2015,14(01):143-145.

Cai Hai Zhou. Research and application of classroom human behavior recognition based on spatio-temporal interest points [D]. Master's thesis (Nanjing Normal University), 2014.

Yang Yuanbo. Key technology research on student classroom behavior video observation recording system [D]. Master's thesis (National University of Defense Technology), 2015.

Rish I. An empirical study of the naive Bayes classifier [J]. Journal of UniversalComputer Science, 2001, 1(2):127.

Dongli Dang. Human behavior recognition and its application in educational recording system [D]. Master's thesis (Xi'an University of Science and Technology), 2017.

Zhou Pengxiao, Deng Wei, Guo Cultivation, et al. Research on intelligent recognition of S-T behaviors in classroom teaching videos[J]. Modern Educational Technology, 2018, 028(006):54-59.

Jia D, Wei D, Socher R, et al. ImageNet: A large-scale hierarchical imagedatabase[C]. 2009 IEEE Conference on Computer Vision and Pattern Recognition,Miami, 20-25 June 2009, 248-255.

Simonyan K, Zisserman A. Very Deep Convolutional Networks for Large-ScaleImage Reconginitional[J]. ar Xiv preprint ar Xiv:1409.1556, 2015:1-14.[11] Liao P, Liu C M, Su H, et al. A deep learning-based system for detecting and analyzing students' abnormal classroom behaviors[J]. E-World, 2018, 000(008):97-98.

Ren S, He K, Girshick R, et al. Faster R-CNN: Towards Real-Time ObjectDetection with Region Proposal Networks [J]. IEEE Transactions on PatternAnalysis and Machine Intelligence, 2017, 39(6):1137-1149.

Tan B, Yang S. Enthalpy. Research on student classroom behavior detection algorithm based on FasterR-CNN [J]. Modern Computer:Professional Edition, 2018(33):47-49.

Redmon J, Farhadi A. Yolov3: An Incremental Improvement [J]. ar Xiv preprintar Xiv:1804.02767, 2018:1-6.

He K, Zhang X, Ren S, et al. Deep Residual Learning for Image Recognition [C].2016 IEEE Conference on Computer Vision and Pattern Recognition, LasVegas,27-30 June 2016, 770-778.

Qin Daoying. Student classroom behavior recognition based on deep learning [D]. Master's thesis (Huazhong Normal University), 2019.

Gong Wei. Design and implementation of a student learning behavior recognition system based on skeletal key point detection [D]. Master's thesis (Jilin University), 2019.

Ji Chongxiao. Research on classroom behavior recognition method based on digital image processing [D]. Master's thesis (Taiyuan University of Technology), 2019.

Qinyi Jiang, Yewen Zhang, Siqi Tan, et al. Student classroom behavior identification based on residual network [J]. Modern Computer (Professional Edition), 2019, 000(020):23-27. 2021 Master's Degree Thesis, Guizhou University for Nationalities

Lin Chan-Ran, Xu Wei-Liang, Li Yi. An investigation of classroom student behavior recognition techniques based on multimodal data [J]. Modern Computing, 2020, 678(06):70-76.

Zhang J. Research and implementation of a head-up rate detection system for university classrooms [D]. Master's thesis (HuaUniversity of Science and Technology of China), 2018.

Redmon J, Divvala S, Girshick R, et al. You Only Look Once: Unified, Real-TimeObject Detection[C]. 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 779-788.

Hsu C W, Lin C J. A Comparison of Methods for Multiclass Support Vector Machines[J]. IEEE Transactions on Netural Networks, 2002, 13(2):415-425.

Jia, Oriyo, Zhang, Zhao, Zhao, Xiaoyan, et al. Classroom student state analysis based on artificial intelligence video processing[J]. Modern Educational Technology, 2019, 224(12):83-89.

F Schroff, Kalenichenko D, Philbin J . FaceNet: A Unified Embedding for Face Recognition and Clustering[C]. 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, 7-12 June 2015, 815-823.

Zhang Shuangxi. Research and application of face recognition and concentration discrimination method based on deep learning [D]. Master's Degree Dissertation (Nanjing Normal University), 2019.

Chang W Y, Hsu S H, Chien J H. FATAUVA-Net: An integrated deep learning [C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, 21-26 July 2017, 1963-1971.

Guo Xiaoxu. Research on a classroom concentration analysis system based on micro-expression recognition for students [D]. Master's thesis. (Yunnan Normal University), 2019.

Zhang K, Zhang Z, Li Z, et al. Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks[J]. IEEE Signal Processing Letters, 2016, 23(10):1499-1503.

Kalal Z, Mikolajczyk K, Matas J. Forward-backward error: automatic detection of tracking failures[C]. 20th International Conference on Pattern Recognition, Istanbul, Turkey, 23-26 August 2010, 2756-2759.

Li Furong. Multi-feature fusion student fatigue detection based on MTCNN [J]. Information Technology, 2020,044(006):108-113, 120.



27 October 2022




How to Cite

Cheng, Y. (2022). Video-based Student Classroom Classroom Behavior State Analysis. International Journal of Education and Humanities, 5(2), 229-233.

Similar Articles

1-10 of 1004

You may also start an advanced similarity search for this article.