Research on Video Synopsis Based on Deep Learning Target Detection and Target Trajectory Optimization

Authors

  • Yue Liu
  • Li Luo
  • Weibin Hong

DOI:

https://doi.org/10.54097/fcis.v3i2.7702

Keywords:

Monitoring video synopsis, Target detection, Deep learning, Track extraction, Trajectory optimization

Abstract

 In this era of rapid economic and technological development, monitoring is essential for security issues. However, it is also accompanied by the low efficiency of managing and viewing a large number of surveillance videos every day. Traditional methods are gradually unable to meet the requirements of application, and the video field requires algorithm technology that can better solve practical problems. Intelligent monitoring technology is gradually emerging and developing, based on theories such as computer vision, which can solve many monitoring video problems and greatly improve the efficiency of monitoring video work. Through in-depth exploration of existing video synopsis technology algorithms, this article proposes a new video synopsis method that can effectively detect and track videos, thereby greatly improving the efficiency of storage, transmission, and use of surveillance videos. Experiments have shown that this method can effectively concentrate surveillance videos, and compared with existing methods, it has a better synopsis ratio while ensuring the integrity of video information, effectively reducing collisions between targets, effectively reducing overlap between targets, and achieving good visual effects. Utilizing an improved deep learning object detection and multi object tracking algorithm with added attention mechanism to extract foreground moving targets in videos, and using a mixed Gaussian background modeling algorithm establish a background, laying a stable target foundation for subsequent video concentration. At the same time, design trajectory recombination optimization methods to ensure that the targets do not overlap as much as possible. Reasonably place the targets in the new condensed video sequence, determine the index of all targets in the new condensed video stream, and finally integrate each frame of target images into the background image according to the set index rules, ultimately obtaining the synopsis video.

Downloads

Download data is not yet available.

References

Jian Rong Cao,Yang Xu,Cai Yun Liu. Algorithm of Surveillance Video Synopsis Based on Objects[J]. Applied Mechanics and Materials,2013,2388(321-324).

Michael G. Christel,Michael A. Smith,C. Roy Taylor,David B. Winkler. Evolving video skims into useful multimedia abstractions[P]. Human Factors in Computing Systems,1998.

HUANG X,ZHOU J,LIU B. Moving targets detection approach based on adaptive mixture Gaussian background node[J].Journal of Computer Applications,2010,30(1):128-131.

Joseph Redmon,Santosh Kumar Divvala,Ross B. Girshick,Ali Farhadi. You Only Look Once: Unified, Real-Time Object Detection.[J]. CoRR,2015,abs/1506.02640.

Luo Yu,Zhang Yifan,Sun Xize,Dai Hengwei,Chen Xiaohui. Intelligent Solutions in Chest Abnormality Detection Based on YOLOv5 and ResNet50.[J]. Journal of healthcare engineering,2021,2021.

Jie Yang,Leonidas LilianAsimwe,Mumtaz Farhan,Ali Munsif. Ship Detection and Tracking in Inland Waterways Using Improved YOLOv3 and Deep SORT[J]. Symmetry,2021,13(2).

Thirumalaiah G.,Pandian S. Immanuel Alex. An Optimized Novel Technique for Video Synopsis Using Bayesian Object Tracking Algorithm[J]. Journal of Computational and Theoretical Nanoscience,2020,17(11).

P erez, M. Gangnet, and A. Blake. Poisson image editing. In ACM Transactions on graphics (TOG), volume 22, pages 313–318. ACM, 2003.

Tian Cai,Zhe Lin. A Method for synopsis Surveillance Video Abstracts by Integrating Deep Learning Target Recognition [J]. Modern computers,2020(24):49-53.

Lin Zhang. Research on Video Synopsis Technology Based on Adaptive Tracking Evaluation Mechanism [D]. Shandong University,2017.

Chao Cong. Surveillance video summarization algorithm based on dynamic programming and fill density [J]. Computer Engineering,2018,44(07):250-258.DOI:10.19678/j.issn.1000-3428.0047716.

Downloads

Published

18-04-2023

Issue

Section

Articles

How to Cite

Liu, Y., Luo, L., & Hong, W. (2023). Research on Video Synopsis Based on Deep Learning Target Detection and Target Trajectory Optimization. Frontiers in Computing and Intelligent Systems, 3(2), 147-152. https://doi.org/10.54097/fcis.v3i2.7702