A Research of Data Representation, Event-Based Vision and Hardware Implementation

Hanze Jin

doi:10.54097/ry9t1148

Authors

Hanze Jin School of Electrical Engineering and Information Technology, RWTH Aachen University, Aachen, Germany

DOI:

https://doi.org/10.54097/ry9t1148

Keywords:

High-Speed Object Tracking, Event-Based Vision, Event based Cameras.

Abstract

The high-speed object tracking is not only a problem of tracking fast-moving targets, but also a system-level challenge involving visual sensing, data representation, motion modeling, target association, and hardware implementation. This paper reviews object-recognition-driven methods for high-speed object tracking, with a focus on data representation, motion information extraction, event-based vision, and hardware system design. First, frame-based image sequences, optical flow, and event streams are compared in terms of their ability to represent target motion under high-speed conditions. Then, traditional motion cues, deep representation methods, and lightweight event-driven features are discussed from the perspectives of robustness, real-time performance, and deployability. The paper further analyzes the role of high-speed visual sensors, event cameras, FPGAs, and hardware–software co-design in practical tracking systems. Existing studies show that event-based vision and dedicated hardware acceleration can reduce redundant computation and improve temporal response, but stable association, resource efficiency, and real-world deployment remain open challenges. This review argues that future high-speed tracking systems should be developed through the co-design of sensors, algorithms, and hardware architectures.

References

[1] Lu H., Li P., Wang D. Review of object tracking algorithms. Pattern Recognition and Artificial Intelligence, 2018, 31(1): 61-76.

[2] Huang K., Chen X., Kang Y., et al. Review of intelligent video surveillance technology. Chinese Journal of Computers, 2015, 38(6): 1093-1118.

[3] Zhang Y., Lv H., Zhao Y., et al. Event-based optical flow estimation with spatio-temporal backpropagation trained spiking neural network. Micromachines, 2023, 14(1): 203.

[4] Du Y., Zhao Z., Song Y., et al. StrongSORT: Make DeepSORT great again. IEEE Transactions on Multimedia, 2023, 25: 8725-8743.

[5] Duarte L., Safeea M., Neto P. Event-based tracking of human hands. Sensor Review, 2021, 41(4): 382-389.

[6] Kryjak T. Event-based vision on FPGAs: A survey. arXiv preprint arXiv:2407.08356, 2024.

[7] Gallego G., Delbruck T., Orchard G., et al. Event-based vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(1): 154-180.

[8] Gao Y., Wang S., So H.K.H. A reconfigurable architecture for real-time event-based multi-object tracking. ACM Transactions on Reconfigurable Technology and Systems, 2023, 16(4): Article 58.

[9] Yilmaz A., Javed O., Shah M. Object tracking: A survey. ACM Computing Surveys, 2006, 38(4): Article 13.

[10] Luo W., Xing J., Milan A., Zhang X., Liu W., Kim T.K. Multiple object tracking: A literature review. Artificial Intelligence, 2021, 293: 103448.

[11] Ciaparrone G., Sánchez F.L., Tabik S., Troiano L., Tagliaferri R., Herrera F. Deep learning in video multi-object tracking: A survey. Neurocomputing, 2020, 381: 61-88.

[12] Chen F., Wang X., Zhao Y., Lv X., Tang X., Niu X., Huang Q., Wu B. Visual object tracking: A survey. Computer Vision and Image Understanding, 2022, 222: 103508.

[13] Sali S.M., Meribout M., Abdul Majeed A. Real-time FPGA-based CNNs for detection, classification, and tracking in autonomous systems: State-of-the-art designs and optimizations.

[14] Xiong W., Zhang J., Zhu X., et al. A high-performance and resource-efficient FPGA-based multi-object tracking system using event cameras. In 2025 35th International Conference on Field-Programmable Logic and Applications, 2025.