A novel approach for visual tracking based on occlusion recognition
DOI:
https://doi.org/10.54097/hset.v7i.1027Keywords:
Visual tracking, Correlation filter, Occlusion recognition, Local-global correlationAbstract
Visual object tracking is an extremely challenging task. Many existing trackers cannot handle various challenges simultaneously. In this paper, we propose a novel tracking framework based on an occlusion recognition mechanism to improve the performance in occlusion situations. Firstly, we design an occlusion recognition mechanism based on patch pool and local correlation to describe the occlusion of objects in each frame of an image sequence. Secondly, taking advantage of the occlusion recognition mechanism, we construct a specific training set to train the filter. Thirdly, combining global correlation, we implement our own tracker based on the traditional discriminative correlation filters. Finally, we evaluate it on both OTB and VOT platforms, and the experimental results demonstrate that our design is advanced and effective.
Downloads
References
B. Babenko, M. Yang and S. Belongie, "Visual tracking with online Multiple Instance Learning," 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 983-990.
L. Bertinetto, J. Valmadre, S. Golodetz, O. Miksik and P. H. S. Torr, "Staple: Complementary Learners for Real-Time Tracking," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1401-1409.
Boeddeker, C., Hanebrink, P., Drude, L., Heymann, J., and Haeb-Umbach, R., "On the computation of complex-valued gradients with application to statistically optimum beamforming." arXiv preprint arXiv:1701.00392 (2017).
D. S. Bolme, J. R. Beveridge, B. A. Draper and Y. M. Lui, "Visual object tracking using adaptive correlation filters," 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, pp. 2544-2550.
M. Danelljan, G. Bhat, F. S. Khan and M. Felsberg, "ECO: Efficient Convolution Operators for Tracking," 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6931-6939.
M. Danelljan, G. Häger, F. S. Khan and M. Felsberg, "Learning Spatially Regularized Correlation Filters for Visual Tracking," 2015 IEEE International Conference on Computer Vision (ICCV), 2015, pp. 4310-4318.
M. Danelljan, G. Häger, F. S. Khan and M. Felsberg, "Accurate scale estimation for robust visual tracking," British Machine Vision Conference, Nottingham, September 1-5, 2014. Bmva Press, 2014.
M. Danelljan, G. Häger, F. S. Khan and M. Felsberg, "Adaptive Decontamination of the Training Set: A Unified Formulation for Discriminative Visual Tracking," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1430-1438.
M. Danelljan, F. S. Khan, M. Felsberg and J. Van De Weijer, "Adaptive Color Attributes for Real-Time Visual Tracking," 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 1090-1097.
Danelljan, M., Robinson, A., Shahbaz Khan, F., & Felsberg, "Beyond correlation filters: Learning continuous convolution operators for visual tracking," In European conference on computer vision (pp. 472-488). Springer, Cham.
H. K. Galoogahi, A. Fagg and S. Lucey, "Learning Background-Aware Correlation Filters for Visual Tracking," 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 1144-1152.
S. Hare, A. Saffari and P. H. S. Torr, "Struck: Structured output tracking with kernels," 2011 International Conference on Computer Vision, 2011, pp. 263-270.
Z. He, S. Yi, Y. -M. Cheung, X. You and Y. Y. Tang, "Robust Object Tracking via Key Patch Sparse Representation," in IEEE Transactions on Cybernetics, vol. 47, no. 2, pp. 354-364, Feb. 2017.
Henriques, J. F., Caseiro, R., Martins, P., & Batista, J, "Exploiting the circulant structure of tracking-by-detection with kernels, " In European conference on computer vision (pp. 702-715). Springer, Berlin, Heidelberg.
J. F. Henriques, R. Caseiro, P. Martins and J. Batista, "High-Speed Tracking with Kernelized Correlation Filters," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 3, pp. 583-596, 1 March 2015.
Javed, S., Danelljan, M., Khan, F. S., Khan, M. H., Felsberg, M., & Matas, J, "Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlook," arXiv preprint arXiv:2112.02838 (2021).
Z. Kalal, K. Mikolajczyk and J. Matas, "Tracking-Learning-Detection," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1409-1422, July 2012.
M. Kristan, J. Matas, A. Leonardis, T. Vojíř, Roman P., Gustavo F., et al., "A Novel Performance Evaluation Methodology for Single-Target Trackers," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 11, pp. 2137-2155, 1 Nov. 2016.
Li, Yang, Zhan Xu, and Jianke Zhu. "CFNN: Correlation Filter Neural Network for Visual Object Tracking," IJCAI. 2017.
Ma, Haoyi, Zongli Lin, and Scott T. Acton, "FAST: Fast and accurate scale estimation for tracking," IEEE Signal Processing Letters 27 (2019): 161-165.
Rifkin, Ryan, Gene Yeo, and Tomaso Poggio, "Regularized least-squares classification," Nato Science Series Sub Series III Computer and Systems Sciences 190 (2003): 131-154.
Tian, L., Huang, P., Lin, Z., & Lv, T, "DCFNet++: More Advanced Correlation Filters Network for Real-Time Object Tracking, " IEEE Sensors Journal, 21(10), 11329-11338.
Wang, N., Song, Y., Ma, C., Zhou, W., Liu, W., & Li, H, "Unsupervised deep tracking," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019.
Wang, Q., Gao, J., Xing, J., Zhang, M., & Hu, W, "Dcfnet: Discriminant correlation filters network for visual tracking," arXiv preprint arXiv:1704.04057 (2017).
Wu, Yi, Jongwoo Lim, and Ming-Hsuan Yang, "Online object tracking: A benchmark," Proceedings of the IEEE conference on computer vision and pattern recognition. 2013.
Li, Yang, and Jianke Zhu, "A scale adaptive kernel correlation filter tracker with feature integration," European conference on computer vision. Springer, Cham, 2014.
Yuan, D., Chang, X., Huang, P. Y., Liu, Q., & He, Z, "Self-supervised deep correlation tracking," IEEE Transactions on Image Processing 30 (2020): 976-985.
Fan, Heng, and Jinhai Xiang, "Robust visual tracking via local-global correlation filter," Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 31. No. 1. 2017.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
