A License Plate Detection and Recognition Method Based on Improved Yolov5

Weiping Yang; Chao Huang

doi:10.54097/0Lwh7wov

Authors

Weiping Yang
Chao Huang

DOI:

https://doi.org/10.54097/0Lwh7wov

Keywords:

License Plate Detection, Yolov5, Key Point Detection, ShuffleNet

Abstract

This study proposes a license plate detection and recognition method based on yolov5. In order to accurately detect the license plate and accurately identify the license plate number, this study adds key point detection based on the yolov5 algorithm to correct the license plate image into a rectangle through perspective transformation, which greatly improves the accuracy of license plate number recognition. Due to embedded deployment, this study simplifies the yolov5 network structure to a certain extent. While reducing the network depth and width, ShuffleNet Block is used to replace the C3 module in yolov5. In the end, this study achieved a mean average precision (mAP) of 89.7% while controlling the network calculation amount to 5GFLOPs. Therefore, this model has broad application prospects in the transportation field.

Downloads

Download data is not yet available.

References

Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp.779–788.

Zhang X, Zhou X, Lin M, et al. Shufflenet: An extremely efficient convolutional neural network for mobile devices [C]// Proceedings of the IEEE conference on computer vision and pattern recognition. 2018:6848-6856.

He K, Gkioxari G, Dollár P, et al. Mask r-cnn[C]//Proceedings of the IEEE international conference on computer vision. 2017: 2961-2969.

Girshick R. Fast r-cnn[C]//Proceedings of the IEEE international conference on computer vision. 2015: 1440-1448.

Ren S, He K, Girshick R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks[J]. Advances in neural information processing systems, 2015, 28.

He K, Zhang X, Ren S, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE transactions on pattern analysis and machine intelligence, 2015, 37 (9): 1904-1916.

Liu W, Anguelov D, Erhan D, et al. Ssd: Single shot multibox detector [C]// Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14. Springer International Publishing, 2016: 21-37.

Howard A G, Zhu M, Chen B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications [J]. arXiv preprint arXiv:1704.04861, 2017.

Han K, Wang Y, Tian Q, et al. Ghostnet: More features from cheap operations [C]// Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 1580-1589.

Ma N, Zhang X, Zheng H T, et al. Shufflenet v2: Practical guidelines for efficient cnn architecture design[C]// Proceedings of the European conference on computer vision (ECCV). 2018: 116-131.

Shi B, Bai X, Yao C. An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition[J]. IEEE transactions on pattern analysis and machine intelligence, 2016, 39(11): 2298-2304.

Graves A, Fernández S, Gomez F, et al. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks[C]//Proceedings of the 23rd international conference on Machine learning. 2006: 369-376.