Research On Pruning Methods for Mobilenet Convolutional Neural Network
DOI:
https://doi.org/10.54097/a742e326Keywords:
Convolutional Neural Networks (CNNs), model pruning, MobileNet, model compression, resource-constrained devices.Abstract
This paper comprehensively reviews pruning methods for MobileNet convolutional neural networks. MobileNet is a lightweight convolutional neural network suitable for resource-constrained environments such as mobile devices.Various pruning methods can be applied to reduce the model's storage space and computational complexity, including channel pruning, kernel pruning, and weight pruning. Channel pruning removes unimportant channels to reduce redundant parameters and computations in the model, while kernel pruning reduces redundant calculations by pruning convolutional kernels. Weight pruning involves setting small-weighted elements to zero to remove unimportant weights. These pruning methods can be used individually or in combination. After pruning, fine-tuning is necessary to restore the model's performance. Factors such as pruning rate, pruning order, and pruning location need to be considered to achieve a balance between reducing model size and computational complexity while minimizing performance loss. Pruning methods based on MobileNet convolutional neural networks reduce the parameter count and computational complexity, improving model lightweightness and inference efficiency. These methods are of significant value in resource-constrained environments such as mobile devices. This review provides insights into pruning methods for MobileNet convolutional neural networks and their applications in lightweight and efficient model deployment. Further advancements such as automated pruning methods driven by reinforcement learning algorithms can enhance the pruning process to achieve optimal model compression effects. Future research should focus on adapting and optimizing these pruning methods for specific problem domains and achieving even higher compression ratios and computational speedups.
Downloads
References
Fu Linghao. Research on Computing Acceleration of MobileNet Convolutional Neural Networks for Mobile Embedded Devices [D]. Wuhan University of Technology, 2021,18(10):53-60.
Li Jiangyun, Zhao Yikai, Xue Zhuoer, etc. A review of deep neural network model compression [J]. Engineering Science Journal, 2019, 41(10):12-25
Li Qian, Wang Yongxian, Zhu Youqin. Artificial Neural Network Hybrid Pruning Algorithm[J]. Journal of Tsinghua University (Natural Science Edition), 2005(06):83-85
Jin Lilei, Yang Wenzhu, Wang Sile, etc. A Hybrid Pruning Method for Convolutional Neural Network Compression [J]. Small and Micro Computer Systems, 2018, 39(12): 2596-2601
He, Y., Zhang, X., & Sun, J. Channel Pruning for Accelerating Very Deep Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2018, 41(10): 1229-1239
Molchanov, P., Tyree, S., Karras, T., Aila, T., & Kautz, J. Pruning Convolutional Neural Networks for Resource Efficient Inference, 2016, 51(12): 1329-1339
Han, S., Pool, J., Tran, J., & Dally, W. Learning both weights and connections for efficient neural network. In Advances in neural information processing systems, 2019, 13(21):1135-1143.
Molchanov, D., Ashukha, A., & Vetrov, Variational dropout sparsifies deep neural networks. In Proceedings of the 34th International Conference on Machine Learning-Volume, 2021, 14(12): 2498-2507.
Zhu, M., Gupta, S., Han, S., & Kumar, H. P. Toprune, or not to prune exploring the efficacy of pruning for model compression, 2018, 16(2):453-457.
Han, S., Pool, J., Tran, J., & Dally, W. (2015). Learning both weights and connections for efficient neural network. In Advances in neural information processing systems, 2020, 14(21):765-770.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







