Effect of the Number of Hidden Layer Neurons on the Accuracy of the Back Propagation Neural Network
DOI:
https://doi.org/10.54097/nbra6h45Keywords:
BP neural network; neurons; machine learning; hidden layer; deep learning.Abstract
Back propagation neural network (BPNN) is one of the most basic and commonly used models in machine learning. Hidden layers play a crucial function in maximizing the performance of neural networks, especially when solving complicated issues that demand strict adherence to accuracy and time complexity requirements. The only reliable ways at the moment are just experience and attempting each situation, as the process of determining the amount of Hidden Layer neurons is still unclear. To investigate this relationship, this article conducted extensive experiments involving designing and training the BPNN model with varying numbers of hidden layer neurons. Leverage benchmark data sets and quantify accuracy with appropriate error metrics. The analysis in this article focuses on understanding the impact of different neuron counts on network performance. Under specific assumptions, the findings show a relationship between the quantity of hidden layer neurons and BPNN accuracy. According to statistics of some recent neural network applications, it can be observed that if the number of neurons in the hidden layer is decreased, it will have an effect on the network's accuracy because complex problems with a small number of hidden layers may cause the network to be incorrectly trained; However, relative to the accuracy gain, the time complexity rises orders of magnitude as the number of hidden layer neurons exceeds the ideal amount.
Downloads
References
Wright L. G. et al., Deep physical neural networks trained with backpropagation, Nature, 2022, 601(7894), 549–555.
Rajawat A. S. and Jain S., Fusion Deep Learning Based on Back Propagation Neural Network for Personalization,” in 2nd International Conference on Data, Engineering and Applications (IDEA), 2020, 1–7.
Uzair M. and Jamil N. Effects of Hidden Layers on the Efficiency of Neural networks, in 2020 IEEE 23rd International Multitopic Conference (INMIC), 2020, 1–6.
Karsoliya S. Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture, Int. J. Eng. Trends Technol., 2012.
Wu Z.Watts O. and King S. Merlin: An Open Source Neural Network Speech Synthesis System. in SSW, 2016, 202–207.
Bai B., Zhang J., Wu X., Zhu W.G., and Li X., Reliability prediction-based improved dynamic weight particle swarm optimization and back propagation neural network in engineering systems, Expert Syst. Appl., 2021, 77, 114952.
Zhang S.-Z., Chen S., and Jiang H., A back propagation neural network model for accurately predicting the removal efficiency of ammonia nitrogen in wastewater treatment plants using different biological processes, Water Res., 2022, 222, 118908.
Shen J. et al., Modeling Height–Diameter Relationship for Poplar Plantations Using Combined-Optimization Multiple Hidden Layer Back Propagation Neural Network, Forests, 2020, 11(4), 442.
F. S. Panchal and M. Panchal, “Review on methods of selecting number of hidden nodes in artificial neural network,” Int. J. Comput. Sci. Mob. Comput., 2014, 3(11), 455–464.
Xu S. and Chen L., A novel approach for determining the optimal number of hidden layer neurons for FNN’s and its application in data mining, 2023.
Guang-Bin Huang, Learning capability and storage capacity of two-hidden-layer feedforward networks,” IEEE Trans. Neural Netw., 2023, 14(2), 274–281.
Optimizing back propagation neural network based on fractional-order value optimization comprises establishing back propagation neural network model of fractional-order, and establishing depth back propagation neural network model. Accessed: Aug. 29, 2023.
Zhang Q. and Zhu S., “Visual interpretability for deep learning: a survey,” Front. Inf. Technol. Electron. Eng., 2018, 19(1), 27–39.
S. Seifollahi, J. Yearwood, and B. Ofoghi, “Novel weighting in single hidden layer feedforward neural networks for data classification,” Comput. Math. Appl., 2012, 64(2), 128–136.
I. Shafi, J. Ahmad, S. I. Shah, and F. M. Kashif, “Impact of Varying Neurons and Hidden Layers in Neural Network Architecture for a Time Frequency Application,” in 2006 IEEE International Multitopic Conference, 2006, 188–193.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







