Capitalized Comparison of Three Machine Learning Models: Linear Model, Decision Tree, Neural Network
DOI:
https://doi.org/10.54097/pxcpca72Keywords:
Linear Model, Decision Tree, Neural Network, machine learning.Abstract
As a matter of fact, with the rapid development of computation ability, machine learning has boosted rapidly with much faster training speed in recent years. In reality, machine learning is transforming industries with its ability to derive insights and patterns within massive datasets. Among numerous algorithms available, certain foundational models stand out due to their efficiency and capability. With this in mind, this study compares three typical models among various machine learning scenarios, i.e., linear models, decision trees, and neural network models. According to the analysis, the basic principle, concepts as well as parameters will be demonstrated. While all three has its unique pros and cons, this study aims to guide readers in choosing most fitting model with their tasks, by clarify the difference and future outlooks of these models. At the same time, the future development trends for the machine learning models will be proposed based on the analysis. Overall, these results shed light on guiding further exploration of machine learning.
Downloads
References
Royal Society & British Academy, Machine Learning: The Power and Promise of Computers That Learn by Example (RS&BC, London, 2017), pp.1 - 331.
M. Yang, Y. Liu, T. Chen, and Y. Tong, ACM Transactions on Intelligent Systems and Technology 10 (2), 1 – 19 (2019).
C. Zhou, S. Pan, J. Wang and A. V. Vasilakos, Neurocomputing (Amsterdam) 237, 350 – 361 (2017).
V. Muthalagu, A. S. Bolimera, D. Duseja, and S. Fernandes, Transport and Telecommunication 22 (4), 383 – 391 (2021).
P. Gordijn and H. Have, Medicine, Health Care, and Philosophy 26(1), 1 – 2 (2023).
J. Jovel and R. Greiner, Frontiers in Medicine 8, 771607 – 771609 (2021).
D. Valkenborg, American Journal of Orthodontics and Dentofacial Orthopedics 164 (1), 146 – 149 (2023).
D. Valkenborg, American Journal of Orthodontics and Dentofacial Orthopedics 163 (6), 877 – 882 (2023).
R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction (MIT press, Cambridge, 2018).
Y. Matsuo, Neural Networks 152, 267 – 275 (2022).
K. S. Priya, International Journal of Research in Applied Science and Engineering Technology 15 (2021).
D. Jurafsky and J. H. Martin, Speech and Language Processing (Chapter 5) (Stanford University, Stanford 2023).
J. Hair, Análise multivariada de dados (Porto Alegre, Bookman Editora, 2009).
D. Boswell, Introduction to Support Vector Machines. (Caltech press, Pasadena, 2022).
L. Jun, Journal of Physics. Conference Series 1748 (5), 52006 (2021).
D. Blockeel, L. Devos, B. Frénay, G. Nanfack and S. Nijssen, Frontiers in Artificial Intelligence 6, 1124553 (2023).
G. Biau, Journal of Machine Learning Research 13, 1063 - 1095 (2012).
G. Ke, Q. Meng, T. Finley et al., NIPS 17, 3149 - 3157 (2017).
T. Chen and C. Guestrin, Advances in Pure Mathematics 6, 9 (2016).
E. Khandelwal. Which Algorithm Takes the Crown: Light GBM vs XGBOOST? Analytics Vidhya. Retrieved from https://www.analyticsvidhya.com/blog/2017/06/which-algorithm-takes-the-crown-light-gbm-vs-xgboost/.
K. O’Shea, and R. Nash, An Introduction to Convolutional Neural Networks (Springer, Berlin, 2015).
J. Dancker, A Brief Introduction to Recurrent Neural Networks, (Towards Data Science, London, 2022).
A. Creswell, T. White, V. Dumoulin, et al., IEEE signal processing magazine 35 (1), 53 - 65 (2018).
S. Vaswani, N. Shazeer, N. Parmar, et al., Advances in neural information processing systems 30 (2017).
M. Zhou, H. Fan, Y. Liu, H. Zhang and R. Ji, Applied Sciences, 13 (10), 5870 (2023).
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Highlights in Science, Engineering and Technology

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







