The Application and Optimization of Machine Learning in Big Data Analysis
DOI:
https://doi.org/10.54097/10e0ym54Keywords:
Machine learning; Big data; Neural network; Support vector machine.Abstract
As a branch of artificial intelligence, machine learning enables computers to learn rules and patterns automatically from massive data by training and optimizing algorithms. This paper discusses the important role of machine learning in big data analysis, paying special attention to the application comparison between neural network algorithm and support vector machine (SVM) algorithm. This paper first introduces the close relationship between machine learning and big data analysis, and then compares the differences between neural network and SVM in calculation time and prediction performance through experiments. The results show that when dealing with complex data, the neural network shows higher operating efficiency and prediction accuracy, and its accuracy is improved by more than 20% compared with SVM. This discovery provides a powerful basis for algorithm selection in the field of big data analysis, and indicates the great potential of neural network in processing large-scale data sets.
References
Cravero A, Samuel Sepúlveda. Use and Adaptations of Machine Learning in Big Data—Applications in Real Cases in Agriculture[J]. Electronics, 2021, 10(5):552.
Gupta M, Gupta B. Survey of Breast Cancer Detection Using Machine Learning Techniques in Big Data[J]. Journal of Cases on Information Technology, 2019, 21(3):80-92.
Tsaih R H, Kuo B S, Lin T H, et al. The use of big data analytics to predict the foreign exchange rate based on public media: A machine-learning experiment[J]. It Professional, 2018, 20(2):34-41.
Stan L. Statistical and Machine-Learning Data Mining: Techniques for Better Predictive Modeling and Analysis of Big Data[J]. Technometrics, 2022, 2022(1):64.
Gui G, Liu F, Sun J, et al. Flight Delay Prediction Based on Aviation Big Data and Machine Learning[J]. IEEE Transactions on Vehicular Technology, 2020, 69(1):140-150.
Gui G, Zhou Z, Wang J, et al. Machine Learning Aided Air Traffic Flow Analysis Based on Aviation Big Data[J]. IEEE Transactions on Vehicular Technology, 2020, 69(5):4817-4826.
Wei Y, Chen Y, Xiao M, et al. Protecting Machine Learning Integrity in Distributed Big Data Networking[J]. IEEE Network, 2020, 34(4):84-90.
King P H. Signal Processing and Machine Learning for Biomedical Big Data[J]. IEEE Pulse, 2019, 10(3):34-35.
Liu Y, Bi S, Shi Z, et al. When Machine Learning Meets Big Data: A Wireless Communication Perspective[J]. IEEE Vehicular Technology Magazine, 2020, 15(1):63-72.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
