Research on Data Quality Analysis Based on Data Mining
DOI:
https://doi.org/10.54097/9bav3z07Keywords:
Data mining; data quality; analysis.Abstract
As the process of digitalization continues to advance, big data plays a pivotal role across various industries. However, the quality of data directly impacts the results of data analysis and the accuracy of decision-making. High-quality data can provide a reliable basis for decisions, whereas poor-quality data may lead to erroneous judgments and cause incalculable losses. Therefore, the management and enhancement of data quality have become central issues in contemporary data management. Data mining technology, as a powerful tool, excels not only in extracting valuable information from large-scale datasets but also in demonstrating significant potential in improving data quality. By mining and analyzing the patterns and characteristics hidden within data, it is possible to identify and rectify defects, thereby enhancing the overall quality of data and increasing the reliability of data-driven decision-making. This paper delves into the definition and dimensions of data quality, explores the fundamental principles of data mining technology, and examines its specific applications in data quality analysis, aiming to offer new insights and methods for data quality management.
Downloads
References
[1] Luebbers D, Grimmer U, Jarke M. Systematic development of data mining-based data quality tools[C]//Proceedings 2003 VLDB conference. Morgan Kaufmann, 2003: 548-559.
[2] Deng W, Wang G. A novel water quality data analysis framework based on time-series data mining[J]. Journal of environmental management, 2017, 196: 365-375.
[3] Nie G, Zhang L, Liu Y, et al. Decision analysis of data mining project based on Bayesian risk[J]. Expert Systems with Applications, 2009, 36(3): 4589-4594.
[4] Haghverdi A, Öztürk H S, Cornelis W M. Revisiting the pseudo continuous pedotransfer function concept: Impact of data quality and data mining method[J]. Geoderma, 2014, 226: 31-38.
[5] Sheng V S, Provost F, Ipeirotis P G. Get another label? improving data quality and data mining using multiple, noisy labelers[C]//Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 2008: 614-622.
[6] Batini C, Cappiello C, Francalanci C, et al. Methodologies for data quality assessment and improvement[J]. ACM computing surveys (CSUR), 2009, 41(3): 1-52.
[7] Peña-Ayala A. Educational data mining: A survey and a data mining-based analysis of recent works[J]. Expert systems with applications, 2014, 41(4): 1432-1462.
[8] Jeihouni M, Toomanian A, Mansourian A. Decision tree-based data mining and rule induction for identifying high quality groundwater zones to water supply management: a novel hybrid use of data mining and GIS[J]. Water Resources Management, 2020, 34: 139-154.
[9] DeRosa M. Data mining and data analysis for counterterrorism[M]. Washington, DC: CSIS Press, 2004:11.
[10] Berti-Equille L. Measuring and modelling data quality for quality-awareness in data mining[M]//Quality measures in data mining. Berlin, Heidelberg: Springer Berlin Heidelberg, 2007: 101-126.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Academic Journal of Science and Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
