Optimizing the Integration of Enterprise Data Warehouses and Large Language Models
DOI:
https://doi.org/10.54097/3nrmmk85Keywords:
Data Warehouse, Large Language Model, Efficient Fine-tuning, Intelligent Data AnalysisAbstract
With the in-depth advancement of the digital transformation strategy, enterprise-level data warehouses, as the core infrastructure for intelligent decision-making, are confronted with technical bottlenecks such as insufficient dynamic expansion capabilities and low real-time analysis efficiency. However, the rapid development of large language model technology provides a new path for the intelligence of data processing. This paper systematically explores the integration logic and technical adaptability of the two types of technologies, revealing the feasibility of upgrading the data processing paradigm through model light-weighting technology. This study reviews the application efficiency of the existing system in scenarios such as real-time analysis and resource allocation from the perspective of technical synergy, and demonstrates the development trend of the converged architecture in directions such as trusted computing and multi-modal processing. This paper provides a theoretical framework and practical reference for constructing a new generation of data infrastructure that supports dynamic optimization and intelligent decision-making, and has guiding significance for promoting the release of the value of data elements.
Downloads
References
[1] Ferreira F E R R, Fidalgo R d N. A Performance Analysis of Hybrid and Columnar Cloud Databases for Efficient Schema Design in Distributed Data Warehouse as a Service[J]. Data, 2024, 9: 99.
[2] Kahn M, Mui J Y, Ames M J, et al. Migrating a research data warehouse to a public cloud: challenges and opportunities[J]. Journal of the American Medical Informatics Association : JAMIA, 2021, 29: 592 - 600.
[3] Gourishetti S. Centralized Data Warehouse vs. Data Mesh: A Comparative Analysis of Modern Data Management Paradigms[J]. International Journal For Multidisciplinary Research, 2024.
[4] Shah K. The evolution of data warehouse architectures: from on-premises to cloud-native solutions[J]. World Journal of Advanced Research and Reviews, 2025.
[5] Wang Y, Xing K, Zheng B. Multi-Dimensional Indexing and Efficient Query Optimization of Property Right Digital Certificate Warehouse Based on Big Data Analysis[C]//2024 International Conference on Telecommunications and Power Electronics (TELEPE). , 2024: 266-271.
[6] Tang J. Applications and Challenges of Warehouse Optimization Technology in E-commerce Platforms under the Background Big Data[J]. Advances in Economics, Management and Political Sciences, 2025.
[7] Pracucci A. Designing Digital Twin with IoT and AI in Warehouse to Support Optimization and Safety in Engineer-to-Order Manufacturing Process for Prefabricated Building Products[J]. Applied Sciences, 2024.
[8] Chen B, Li X, Liang Y, et al. Circuit Complexity Bounds for RoPE-based Transformer Architecture[J]. ArXiv, 2024.
[9] Xiong R, Yang Y, He D, et al. On Layer Normalization in the Transformer Architecture[J]. ArXiv, 2020.
[10] Peng B, Narayanan S, Papadimitriou C. On Limitations of the Transformer Architecture[J]. ArXiv, 2024.
[11] Hu J E, Shen Y, Wallis P, et al. LoRA: Low-Rank Adaptation of Large Language Models[J]. ArXiv, 2021.
[12] Li M, Shi T, Ziems C, et al. CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation[J]. ArXiv, 2023.
[13] Trummer I. From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management[J]. Proc. VLDB Endow., 2022, 15: 3770-3773.
[14] Zhao J, Yu X, Yang Z. MSPLoRA: A Multi-Scale Pyramid Low-Rank Adaptation for Efficient Model Fine-Tuning[J]. ArXiv, 2025.
[15] Chang H, Ma Z, Ma M, et al. ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning[J]. ArXiv, 2025.
[16] Wang Q, Shen S. Activation-Guided Low-Rank Parameter Adaptation for Efficient Model Fine-Tuning[J]. IEEE Access, 2025, 13: 70909-70918.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Frontiers in Computing and Intelligent Systems
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
