A Multi-Strategy Learning Framework for Multi-Factor Forecasting and Optimization: Integrating Gradient Boosting, Causality Analysis, and SVM

Authors

  • Weihan Li
  • Zhen Xie
  • Weiran Chen

DOI:

https://doi.org/10.54097/0yq6wr75

Keywords:

Multivariate Regression, Gadient Bosting, Random Forest, SHAP, Support Vector Machine, Decision Optimization

Abstract

This paper investigates a data-driven forecasting and decision optimization problem under multi-factor constraints, aiming to predict target outcomes and support resource allocation strategies. We first propose a hybrid computational framework combining multivariate regression and gradient boosted decision trees to handle incomplete data and capture nonlinear dependencies. A secondary modeling scheme integrates random forest classifiers and support vector machines to quantify indirect influence factors and prioritize strategic investments. Extensive experiments demonstrate that our model achieves a prediction error margin within 35% on most instances, while offering interpretable insights via SHAP-based attribution. The findings suggest the framework's robustness and adaptability across diverse scenarios, providing a generalizable solution for simulation-based outcome prediction and strategic decision-making in resource-limited environments.

References

[1]Ye H, Teng X, Song B, et al. Multi-Source Data Fusion-Based Grid-Level Load Forecasting[J]. Applied Sciences, 2025, 15(9): 4820.

[2]Wang J, Du W, Yang Y, et al. Deep learning for multivariate time series imputation: A survey[J]. arXiv preprint arXiv:2402.04059, 2024.

[3]Emami S, Martínez-Muñoz G. Deep learning for multi-output regression using gradient boosting[J]. IEEE Access, 2024, 12: 17760-17772.

[4]Moraffah R, Sheth P, Karami M, et al. Causal inference for time series analysis: Problems, methods and evaluation[J]. Knowledge and Information Systems, 2021, 63(12): 3041-3085.

[5]Ahmed U, Jiangbin Z, Almogren A, et al. Hybrid bagging and boosting with SHAP based feature selection for enhanced predictive modeling in intrusion detection systems[J]. Scientific Reports, 2024, 14(1): 30532.

[6]Yousefli A, Heydari M, Norouzi R. A data-driven stochastic decision support system to investment portfolio problem under uncertainty[J]. Soft Computing, 2022, 26(11): 5283-5296.

Downloads

Published

26-08-2025

Issue

Section

Articles