A Modified LSTM Neural Network Based on Boosting and Sufficient Dimensionality Reduction
DOI:
https://doi.org/10.54097/n5msag36Keywords:
boosting, sufficient dimensionality reduction, stock price prediction, LSTM, model averaging.Abstract
Stock price prediction is a common scenario in time series data forecasting, providing effective guidance for investment decisions. Long Short-Term Memory (LSTM) is a widely used model for stock price prediction, yet the selection of its hyperparameters remains an unresolved issue. In this paper, we address this challenge by employing model averaging instead of model selection. Specifically, we adaptively solve the hyperparameter selection problem by utilizing a distance covariance-weighted method, effectively balancing the bias and variance of the predictive model. Additionally, we propose an enhanced model that employs a boosting approach based on sufficiently reducing dimensionality through a multifactor model. This approach captures stock price sequence information beyond volatility. Practical data analysis demonstrates that the proposed method exhibits significant advantages over the original LSTM model in terms of mean square error or absolute error. Furthermore, the proposed framework can be applied to hyperparameter selection in other time series prediction models, such as autoregressive integrated moving averages (ARIMA), including the selection of autoregressive and partial autocorrelation orders.
Downloads
References
White H. Economic Prediction Using Neural Networks: The Case of IBM Daily Stock Returns[C]. Neural Networks IEEE International Conference, 1988, 2(6): 451-458.
Li Chenyang. Research on Stock price prediction and Quantitative stock Selection based on CNN-LSTM [D]. Northwestern University,2021.
Rather A M, Agarwal A, Sastry V N. Recurrent Neural Network and a Hybrid Model for Prediction of Stock Returns [ J]. Expert Systems with Applications, 2015, 42(6):3234-3241.
Kristjanpoller W, Fadic A, Minutolo M C. Volatility forecast using hybrid Neural Network models[J]. Expert Systems with Applications, 2014, 41(5):2437–2442.
Patel J, Shah S, Thakkar P, et al. Predicting stock market index using a fusion of machine learning techniques[J]. Expert Systems with Applications An International Journal, 2015, 42(4):2162–2172.
Hochreiter S, Schmidhuber J. Long Short-Term Memory[J]. Neural Computation, 1997,9(8):1735– 1780.
Selvin S, Vinayakumar R, Gopalakrishnan E A. Stock Price Predic⁃tion Using LSTM, RNN and CNN-sliding Window Model [C]. Interna⁃tional Conference on Advances in Computing,2017.
Chen Jia, LIU Dongxue, WU Dashuo. Research on Stock Index prediction Method based on Feature Selection and LSTM Model [J]. Computer Engineering and Applications,2019,55(6).
TU Zhirun. Research on Terminal Prediction Model of VOD Refining Furnace based on LSTM [D]. Xi 'an University of Technology,2022.
N Hjort and G Claeskens. Frequentist model average estimators[J]. Journal of the American Statistical Association, 2003 (4):879－899.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
