A Hybrid LSTM-Transformer Approach for Financial Markets: Forecasting Stock Price Time Series
DOI:
https://doi.org/10.54097/qvtnqc67Keywords:
Stock price prediction; LSTM, Transformer; Hybrid model.Abstract
Although the most used Long Short-Term Memory (LSTM) networks are now well-suited for short-term data changes, they are not enough to grasp the overall data in financial forecasting. This paper proposes a hybrid approach that combines LSTM and Transformer architectures to leverage both temporal dynamics and global dependencies in financial time series. Specifically, the model employs LSTM layers to extract sequential and local temporal features, while the Transformer’s self-attention mechanism captures long-range correlations and the global structure of the data. Experimental results demonstrate that this combined framework achieves higher prediction accuracy and greater robustness compared to traditional models. This suggests that this paper model can better handle the complex, nonlinear, and highly volatile nature of financial data. Overall, this hybrid model provides a more reasonable and reliable basis for financial forecasting, offering valuable insights for investors, analysts, and policymakers seeking to make data-driven decisions in an ever-changing market environment.
Downloads
References
[1] Gu S, Kelly B, Xiu D. Empirical asset pricing via machine learning. The Review of Financial Studies, 2020, 33(5): 2223-2273.
[2] Fama E F. Efficient capital markets: a review of theory and empirical work. The Journal of Finance, 1970, 25(2): 383-417.
[3] Box G, Jenkins G M. Analysis: forecasting and control. San Francisco, 1976.
[4] Cont R. Empirical properties of asset returns: stylized facts and statistical issues. Quantitative Finance, 2001, 1(2): 223.
[5] Cortes C, Vapnik V. Support-vector networks. Machine Learning, 1995, 20(3): 273-297.
[6] Breiman L. Random forests. Machine Learning, 2001, 45(1): 5-32.
[7] Lim B, Zohren S. Time-series forecasting with deep learning: a survey. Philosophical Transactions of the Royal Society A, 2021, 379(2194): 20200209.
[8] Sezer O B, Gudelek M U, Ozbayoglu A M. Financial time series forecasting with deep learning: a systematic literature review: 2005–2019. Applied Soft Computing, 2020, 90: 106181.
[9] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Advances in Neural Information Processing Systems, 2017, 30.
[10] Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735-1780.
[11] Fischer T, Krauss C. Deep learning with long short-term memory networks for financial market predictions. European Journal of Operational Research, 2018, 270(2): 654-669.
[12] Kabir M R, Bhadra D, Ridoy M, et al. LSTM–transformer-based robust hybrid deep learning model for financial time series forecasting. Science, 2025, 7(1): 7.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Frontiers in Computing and Intelligent Systems

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

