Traffic Flow Prediction on the Spatial Graph Convolutional Networks and Temporal Transformer Model

Authors

  • Kaize Xu

DOI:

https://doi.org/10.54097/em162q98

Keywords:

Deep learning, Spatial Graph Convolutional Networks, Temporal Transformer, Traffic Forecasting.

Abstract

This study investigates traffic flow forecast using a hybrid deep learning architecture that combines Spatial Graph Convolutional Networks (GCN) with a Temporal Transformer. Traditional deep learning models, like LSTM and STGCN, have demonstrated promising performance in spatio-temporal forecasting. But the biggest limitation is that they face restrictions in modeling long-range temporal dependence and they catch complex spatial correlations. To address these issues, the proposed model employs a spatial GCN to extract topological and spatial relationships among traffic sensors from the road network, while a Transformer-based temporal module models sequential dependencies through self-attention, enabling dynamic weighting of historical observations across time steps. The METR-LA dataset is used to evaluate the model, which contains short-term traffic speed record from sensors in Los Angeles. Experimental results indicate that the Spatial GCN + Temporal Transformer achieves better prediction accuracy compared to conventional baselines, especially in multi-step forecasting scenarios, benefiting from its ability to capture local temporal dependencies, as well as global temporal dependencies. The findings highlight the potential of combining graph-based spatial modeling with attention-driven temporal modeling for intelligent transportation systems, and suggest promising directions for extending the approach to large-scale, real-time traffic prediction and route optimization tasks.

References

[1] INRIX Global Traffic Scorecard (2023) [Online]. Available: https://inrix.com/.

[2] Williams B M, Williams L. A. Modeling and forecasting vehicular traffic flow as a seasonal arima process: Theoretical basis and empirical results. Journal of Transport engineering, 129(6):664-672, 2003.

[3] Jiang W, Luo J. Graph Neural Network for Traffic Forecastin g: A Survey. arXiv:2101.11174, 2021.

[4] Yin X, Wu G, Wei J, Shen Y, Qi H, Yin B. Deep Learning on Traffic Prediction: Methods, Analysis and Future Directions. arXiv:2004.08555, 2020.

[5] Yu B, Yin H, Zhu Z. Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting. arXiv:1709.04875, 2017.

[6] Jaderberg M, Simonyan K, Zisserman A, Kavukcuoglu K. Spatial Transformer Networks. Advances in Neural Information Processing Systems 28 (NIPS 2015).

[7] Shao Z, Yao X, Wang Z, Gao J. ST-MambaSync: The Complement of Mamba and Transformers for Spatial-Temporal in Traffic Flow Prediction. arXiv:2404.15899, 2024.

[8] Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Computation Volume: 9 Issue: 8, 1997.

[9] Li Y, Yu R, Shahabi C, Liu Y. Diffusion Convolutional Recurrent Neural Network: Data-driven Traffic Forecasting. arXiv:1707.01926, 2017.

[10] Huang Y, Weng Y, Yu S, Chen X. Diffusion Convolutional Recurrent Neural Network with Rank Influence Learning for Traffic Forecasting. 18th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, 2019.

[11] Han H, Zhang M, Hou M, Zhang F, Wang Z, Chen E. STGCN: A Spatial-Temporal Aware Graph Learning Method for POI Recommendation. 2020 IEEE International Conference on Data Mining, 2020.

[12] Yun S, Jeong M, Kim R, Kang J, Kim H. J. Graph Transformer Networks. Advances in Neural Information Processing Systems 32 (NeurIPS 2019), 2019.

[13] Giuliari F, Hasan I, Cristani M, Galasso F. Transformer Networks for Trajectory Forecasting. 25th International Conference on Pattern Recognition, 2021.

Downloads

Published

15-03-2026

Issue

Section

Articles

How to Cite

Xu, K. (2026). Traffic Flow Prediction on the Spatial Graph Convolutional Networks and Temporal Transformer Model. Mathematical Modeling and Algorithm Application, 9(1), 116-123. https://doi.org/10.54097/em162q98