Intelligent Control Scheme for Traffic Signals at Multi-intersections based on Pedestrian Safety

Authors

  • Weiming Liang

DOI:

https://doi.org/10.54097/dym7hp18

Keywords:

Deep reinforcement learning, traffic signal, pedestrian safety.

Abstract

Traffic congestion has become a more and more serious problem. Meanwhile, pedestrian safety problem is another issue under the circumstance of multiple modes of vehicles that needed to be dealt with. And these two problems can be effectively solved if the traffic signal is set reasonably. This paper proposes an intelligent control scheme for traffic signals at multi-intersections based on pedestrian safety, which is designed by using multi-agent deep reinforcement learning and self-attention mechanism. And Centralized training decentralized execution is also applied in this paper which can effectively downsize the action dimension to make the model learn much faster. Though pedestrian safety and vehicle efficiency are two contradictory factors, this paper dexterously designs the reward function to let the model learn the optimal timing scheme. And the model outperforms the fixed-timed scheme and deep Q-learning scheme in the simulation traffic environment, with fewer conflicts between pedestrians and vehicles, shorter average delay time and higher average speed of vehicles at the same time.

Downloads

Download data is not yet available.

References

Road Traffic Accident Database 2009-2011: Traffic Police Department. SPF, Singapore, 2013.

Alan J Miller. Settings for fixed-cycle traffic signals. Journal of the Operational Research Society, 1963, 14: 373–386.

Isaac Porche, Stéphane Lafortune. Adaptive look-ahead optimization of traffic signals. Journal of Intelligent Transportation System, 1999, 3: 209–254.

Dahai Wang, Qian Wang. Cycle lost time L is negative for the fine optimal adaptive TC. The 9th China Intelligent Transportation Annual Conference, 2014: 10.

Varaiya P. The max-pressure controller for arbitrary networks of signalized intersections. In Advances in Dynamic Network Modeling in Complex Transportation Systems, 2013, 27-66.

Guoyou Zhang, Shifeng Song. Traffic Light Control Optimization based one D3QN. Computer and Modernization, 2023(07): 30-35+47.

Tong Wu, et al. Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks. IEEE Transactions on Vehicular Technology, 2020, 8: 8243–8256.

Lowe R, Wu Y, Tamar A, et al. Multi-agent actor-critic for mixed cooperative-competitive environments. In Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, 6382-6393.

Zundong Zhang, et al. Road network traffic control reinforcement learning algorithms based on Nash-Stackelberg hierarchical game model. Journal of Southeast University (Natural Science Edition), 2023, 334-341.

Haosheng Wu, Jiaoling Zheng, Maofan Wang. TR-light: traffic organization plan optimization algorithm based on multiple traffic signal lights reinforcement learning. Application Research of Computers, 2023, 39(02): 504-509+514.

Xianglin Zhuang, Changxu Wu, Shua Ma. Cross or wait? Pedestrian decision making during clearance phase at signalized intersections. Accident Analysis and Prevention, 2018, 115-124.

Turky A M, et al. The use of genetic algorithm for traffic light and pedestrian crossing control. International Journal of Computer Science and Network Security, 2009, 9(2):88-96.

Liu Y, Liu L, Chen W P. Intelligent traffic light control using distributed multi-agent Q learning. IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), 2017, 1-8.

Zhang Y, et al. Pedestrian-safety-aware traffic light control strategy for urban traffic congestion alleviation. IEEE Transactions on Intelligent Transportation System, 2019, 22(1): 178-193.

Qianlong Zhang, Zhiqun Hu, Hailin Xiao. Research on Intelligent Control Algorithm of Traffic Light Based on Pedestrian Safety. Computer Measurement & Control, 2022, 30(4): 114-120.

Prashanth L, Bhatnagar S. Reinforcement learning with function approximation for traffic signal control. Intelligent Transportation Systems, IEEE Transactions on, 2011, 412–421.

Anni Ren, Dake Zhou, Jinhao Feng, et al. Attention mechanism based deep reinforcement learning for traffic signal control. Application Research of Computers, 2023, 40(02): 430-434.

Downloads

Published

26-12-2023

How to Cite

Liang, W. (2023). Intelligent Control Scheme for Traffic Signals at Multi-intersections based on Pedestrian Safety. Highlights in Science, Engineering and Technology, 78, 113-121. https://doi.org/10.54097/dym7hp18