Top

Published in:

2024 | OriginalPaper | Chapter

Traffic Signal Optimization at T-Shaped Intersections Based on Deep Q Networks

Authors : Wenlong Ni, Chuanzhuang Li, Peng Wang, Zehong Li

Published in: Neural Information Processing

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper traffic signal control strategies for T-shaped intersections in urban road networks using deep Q network (DQN) algorithms are proposed. Different DQN networks and dynamic time aggregation were used for decision-makings. The effectiveness of various strategies under different traffic conditions are checked using the Simulation of Urban Mobility (SUMO) software. The simulation results showed that the strategy combining the Dueling DQN method and dynamic time aggregation significantly improved vehicle throughput. Compared with DQN and fixed-time methods, this strategy can reduce the average travel time by up to 43% in low-traffic periods and up to 15% in high-traffic periods. This paper demonstrated the significant advantages of applying Dueling DQN in traffic signal control strategies for urban road networks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Task Scheduling with Improved Particle Swarm Optimization in Cloud Data Center

next chapter A Multi-task Framework for Solving Multimodal Multiobjective Optimization Problems

Liang, X., Du, X., Wang, G., Han, Z.: A deep reinforcement learning network for traffic light cycle control. IEEE Trans. Veh. Technol. 68(2), 1243–1253 (2019)CrossRef

Chin, Y.K., Bolong, N., Yang, S.S., Teo, K.: Exploring q-learning optimization in traffic signal timing plan management. In: Third International Conference on Computational Intelligence (2011)

Abdoos, M., Mozayani, N., Bazzan, A.: Holonic multi-agent system for traffic signals control. Eng. Appl. Artif. Intell. 26(5–6), 1575–1587 (2013)CrossRef

Balaji, P.G., German, X., Srinivasan, D.: Urban traffic signal control using reinforcement learning agents. IET Intel. Transport Syst. 4(3), 177–188 (2010)CrossRef

Varaiya, P.: The max-pressure controller for arbitrary networks of signalized intersections. In: Ukkusuri, S., Ozbay, K. (eds.) Advances in Dynamic Network Modeling in Complex Transportation Systems. Complex Networks and Dynamic Systems, vol. 2. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-6243-9_2CrossRef

Bazzan, A.: Opportunities for multiagent systems and multiagent reinforcement learning in traffic control. Auton. Agent. Multi-Agent Syst. 18(3), 342 (2009)CrossRef

Abdulhai, B., Pringle, P.: Autonomous multiagent reinforcement learning5 GC urban traffic control. In: Annual Transportation Research Board Meeting (2003)

Hamilton, A., Waterson, B., Cherrett, T., Robinson, A., Snell, I.: The evolution of urban traffic control: changing policy and technology. Transp. Plan. Technol. 36, 24–43 (2013)CrossRef

Zhang, J., Wang, F.Y., Wang, K., Lin, W.H., Xu, X., Chen, C.: Data-driven intelligent transportation systems: a survey. IEEE Trans. Intell. Transp. Syst. 12(4), 1624–1639 (2011)CrossRef

10.

Wu, X., Liu, H.X.: Using high-resolution event-based data for traffic modeling and control: an overview. Transp. Res. Part C Emerg. Technol. 42(2), 28–43 (2014)CrossRef

11.

El-Tantawy, S., Abdulhai, B.: Towards multi-agent reinforcement learning for integrated network of optimal traffic controllers (Marlin-OTC). Transp. Lett. 2(2), 89–110 (2010)CrossRef

12.

Genders, W., Razavi, S.: Using a deep reinforcement learning agent for traffic signal control (2016)

13.

Abdulhai, B., Pringle, R., Karakoulas, G.J.: Reinforcement learning for true adaptive traffic signal control. J. Transp. Eng. 129(3), 278–285 (2003)CrossRef

14.

Watkins, C., Dayan, P.: Q-learning. In: Machine Learning (1992)

15.

Thorpe, T.L.: Vehicle traffic light control using SARSA (1997)

16.

Mikami, S., Kakazu, Y.: Genetic reinforcement learning for cooperative traffic signal control. In: IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence (1994)

17.

Volodymyr, M., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRef

18.

Mnih, V., et al.: Playing Atari with deep reinforcement learning. Computer Science (2013)

19.

Li, L., Lv, Y., Wang, F.Y.: Traffic signal timing via deep reinforcement learning. IEEE/CAA J. Automatica Sinica 3, 247–254 (2016)MathSciNetCrossRef

20.

Hasselt, H.V., Guez, A., Silver, D.: Deep reinforcement learning with double q-learning. In: National Conference on Artificial Intelligence (2016)

21.

Freitas, N.D., Lanctot, M., Hasselt, H.V., Hessel, M., Schaul, T., Wang, Z.: Dueling network architectures for deep reinforcement learning. In: International Conference on Machine Learning (2016)

Title: Traffic Signal Optimization at T-Shaped Intersections Based on Deep Q Networks
Authors: Wenlong Ni
Chuanzhuang Li
Peng Wang
Zehong Li
Publisher: Springer Nature Singapore
Book: Neural Information Processing
Print ISBN: 978-981-9980-66-6

Electronic ISBN: 978-981-9980-67-3

Copyright Year: 2024
DOI: https://doi.org/10.1007/978-981-99-8067-3_22

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner