Advanced Traffic Signal Control System Using Deep Double Q-Learning with Pedestrian Factors
References
- Xiaoyuan Liang, Tan Yan, Joyoung Lee, and Guiling Wang. A distributed intersection management protocol for safety, efficiency, and driver’s comfort. IEEE Internet of Things Journal, 5(3):1924–1935, 2018.
- Reza Zanjirani Farahani, Elnaz Miandoabchi, W.Y. Szeto, and Hannaneh Rashidi. A review of urban transportation network design problems. European Journal of Operational Research, 229(2):281–302, 2013.
- Dongbin Zhao, Yujie Dai, and Zhen Zhang. Computational intelligence in urban traffic signal control: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 42(4):485–494, 2012.
- Ammar Haydari and Yasin Yılmaz. Deep reinforcement learning for intelligent transportation systems: A survey. IEEE Transactions on Intelligent Transportation Systems, 23(1):11–32, 2022.
- Tala Talaei Khoei, Hadjar Ould Slimane, and Naima Kaabouch. Deep learning: systematic review, models, challenges, and research directions. Neural Computing and Applications, 35, 2023.
- Carlos Gershenson. Self-organizing traffic lights, 2005.
- Pravin Varaiya. The max-pressure controller for arbitrary networks of signalized intersections. In Satish V. Ukkusuri and Kaan Ozbay, editors, Advances in Dynamic Network Modeling in Complex Transportation Systems, pages 27–66. Springer New York, New York, NY, 2013.
- Saptarshi Sengupta, Sanchita Basak, Pallabi Saikia, Sayak Paul, Vasilios Tsalavoutis, Frederick Atiah, Vadlamani Ravi, and Alan Peters. A review of deep learning with special emphasis on architectures, applications and recent trends. Knowledge-Based Systems, 194:105596, 2020.
- Juntao Gao, Yulong Shen, Jia Liu, Minoru Ito, and Norio Shiratori. Adaptive traffic signal control: Deep reinforcement learning algorithm with experience replay and target network, 2017.
- Hua Si Li-Juan Liu and Hamid Reza Karimi. Intelligent emergency traffic signal control system with pedestrian access. Information Sciences, 267:120805, 2024.
- Ashish Tigga, Lopamudra Hota, Sanjeev Patel, and Arun Kumar. A deep q-learning-based adaptive traffic light control system for urban safety. In 2022 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), pages 2430–2435, 2022.
- Leilei Kang, Hao Huang, Weike Lu, and Lan Liu. A dueling deep q-network method for low-carbon traffic signal control. volume 141, page 110304, 2023.
- Bin Wang, Zhengkun He, Jinfang Sheng, and Yu Chen. Deep reinforcement learning for traffic light timing optimization. Processes, 10(11), 2022.
- Jianfeng Gu, Yong Fang, Zhichao Sheng, and Peng Wen. Double deep q-network with a dual-agent for traffic signal control. Applied Sciences, 10(5), 2020.
- Tarek Amine Haddad, Djalal Hedjazi, and Sofiane Aouag. A new deep reinforcement learning-based adaptive traffic light control approach for isolated intersection. In 2022 5th International Symposium on Informatics and its Applications (ISIA), pages 1–6, 2022.
- Yanming Feng and Yongrong Wu. Environmental adaptive urban traffic signal control based on reinforcement learning algorithm. Journal of Physics: Conference Series, 1650(3):032097, oct 2020.
- Salah Bouktif, Abderraouf Cheniki, Ali Ouni, and Hesham El-Sayed. Deep reinforcement learning for traffic signal control with consistent state and reward design approach. Knowledge-Based Systems, 267:110440, 2023.
- Peng Mei, Hamid Reza Karimi, Hehui Xie, Fei Chen, Cong Huang, and Shichun Yang. A deep reinforcement learning approach to energy management control with connected information for hybrid electric vehicles. Engineering Applications of Artificial Intelligence, 123:106239, 2023.
- Alexandre Heuillet, Fabien Couthouis, and Natalia Díaz-Rodríguez. Explainability in deep reinforcement learning. Knowledge-Based Systems, 214:106685, 2021.
- Michal Golan and Nahum Shimkin. Markov decision processes with burstiness constraints. European Journal of Operational Research, 312(3):877–889, 2024.
- Degui Xiao, Xuefeng Yang, Jianfang Li, and Merabtene Islam. Attention deep neural network for lane marking detection. Knowledge-Based Systems, 194:105584, 2020.
- Qian Zhou, Yang Lian, Jiayang Wu, Mengyue Zhu, Haiyong Wang, and Jinli Cao. An optimized q-learning algorithm for mobile robot local path planning. volume 286, page 111400, 2024.
- Jian Chen and JianYing Wu. Dynamic adaptive streaming based on deep reinforcement learning. Journal of Physics: Conference Series, 1237(2):022124, jun 2019.
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Belle-mare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. Human-level control through deep reinforcement learning. In Nature, volume 518, pages 529–533, 2015.
- E R Maiorov, I R Ludan, J D Motta, and O N Saprykin. Developing a microscopic city model in sumo simulation system. Journal of Physics: Conference Series, 1368(4):042081, nov 2019.
Language: English
Page range: 239 - 255
Submitted on: Dec 21, 2024
Accepted on: Feb 21, 2025
Published on: Mar 18, 2025
Published by: SAN University
In partnership with: Paradigm Publishing Services
Publication frequency: 4 times per year
Keywords:
Related subjects:
© 2025 Li-Juan Liu, Guang-Ming Bai, Hamid Reza Karimi, published by SAN University
This work is licensed under the Creative Commons Attribution 4.0 License.