In the article, modern approaches to the development of Intelligent Transportation Systems (ITS) aimed at optimizing urban traffic are analyzed. Special attention is paid to model-free reinforcement learning algorithms (Q-Learning and Deep Q-Learning) used for controlling traffic lights in dynamic road traffic conditions. Simulation results in the SUMO environment have proven that implementing such algorithms significantly reduces intersection queues and increases the capacity of the transportation network. In particular, the use of Deep Q-Learning enables more efficient processing of large volumes of data, including information from IoT sensors and V2X technologies, fostering realistic adaptation to changing traffic conditions. The prospects for further research involve enhancing deep neural networks and multi-agent methods, which will improve traffic management outcomes in urban environments and lay the foundation for creating ‘smart’ transportation infrastructures.
- Majstorović Ž., Tišljarić L., Ivanjko E., Carić T. Urban Traffic Signal Control under Mixed Traffic Flows: Literature Review. Applied Sciences. 2023. 13(7). 4484. Doi: https://doi.org/10.3390/app13074484.
- Ouyang Chen, Zhan Zhenfei, Lv Fengyao. A Comparative Study of Traffic Signal Control Based on Reinforcement Learning Algorithms. World Electric Vehicle Journal. 2024. 15. 246. 10.3390/wevj15060246.
- Jin J. et al. CoLight: Learning Network-Level Cooperation for Traffic Signal Control. Proceedings of the AAAI Conference on Artificial Intelligence. Hua Wei, Nan Xu, Huichu Zhang, Guanjie Zheng, Xinshi Zang, Chacha Chen, Weinan Zhang, Yanmin Zhu, Kai Xu, and Zhenhui Li. 2019. CoLight: Learning Network-level Cooperation for Traffic Signal Control. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM '19). Association for Computing Machinery, New York, NY, USA, 2019. 1913–1922. Doi: https://doi.org/10.1145/3357384.3357902.
- Wei Hua, Zheng Guanjie, Yao Huaxiu, Li Zhenhui. IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control. 2018. 2496-2505. Doi: 10.1145/3219819.3220096.
- Rasheed Faizan, Yau Kok-Lim, Md. Noor Rafidah, Wu Celimuge, Low Yeh Ching. Deep Reinforcement Learning for Traffic Signal Control. IEEE Access. 8. 2020. 208016-208044. Doi: 10.1109/ACCESS.2020.3034141.
- Abid Ali Awan. An Introduction to Q-Learning: A Tutorial For Beginners. URL: https://www.datacamp.com/tutorial/introduction-q-learning-beginner-tutorial.
- Samina Amin. Deep Q-Learning (DQN). URL: https://medium.com/@samina.amin/deep-q-learning-dqn- 71c109586bae.