Deep Reinforcement Learning Based Traffic Signal Control: A Comparative Analysis

Chunliang Wu, Inhi Kim, Zhenliang Ma

Research output: Contribution to journalConference articlepeer-review

1 Citation (Scopus)

Abstract

More recently, the advancement of deep learning techniques enables reinforcement learning (RL) to handle high-dimensional decision-making problems. It brings increasing attention in transport areas. Some work has applied them to solve the intractable traffic signal control (TSC) problem and achieved promising results. However, very few research comprehensively investigates the impacts of key design elements, including state definitions, reward functions and deep reinforcement learning (DRL) methods, on TSC performance. To fill this research gap, this paper first selects commonly used design elements from existing literature. Then, we compare their learning stability and control performance at an isolated intersection under different scenarios via simulation experiments. The experimental results show that the quantitative state (e.g., the number of vehicles on lanes) and image-like state (e.g., vehicle position and speed) have no significant impact on the performance under different traffic demands. However, the impact of various reward functions on performance is vivid, especially under high traffic demand. Also, high-resolution vehicular network data may not be possible to improve control performance versus ordinary camera data. In addition, the value-based DRL algorithms outperform the policy-based algorithm and traditional TSC control methods. The findings of this research would provide insights and guidance for transport engineers to design an efficient DRL-based TSC system in a real traffic environment.
Original languageEnglish
Pages (from-to)275-282
Number of pages8
JournalProcedia Computer Science
Volume220
DOIs
Publication statusPublished - 17 Apr 2023
Externally publishedYes
Event14th International Conference on Ambient Systems, Networks and Technologies (ANT) - Leuven, Belgium
Duration: 15 Mar 202317 Mar 2023
https://cs-conferences.acadiau.ca/ant-23/#homePage

Fingerprint

Dive into the research topics of 'Deep Reinforcement Learning Based Traffic Signal Control: A Comparative Analysis'. Together they form a unique fingerprint.

Cite this