Intelligent vehicle pedestrian light (IVPL): A deep reinforcement learning approach for traffic signal control. (April 2023)

• Record Type: Journal Article
• Authors: Yazdani, Mobin; Sarvi, Majid; Asadi Bagloee, Saeed; Nassir, Neema; Price, Jeff; Parineh, Hossein
• Is Part Of: Transportation research. Volume 149(2023)
• Publication Date: 2023-04
• Subjects: Reinforcement learning -- Deep learning -- Adaptive traffic signal control -- Mixed traffic environment -- Pedestrian crossing signal; Transportation -- Periodicals; Transportation -- Technological innovations -- Periodicals; 388.011
• DOI: 10.1016/j.trc.2022.103991
• Languages: English
• ISSNs: 0968-090X

Abstract

Highlights: A deep reinforcement learning based traffic signal model is proposed to control vehicles and pedestrians. An extended reward function is designed to capture the delays due to the road users' interactions. The baselines are adopted based on real-world traffic signal control logic, parameters, and data. The effect of pedestrian jaywalking and traffic flow interruptions are evaluated in different scenarios. The results have shown the superiority of the proposed model to improve total user delays. Abstract: Deep reinforcement learning (RL) has been widely studied in traffic signal control. Despite the promising results that indicate the superiority of deep RL in terms of the quality of solution and optimality over fixed time signal control, the real-world multi-modal traffic flows, especially pedestrians, are not properly considered nor sufficiently investigated. This study presents a novel deep RL-based adaptive traffic signal model to control the vehicles and pedestrian flows by allocating an equitable green time to each, aiming at minimizing "total user delays" as opposed to "total vehicle delays" dominantly being used in the literature. Our proposed intelligent vehicle pedestrian light (IVPL) method can perform in the absence or presence of pedestrians, especially when there is jaywalking at the intersection, interrupting vehicle flows. To this end, an extended reward function is designed to capture delays due to vehicle-to-vehicle, vehicle-to-pedestrian, and pedestrian-to-pedestrian interactions, as well as red-light delays for vehicles and pedestrians. To evaluate the performance of IVPL, a microsimulation model of an intersection in city of Melbourne is used as a case-study. The real traffic signal parameters of an existing operation system (SCATS) are employed, and the simulation is calibrated using video-based camera data and loop detectors data collected at intersection. The experimental results demonstrate the superiority of the proposed model over fully actuated traffic signal, not only in terms of the quality of optimal solution, but also considering the fact that the proposed model can minimize the "total user delays".