Stochastic traffic modelling and decentralised signal control based on a state transition probability model. Issue 8 (5th July 2018)

• Record Type: Journal Article
• Authors: Xu, Yunwen; Li, Dewei; Xi, Yugeng
• Is Part Of: IET intelligent transport systems. Volume 12:Issue 8(2018)
• Page Start: 909
• Page End: 920
• Publication Date: 2018-07-05
• Subjects: probability -- decentralised control -- stochastic systems -- matrix algebra -- Markov processes -- decision theory -- iterative methods -- sensitivity analysis -- traffic control; optimisation efficiency -- compact region control -- traffic performance -- numerical study -- sensitivity‐based policy iteration algorithm -- Markov decision process -- stochastic signal control problem -- dimension expansion -- virtual input links -- virtual node -- occupancy rate -- congestion level -- isolated intersection -- link‐based state transition probability matrix -- state transition probability model -- decentralised signal control -- stochastic traffic modelling; Intelligent transportation systems -- Periodicals; Electronics in transportation -- Periodicals; 388.31205
• DOI: 10.1049/iet-its.2018.5154
• Languages: English
• ISSNs: 1751-956X

Abstract

Abstract : In this study, the authors develop a state transition probability model for an isolated intersection on the basis of link‐based state transition probability matrix. The state of an intersection is defined as the combination of its input links' states which represent their respective congestion level by occupancy rate. This way of modelling is further extended to a compact region by likening the region to a virtual node with several virtual input links to avoid dimension expansion. Based on the state transition probability model, the stochastic signal control problem for both intersections and compact regions is formulated as a Markov decision process with the specified definition of state, action, probability and reward. A sensitivity‐based policy iteration algorithm is employed to solve the Markov decision process in real‐time, which has a great advantage in computational efficiency. The results of the numerical study on a calibrated network of Caohejing District in Shanghai indicate that the authors' proposed method outperforms the fixed‐time and actuated signal control at high loads in terms of many indices and greatly decreases the variability in the traffic performance. In addition, the compact region control can improve the optimisation efficiency while providing similar performance to the intersection control at different loads.