Pedestrian intention prediction: A convolutional bottom-up multi-task approach. (September 2021)

• Record Type: Journal Article
• Authors: Razali, Haziq; Mordan, Taylor; Alahi, Alexandre
• Is Part Of: Transportation research. Volume 130(2021)
• Publication Date: 2021-09
• Subjects: Traffic Management Systems -- Advanced Driver Assistance Systems -- Autonomous Vehicles -- Pedestrian Intention Prediction -- Human Pose Estimation -- Human Behaviour Analysis; Transportation -- Periodicals; Transportation -- Technological innovations -- Periodicals; 388.011
• DOI: 10.1016/j.trc.2021.103259
• Languages: English
• ISSNs: 0968-090X

Abstract

Highlights: A bottom-up convolutional multi-task network for pedestrian intention prediction. A runtime that is nearly independent of the number of pedestrians. Can be easily extended to perform a wide variety of vision-related tasks. Abstract: The ability to predict pedestrian behaviour is crucial for road safety, traffic management systems, Advanced Driver Assistance Systems (ADAS), and more broadly autonomous vehicles. We present a vision-based system that simultaneously locates where pedestrians are in the scene, estimates their body pose and predicts their intention to cross the road. Given a single image, our proposed neural network is designed using a bottom-up approach and thus runs at nearly constant time without relying on a pedestrian detector. Our method jointly detects human body poses and predicts their intention in a multitask framework. Experimental results show that the proposed model outperforms the precision scores of the state-of-the-art for the task of intention prediction by approximately 20% while running in real-time (5 fps). The source code is publicly available so that it can be easily integrated into an ADAS or into any traffic light management systems.