A2X: An end-to-end framework for assessing agent and environment interactions in multimodal human trajectory prediction. (August 2022)

• Record Type: Journal Article
• Authors: Sohn, Samuel S.; Lee, Mihee; Moon, Seonghyeon; Qiao, Gang; Usman, Muhammad; Yoon, Sejong; Pavlovic, Vladimir; Kapadia, Mubbasir
• Is Part Of: Computers & graphics. Volume 106(2022)
• Page Start: 130
• Page End: 140
• Publication Date: 2022-08
• Subjects: Human trajectory prediction -- Datasets -- Evaluation metrics; Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2022.05.010
• Languages: English
• ISSNs: 0097-8493

Abstract

Abstract: In recent years, human trajectory prediction (HTP) has garnered attention in computer vision literature. Although this task has much in common with the longstanding task of crowd simulation, there is little from crowd simulation that has been borrowed, especially in terms of evaluation protocols. The key difference between the two tasks is that HTP is concerned with forecasting multiple steps at a time and capturing the multimodality of real human trajectories. A majority of HTP models are trained on the same few datasets, which feature small, transient interactions between real people and little to no interaction between people and the environment. Unsurprisingly, when tested on crowd egress scenarios, these models produce erroneous trajectories that accelerate too quickly and collide too frequently, but the metrics used in HTP literature cannot convey these particular issues. To address these challenges, we propose (1) the A2X dataset, which has simulated crowd egress and complex navigation scenarios that compensate for the lack of agent-to-environment interaction in existing real datasets, (2) evaluation metrics that convey model performance with more reliability and nuance, and (3) a guideline for future data acquisition in HTP. A subset of the proposed metrics are novel multiverse metrics, which are better suited for multimodal models than existing metrics. The dataset is available at: https://mubbasir.github.io/HTP-benchmark . Graphical abstract: Highlights: A new human trajectory prediction dataset featuring high agent-to-agent and agent-to-environment interactions. Novel evaluation metrics that provide greater reliability and nuance than current popular metrics. Analysis showing that future trajectory datasets should be sampled at rates higher than 20 Hz.