Outlier detection in traffic data based on the Dirichlet process mixture model. Issue 7 (1st September 2015)

• Record Type: Journal Article
• Authors: Ngan, Henry Y.T.; Yung, Nelson H.C.; Yeh, Anthony G.O.
• Is Part Of: IET intelligent transport systems. Volume 9:Issue 7(2015)
• Page Start: 773
• Page End: 781
• Publication Date: 2015-09-01
• Subjects: traffic information systems -- data handling -- vectors -- spatiotemporal phenomena -- road traffic; outlier detection -- Dirichlet process mixture model -- road network management -- traffic behaviour -- large‐scale traffic data -- DPMM -- traffic signals -- covariance signal descriptor -- vector dimension -- spatial‐temporal similarities; Intelligent transportation systems -- Periodicals; Electronics in transportation -- Periodicals; 388.31205
• DOI: 10.1049/iet-its.2014.0063
• Languages: English
• ISSNs: 1751-956X

Abstract

Abstract : Traffic data collections are exceedingly useful for road network management. Such collections are typically massive and are full of errors, noise and abnormal traffic behaviour. These abnormalities are regarded as outliers because they are inconsistent with the rest of the data. Hence, the problem of outlier detection (OD) is non‐trivial. This paper presents a novel method for detecting outliers in large‐scale traffic data by modelling the information as a Dirichlet process mixture model (DPMM). In essence, input traffic signals are truncated and mapped to a covariance signal descriptor, and the vector dimension is then further reduced by principal component analysis. This modified signal vector is then modelled by a DPMM. Traffic signals generally share heavy spatial‐temporal similarities within signals or among various categories of traffic signals, and previous OD methods have proved incapable of properly discerning these similarities or differences. The contribution of this study is to represent real‐world traffic data by a robust DPMM‐based method and to perform an unsupervised OD to achieve a detection rate of 96.67% in a ten‐fold cross validation.