Bayesian dynamic modeling and monitoring of network flows. (September 2019)

• Record Type: Journal Article
• Authors: Chen, Xi; Banks, David; West, Mike
• Is Part Of: Network science. Volume 7:Number 3(2019)
• Page Start: 292
• Page End: 318
• Publication Date: 2019-09
• Subjects: Bayesian model emulation, -- decouple/recouple, -- dynamic network flow time series, -- dynamic generalized linear models, -- Internet traffic, -- parallel computing, -- state-space models; Social networks -- Research -- Periodicals; System analysis -- Periodicals; System theory -- Periodicals; Computer science -- Periodicals; 003.72
• DOI: 10.1017/nws.2019.10
• Languages: English
• ISSNs: 2050-1242

Abstract

Abstract: In the context of a motivating study of dynamic network flow data on a large-scale e-commerce website, we develop Bayesian models for online/sequential analysis for monitoring and adapting to changes reflected in node–node traffic. For large-scale networks, we customize core Bayesian time series analysis methods using dynamic generalized linear models (DGLMs). These are integrated into the context of multivariate networks using the concept of decouple/recouple that was recently introduced in multivariate time series. This method enables flexible dynamic modeling of flows on large-scale networks and exploitation of partial parallelization of analysis while maintaining coherence with an over-arching multivariate dynamic flow model. This approach is anchored in a case study on Internet data, with flows of visitors to a commercial news website defining a long time series of node–node counts on over 56, 000 node pairs. Central questions include characterizing inherent stochasticity in traffic patterns, understanding node–node interactions, adapting to dynamic changes in flows and allowing for sensitive monitoring to flag anomalies. The methodology of dynamic network DGLMs applies to many dynamic network flow studies.