Nonlinear Laplacian spectral analysis: capturing intermittent and low‐frequency spatiotemporal patterns in high‐dimensional data. (19th December 2012)

• Record Type: Journal Article
• Authors: Giannakis, Dimitrios; Majda, Andrew J.
• Is Part Of: Statistical analysis and data mining. Volume 6:Number 3(2013)
• Page Start: 180
• Page End: 194
• Publication Date: 2012-12-19
• Subjects: Data mining -- Statistical methods -- Periodicals; 006.312
• DOI: 10.1002/sam.11171
• Languages: English
• ISSNs: 1932-1864

Abstract

<abstract abstract-type="main" xml:lang="en"> <title>Abstract</title> <p>We present a technique for spatiotemporal data analysis called nonlinear Laplacian spectral analysis (NLSA), which generalizes singular spectrum analysis (SSA) to take into account the nonlinear manifold structure of complex datasets. The key principle underlying NLSA is that the functions used to represent temporal patterns should exhibit a degree of smoothness on the nonlinear data manifold <italic>M</italic>; a constraint absent from classical SSA. NLSA enforces such a notion of smoothness by requiring that temporal patterns belong in low‐dimensional Hilbert spaces <italic>V</italic><sub><italic>l</italic></sub> spanned by the leading <italic>l</italic> Laplace‐‐Beltrami eigenfunctions on <italic>M</italic>. These eigenfunctions can be evaluated efficiently in high ambient‐space dimensions using sparse graph‐theoretic algorithms. Moreover, they provide orthonormal bases to expand a family of linear maps, whose singular value decomposition leads to sets of spatiotemporal patterns at progressively finer resolution on the data manifold. The Riemannian measure of <italic>M</italic> and an adaptive graph kernel width enhances the capability of NLSA to detect important nonlinear processes, including intermittency and rare events. The minimum dimension of <italic>V</italic><sub><italic>l</italic></sub> required to capture these features while avoiding overfitting is estimated here using spectral entropy criteria.</p> <p>As an application, we study the upper‐ocean temperature in the North Pacific sector of a 700‐year control run of the CCSM3 climate model. Besides the familiar annual and decadal modes, NLSA recovers a family of intermittent processes associated with the Kuroshio current and the subtropical and subpolar gyres. These processes carry little variance (and are therefore not captured by SSA), yet their dynamical role is expected to be significant. The intermittent modes are eliminated from the spectrum if seasonal detrending is performed. © 2012 Wiley Periodicals, Inc. Statistical Analysis and Data Mining 6: 180–194, 2013</p> </abstract>