A general framework of online updating variable selection for generalized linear models with streaming datasets. Issue 3 (11th February 2023)

• Record Type: Journal Article
• Authors: Ma, Xiaoyu; Lin, Lu; Gai, Yujie
• Is Part Of: Journal of statistical computation and simulation. Volume 93:Issue 3(2023)
• Page Start: 325
• Page End: 340
• Publication Date: 2023-02-11
• Subjects: Streaming data environment -- penalized likelihoods -- online updating criterion -- oracle property; Mathematical statistics -- Data processing -- Periodicals; Digital computer simulation -- Periodicals; 519.5028505
• DOI: 10.1080/00949655.2022.2107207
• Languages: English
• ISSNs: 0094-9655

Abstract

ABSTRACT: In the era of big data, one of the important issues is how to recover the sets of true features when the data sets arrive sequentially. The paper presents a general framework for online updating variable selection and parameter estimation in generalized linear models with streaming datasets. This is a type of online updating penalized likelihoods with differentiable or non-differentiable penalty functions. An online updating coordinate descent algorithm is proposed for solving the online updating optimization problem. Moreover, a tuning parameter selection is suggested in an online updating way. The selection and estimation consistencies and the oracle property are established, theoretically. Our methods are further examined and illustrated by various numerical examples from both simulation experiments and a real data analysis.