Convex Modeling of Interactions With Strong Heredity. Issue 4 (1st October 2016)

• Record Type: Journal Article
• Authors: Haris, Asad; Witten, Daniela; Simon, Noah
• Is Part Of: Journal of computational and graphical statistics. Volume 25:Issue 4(2016)
• Page Start: 981
• Page End: 1004
• Publication Date: 2016-10-01
• Subjects: Classification and clustering -- Linear -- Massive datasets -- Model selection/variable selection; Mathematical statistics -- Data processing -- Periodicals; Mathematical statistics -- Graphic methods -- Periodicals; 519.50285
• DOI: 10.1080/10618600.2015.1067217
• Languages: English
• ISSNs: 1061-8600

Abstract

Abstract : We consider the task of fitting a regression model involving interactions among a potentially large set of covariates, in which we wish to enforce strong heredity. We proposeFAMILY, a very general framework for this task. Our proposal is a generalization of several existing methods, such asVANISH, hierNet, the all-pairs lasso, and the lasso using only main effects. It can be formulated as the solution to a convex optimization problem, which we solve using an efficient alternating directions method of multipliers (ADMM) algorithm. This algorithm has guaranteed convergence to the global optimum, can be easily specialized to any convex penalty function of interest, and allows for a straightforward extension to the setting of generalized linear models. We derive an unbiased estimator of the degrees of freedom ofFAMILY, and explore its performance in a simulation study and on an HIV sequence dataset. Supplementary materials for this article are available online.