A Sharper Computational Tool for Regression. Issue 1 (2nd January 2023)

• Record Type: Journal Article
• Authors: Liu, Xiaoqian; Chi, Eric C.; Lange, Kenneth
• Is Part Of: Technometrics. Volume 65:Issue 1(2023)
• Page Start: 117
• Page End: 126
• Publication Date: 2023-01-02
• Subjects: Distance penalization -- Integral squared error criterion -- MM principle -- Newton's method -- Penalized estimation; Statistical physics -- Periodicals; Chemistry -- Statistical methods -- Periodicals; Engineering -- Statistical methods -- Periodicals; 519.5
• DOI: 10.1080/00401706.2022.2118172
• Languages: English
• ISSNs: 0040-1706

Abstract

Abstract: Building on previous research of Chi and Chi, this article revisits estimation in robust structured regression under the L 2 E criterion. We adopt the majorization-minimization (MM) principle to design a new algorithm for updating the vector of regression coefficients. Our sharp majorization achieves faster convergence than the previous alternating proximal gradient descent algorithm by Chi and Chi. In addition, we reparameterize the model by substituting precision for scale and estimate precision via a modified Newton's method. This simplifies and accelerates overall estimation. We also introduce distance-to-set penalties to enable constrained estimation under nonconvex constraint sets. This tactic also improves performance in coefficient estimation and structure recovery. Finally, we demonstrate the merits of our improved tactics through a rich set of simulation examples and a real data application.