A stochastic alternating direction method of multipliers for non-smooth and non-convex optimization. (2nd July 2021)

• Record Type: Journal Article
• Authors: Bian, Fengmiao; Liang, Jingwei; Zhang, Xiaoqun
• Is Part Of: Inverse problems. Volume 37:Number 7(2021)
• Publication Date: 2021-07-02
• Subjects: non-convex optimization -- stochastic ADMM -- variance reduction stochastic gradient; Inverse problems (Differential equations) -- Periodicals; 515.357
• DOI: 10.1088/1361-6420/ac0966
• Languages: English
• ISSNs: 0266-5611

Abstract

Abstract: Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale of optimization problems to solve becomes large. In this paper, we consider combining ADMM with a class of variance-reduced stochastic gradient estimators for solving large-scale non-convex and non-smooth optimization problems. Global convergence of the generated sequence is established under the additional assumption that the object function satisfies Kurdyka-Łojasiewicz property. Numerical experiments on graph-guided fused lasso and computed tomography are presented to demonstrate the performance of the proposed methods.