A quasi-Newton proximal bundle method using gradient sampling technique for minimizing nonsmooth convex functions. (4th July 2022)

• Record Type: Journal Article
• Authors: Maleknia, Morteza; Shamsi, Mostafa
• Is Part Of: Optimization methods and software. Volume 37:Number 4(2022)
• Page Start: 1415
• Page End: 1446
• Publication Date: 2022-07-04
• Subjects: Unconstrained minimization -- nonsmooth convex functions -- bundle method -- gradient sampling -- Quasi-Newton; 90C26 -- 49M37 -- 65K05 -- 49M05; Mathematical optimization -- Periodicals; Algorithms -- Periodicals; 519.7
• DOI: 10.1080/10556788.2021.2023522
• Languages: English
• ISSNs: 1055-6788

Abstract

Abstract : This study aims to merge the well-established ideas of bundle and Gradient Sampling (GS) methods to develop an algorithm for locating a minimizer of a nonsmooth convex function. In the proposed method, with the help of the GS technique, we sample a number of differentiable auxiliary points around the current iterate. Then, by applying the standard techniques used in bundle methods, we construct a polyhedral (piecewise linear) model of the objective function. Moreover, by performing quasi-Newton updates on the set of auxiliary points, this polyhedral model is augmented with a regularization term that enjoys second-order information. If required, this initial model is improved by the techniques frequently used in GS and bundle methods. We analyse the global convergence of the proposed method. As opposed to the original GS method and some of its variants, our convergence analysis is independent of the size of the sample. In our numerical experiments, various aspects of the proposed method are examined using a variety of test problems. In particular, in contrast with many variants of bundle methods, we will see that the user can supply gradients approximately. Moreover, we compare the proposed method with some efficient variants of GS and bundle methods.