Additive Schwarz methods for convex optimization with backtracking. (1st May 2022)

• Record Type: Journal Article
• Authors: Park, Jongho
• Is Part Of: Computers & mathematics with applications. Volume 113(2022)
• Page Start: 332
• Page End: 344
• Publication Date: 2022-05-01
• Subjects: Additive Schwarz method -- Backtracking -- Acceleration -- Convergence rate -- Convex optimization; Electronic data processing -- Periodicals; Mathematics -- Data processing -- Periodicals; 510.28541
• DOI: 10.1016/j.camwa.2022.03.033
• Languages: English
• ISSNs: 0898-1221

Abstract

Abstract: This paper presents a novel backtracking strategy for additive Schwarz methods for general convex optimization problems as an acceleration scheme. The proposed backtracking strategy is independent of local solvers, so that it can be applied to any algorithms that can be represented in an abstract framework of additive Schwarz methods. Allowing for adaptive increasing and decreasing of the step size along the iterations, the convergence rate of an algorithm is improved. The improved convergence rate of the algorithm is analyzed rigorously. In addition, combining the proposed backtracking strategy with a momentum acceleration technique, we propose a further accelerated additive Schwarz method. Numerical results for various convex optimization problems such as nonlinear elliptic problems, nonsmooth problems, and nonsharp problems are presented in order to support our theory.