Metric selection in fast dual forward–backward splitting. (December 2015)

• Record Type: Journal Article
• Authors: Giselsson, Pontus; Boyd, Stephen
• Is Part Of: Automatica. Volume 62(2015)
• Page Start: 1
• Page End: 10
• Publication Date: 2015-12
• Subjects: First order optimization algorithms -- Metric selection -- Preconditioning -- Model predictive control -- Distributed optimization; Automatic control -- Periodicals; Automation -- Periodicals; 629.805
• DOI: 10.1016/j.automatica.2015.09.010
• Languages: English
• ISSNs: 0005-1098

Abstract

Abstract: The performance of fast forward–backward splitting, or equivalently fast proximal gradient methods, depends on the conditioning of the optimization problem data. This conditioning is related to a metric that is defined by the space on which the optimization problem is stated; selecting a space on which the optimization data is better conditioned improves the performance of the algorithm. In this paper, we propose several methods, with different computational complexity, to find a space on which the algorithm performs well. We evaluate the proposed metric selection procedures by comparing the performance to the case when the Euclidean space is used. For the most ill-conditioned problem we consider, the computational complexity is improved by two to three orders of magnitude. We also report comparable to superior performance compared to state-of-the-art optimization software.