On the Barzilai–Borwein gradient methods with structured secant equation for nonlinear least squares problems. (4th July 2022)

• Record Type: Journal Article
• Authors: Awwal, Aliyu Muhammed; Kumam, Poom; Wang, Lin; Yahaya, Mahmoud Muhammad; Mohammad, Hassan
• Is Part Of: Optimization methods and software. Volume 37:Number 4(2022)
• Page Start: 1269
• Page End: 1288
• Publication Date: 2022-07-04
• Subjects: Nonlinear least squares problems -- spectral gradient method -- nonmonotone line search -- global convergence; Mathematical optimization -- Periodicals; Algorithms -- Periodicals; 519.7
• DOI: 10.1080/10556788.2020.1855170
• Languages: English
• ISSNs: 1055-6788

Abstract

ABSTRACT: We propose structured spectral gradient algorithms for solving nonlinear least squares problems based on a modified structured secant equation. The idea was to integrate more details of the Hessian of the objective function into the standardized spectral parameters with the goal of improving numerical efficiency. We safeguard the structured spectral parameters to avoid negative curvature search direction. The sequence of the search direction generated by the respective proposed algorithm satisfies the sufficient descent condition. Using a nonmonotone line search strategy, we establish the global convergence of the proposed algorithms under some standard assumptions. Numerical experiments on some benchmark test problems show that the proposed algorithms are efficient and outperform some existing competitors.