Iterative positive thresholding algorithm for non-negative sparse optimization. (2nd September 2018)

• Record Type: Journal Article
• Authors: Zhang, Lufang; Hu, Yaohua; Yu, Carisa Kwok Wai; Wang, Jinhua
• Is Part Of: Optimization. Volume 67:Number 9(2018)
• Page Start: 1345
• Page End: 1363
• Publication Date: 2018-09-02
• Subjects: Non-negative sparse optimization -- non-negative regularization problems -- iterative positive thresholding algorithm -- global convergence -- linear convergence rate; Mathematical optimization -- Periodicals; 519.7
• DOI: 10.1080/02331934.2018.1470629
• Languages: English
• ISSNs: 0233-1934

Abstract

Abstract: The non-negative regularization problem has been widely studied for finding non-negative sparse solutions of linear inverse problems and gained successful applications in various application areas. In the present paper, we propose an iterative positive thresholding algorithm (IPTA) to solve the non-negative regularization problem and investigate its convergence properties in finite- or infinite-dimensional Hilbert spaces. The significant advantage of the IPTA is that it is very simple and of low computation cost, and thus, it is practically attractive, especially for large-scale problems. The global convergence of the IPTA is achieved under some mild assumptions on algorithmic parameters. Furthermore, we introduce a notion of positive orthogonal sparsity pattern, and use it to establish the linear convergence rate of the IPTA to a global minimum. Finally, the numerical study on compressive sensing shows that the proposed IPTA is efficient in approaching the non-negative sparse solutions of linear inverse problems and outperforms several existing algorithms in sparse optimization.