Particle swarm optimization based ridge logistic estimator. Issue 3 (3rd March 2020)

• Record Type: Journal Article
• Authors: Inan, Deniz; Sancar, Nuriye
• Is Part Of: Communications in statistics. Volume 49:Issue 3(2020)
• Page Start: 669
• Page End: 683
• Publication Date: 2020-03-03
• Subjects: Multicollinearity -- Particle swarm optimization -- Ridge logistic regression -- Shrinkage parameter; Mathematical statistics -- Periodicals; Mathematical statistics -- Data processing -- Periodicals; Digital computer simulation -- Periodicals; 519.5
• DOI: 10.1080/03610918.2020.1713361
• Languages: English
• ISSNs: 0361-0918

Abstract

Abstract: Logistic regression is a commonly used method when the dependent variable is dichotomous. However, it is known that the presence of multicollinearity significantly affects maximum likelihood estimations in logistic regression models. In this case, unstable estimates, in other words, parameter estimates with high variances, are obtained. To deal with this problem, a ridge-type estimator was proposed by Schaefer et al. Ridge regression shrinks the maximum likelihood estimation vector of regression coefficients, allowing a bias but providing a smaller variance. However, the selection of shrinkage parameter λ in ridge logistic regression is an important matter. In this study, a new alternative approach based on particle swarm optimization is introduced to obtain an optimal shrinkage parameter. The performance of the new approach is evaluated by simulation studies and a real dataset application.