Advanced strategies on update mechanism of Sine Cosine Optimization Algorithm for feature selection in classification problems. (January 2022)

• Record Type: Journal Article
• Authors: Kale, Gizem Ataç; Yüzgeç, Uğur
• Is Part Of: Engineering applications of artificial intelligence. Volume 107(2022)
• Publication Date: 2022-01
• Subjects: Feature selection -- Sine Cosine Algorithm -- Optimization -- Classification -- Machine learning; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2021.104506
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Sine Cosine Algorithm (SCA) that is one of the population-based metaheuristic optimization algorithms basically consists of the updating mechanism based on sine and cosine functions. In this algorithm, a few random and adaptive variables are also utilized for more effective motions of the candidate solutions. SCA has some drawbacks like other some metaheuristic algorithms. SCA tends to be stuck into the local regions in the search space and this affects negatively on the computational effort required to find the best solution point in the search space. This paper presents four different improved versions of SCA. The proposed improvements on original SCA are the innovations on the updating mechanism of SCA. To evaluate the performances of Improved Sine Cosine Algorithms (ImpSCAs), well-known numerical optimization problems including CEC 2014 test suite are used. Firstly, different analyses of the proposed ImpSCAs are dealt with such as the convergence analysis, search history analysis, trajectory analysis, average distance analysis, and computational complexity analysis. Secondly, the proposed four versions of ImpSCAs are compared with the original SCA for CEC 2014 benchmark problems with dimension sizes of 10D, 30D and 50D. Finally, original SCA and ImpSCAs are adapted to select optimal feature combination and they are tested for 10 feature selection datasets taken from the UCI machine learning repository. The benchmark results show that the performances of the ImpSCA 1, ImpSCA 2, and ImpSCA 4 are better than that of the original SCA. From the feature selection results, it is observed that three versions of ImpSCAs (except ImpSCA 3 ) outperform the original SCA in 80% of the datasets. Source codes of ImpSCAs are publicly available at https://github.com/uguryuzgec/ImpSCAs . Highlights: We focused to improve the exploration and exploitation ability of the original SCA. The basic idea is based on the innovations on the update mechanism. The ISCAs were evaluated using CEC2014 benchmark test suite. The proposed ISCAs were tested for 10 popular UCI datasets. Three versions of ISCAs (except ISCA3 ) outperform the SCA in 80% of the datasets.