Tuning parameters via a new rapid, accurate and parameter-less method using meta-learning. (6th September 2019)

• Record Type: Journal Article
• Authors: Hekmatinia, Alireza; Shanghooshabad, Ali Mohammadi; Motevali, Mohammad Mahdi; Almasi, Mehrdad
• Is Part Of: International journal of data mining, modelling and management. Volume 11:Number 4(2019)
• Page Start: 366
• Page End: 390
• Publication Date: 2019-09-06
• Subjects: parameter tuning -- meta learning -- meta feature -- SVM tuning -- genetic algorithm; Data mining -- Periodicals; Information science -- Periodicals; Databases -- Periodicals; 005.7
• Languages: English
• ISSNs: 1759-1163

Abstract

Dealing with a large parameter space in data mining tasks is extremely time-consuming, and the tuning method itself needs to be tuned since methods themselves have at least one parameter. Here, a new rapid and parameter-less method is presented to tune algorithms on diverse datasets to achieve high quality results in a short consumed time. The method presented here uses a pre-knowledge by using meta-features to guess closer point to optimal point in parameter space of target algorithms (here, support vector machine algorithm is used). For preparing the pre-knowledge, 282 meta-features are introduced and then genetic algorithm is applied to determine best meta-features for the target algorithm. Then the best meta-features are used to tune the target algorithm on unseen datasets. The results show in less than 0.19 minute in average, the method obtains approximately the same classification rates in comparison with others, but the consumed time is dramatically declined.