A bi-objective k-nearest-neighbors-based imputation method for multilevel data. (15th October 2022)

• Record Type: Journal Article
• Authors: Cubillos, Maximiliano; Wøhlk, Sanne; Wulff, Jesper N.
• Is Part Of: Expert systems with applications. Volume 204(2022)
• Publication Date: 2022-10-15
• Subjects: Multilevel data -- Imputation -- k-nearest neighbors; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117298
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: We propose a bi-objective algorithm based on the k -nearest neighbors (biokNN) method to perform imputation of missing values for data with multilevel structures with continuous variables. We define the imputation method as a bi-objective minimization problem and propose a solution algorithm based on a weighted objective function. The algorithm seeks imputed values that balance the dissimilarity between the k -nearest neighbors and the observations within the same cluster. The effectiveness of the proposed method is evaluated through a simulation study, and its results are compared with those of eight benchmark imputation methods. The simulation study is based on the generation of datasets with a varying-intercept–varying-slope multilevel model, and the results are compared both by using well-known accuracy metrics and by estimating the bias of the estimates after inference has been performed. Based on the simulation, the effects of different configurations of multilevel datasets are tested, including the number of clusters, their size, their similarity, the percentage of missing values, and the effect of imbalanced clusters. The results show that the proposed method outperforms the benchmark methods, especially in cases with high intraclass correlation. A comparison of fitted linear multilevel regression models shows that our method can also reduce the bias of the estimates and the coefficient of determination. Finally, the method is tested on three commonly used machine learning datasets and shows better accuracy in most cases compared with the benchmark methods. Highlights: A new imputation method for multilevel data was proposed. The method was described as a bi-objective optimization problem. The method was compared with benchmark imputation methods. Methods were tested on both simulated and benchmark data. The proposed method outperformed the traditional methods in most scenarios.