An evolutionary approach for high dimensional attribute selection. (1st January 2012)

• Record Type: Journal Article
• Authors: Boudjeloud-Assala, Lydia
• Is Part Of: International journal of intelligent information and database systems. Volume 6:Number 6(2012)
• Page Start: 578
• Page End: 602
• Publication Date: 2012-01-01
• Subjects: evolutionary approach -- high dimensional datasets -- clustering -- attribute selection -- outlier detection -- visualisation; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

We present a method to select a relevant dimension subset (with few or no loss of information) for clustering and outlier detection in high dimensional datasets. We use a heuristic search for relevant dimension subset selection based on genetic algorithm. The genetic algorithm fitness function for clustering uses the validity indexes of classification algorithms. We first use these validity indexes to select a dimension subset and then, to evaluate the clustering quality in this subspace. For outlier detection, the genetic algorithm fitness function is an individual distance-based function. The performances of our new approach of dimension selection are evaluated on simulations with different high dimensional datasets for the two applications (clustering and outlier detection). Furthermore, as the number of dimensions is low, it is possible to display the datasets in order to visually evaluate and interpret the obtained results.