A novel near-parallel version of k-means algorithm for n-dimensional data objects using MPI. (2016)

• Record Type: Journal Article
• Authors: Savvas, Ilias K.; Sofianidou, Georgia N.
• Is Part Of: International journal of grid and utility computing. Volume 7:Number 2(2016)
• Page Start: 80
• Page End: 91
• Publication Date: 2016
• Subjects: data mining -- k-means clustering -- MPI -- message passing interface -- parallel k-means -- big data; Electronic data processing -- Distributed processing -- Periodicals; Electronic commerce -- Management -- Computer programs -- Periodicals; 004.605
• Languages: English
• ISSNs: 1741-847X

Abstract

Nowadays, the growth of data is exponential leading to colossal amounts of information. To explore this huge amount of data, new fast algorithms must be discovered or old ones may be redesigned. One of the most useful techniques in order to extract information from data pools is clustering, and k-means is one of them. Its main disadvantage is its computational complexity, which makes it difficult to apply on big data-sets. In this study, a fully parallel version of the k-means for one-dimensional objects is presented, and in addition, a near-parallel approach for n-dimensional objects is explored. The experimental results obtained for one-dimensional data are in-line with the theoretical outcome and prove both its correctness and effectiveness while for n-dimensional objects they are so close to the outcome of the original one that either could be accepted as they are, or could be used as the initial solution for it.