Evaluating automatically parallelized versions of the support vector machine. (9th October 2014)

• Record Type: Journal Article
• Authors: Codreanu, Valeriu; Dröge, Bob; Williams, David; Yasar, Burhan; Yang, Po; Liu, Baoquan; Dong, Feng; Surinta, Olarik; Schomaker, Lambert R.B.; Roerdink, Jos B.T.M.; Wiering, Marco A.
• Other Names: Olabarriaga Silvia Delgado guestEditor.; Wilkins‐Diehr Nancy guestEditor.; Smari Waleed W. guestEditor.; Bakhouya Mohamed guestEditor.; Fiore Sandro guestEditor.; Aloisio Giovanni guestEditor.
• Is Part Of: Concurrency and computation. Volume 28:Number 7(2016)
• Page Start: 2274
• Page End: 2294
• Publication Date: 2014-10-09
• Subjects: GPU -- automatic parallelization -- handwritten digit recognition -- machine learning -- support vector machine; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3413
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: The support vector machine (SVM) is a supervised learning algorithm used for recognizing patterns in data. It is a very popular technique in machine learning and has been successfully used in applications such as image classification, protein classification, and handwriting recognition. However, the computational complexity of the kernelized version of the algorithm grows quadratically with the number of training examples. To tackle this high computational complexity, we have developed a directive‐based approach that converts a gradient‐ascent based training algorithm for the CPU to an efficient graphics processing unit (GPU) implementation. We compare our GPU‐based SVM training algorithm to the standard LibSVM CPU implementation, a highly optimized GPU‐LibSVM implementation, as well as to a directive‐based OpenACC implementation. The results on different handwritten digit classification datasets demonstrate an important speed‐up for the current approach when compared to the CPU and OpenACC versions. Furthermore, our solution is almost as fast and sometimes even faster than the highly optimized CUBLAS‐based GPU‐LibSVM implementation, without sacrificing the algorithm's accuracy. Copyright © 2014 John Wiley & Sons, Ltd.