Abstract
Machine Learning (ML) is the process of extracting knowledge from current information to enable machine to predict new information based on the learned knowledge. Many ML algorithms aim at improving the learning process. Support vector machine (SVM) is one of the best classifiers for hyper-spectral images. As many of the ML algorithms, SVM training require a high computational cost that considered a very large quadratic programming optimization problem. The proposed sequential minimal optimization solve the highly computational problems using a hybrid parallel model that employs both graphical processing unit to implement binary-classifier and message passing interface to solve multi-class on “one-against-one” method. Our hybrid implementation achieves a speed up of 40X over the sequential (LIBSVM), a speed up of 7.5X over the CUDA-OPENMP for training dataset of 44442 records and 102 features size for 9 classes and a speed up of 13.7X over LIBSVM in classification process for 60300 records.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
NVIDIA Corporation: NVIDIA CUDA C Programming Guide (2010)
Sanders, J., Kandrot, E.: CUDA by Example: An Introduction to General-Purpose GPU Programming, 1st edn. Addison-Wesley Professional, Reading (2010)
Khaled, H., Faheem, H.M., El-Gohary, R.: Design and implementation of a hybrid MPI-CUDA model for the Smith–Waterman algorithm. Int. J. Data Min. Bioinform. 12(3), 313–327 (2015)
Aoyama, Y., Nakano, J., et al.: Rs/6000 sp: Practical MPI Programming. IBM Poughkeepsie, New York (1999)
Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: Proceedings of the 25th International Conference on Machine Learning, pp. 104–111 (2008)
Carlos, J., Ribeiro, B., Lopes, N.: Development of support vector machines (SVMs) in graphics processing units for pattern recognition (2012)
Lopes, N., Ribeiro, B.: GPU machine learning library (GPUMLib). In: 2015 Machine Learning for Adaptive Many-Core Machines - A Practical Approach. Springer, Cham, pp. 15–36 (2015)
Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)
Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to Platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Platt, J.: Sequential minimal optimization: a fast algorithm for training support vector machines (1998)
Fan, R.-E., Chen, P.-H., Lin, C.-J.: Working set selection using second order ınformation for training support vector machines. J. Mach. Learn. Res. 6, 1889–1918 (2005)
Hsu, C.-W., Lin, C.-J.: A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)
Goetz, A.F., Vane, G., Solomon, J.E., Rock, B.N.: Imaging spectrometry for earth remote sensing. Science 228, 1147–1153 (1985)
Green, R.O., et al.: Imaging spectroscopy and the airborne visible/ınfrared ımaging spectrometer (AVIRIS). Remote Sens. Environ. 65(3), 227–248 (1998)
Tan, K., Zhang, J., Du, Q., Wang, X.: GPU parallel implementation of support vector machines for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(10), 4647–4656 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Elgarhy, I., Khaled, H., Gohary, R.E., Faheem, H.M. (2019). Multi-class Support Vector Machine Training and Classification Based on MPI-GPU Hybrid Parallel Architecture. In: Hassanien, A., Tolba, M., Shaalan, K., Azar, A. (eds) Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018. AISI 2018. Advances in Intelligent Systems and Computing, vol 845. Springer, Cham. https://doi.org/10.1007/978-3-319-99010-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-99010-1_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99009-5
Online ISBN: 978-3-319-99010-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)