Abstract
Extreme learning machine as efficiently and effectively single-hidden layer feedforward neural network is widely applied in pattern classification, feature extraction, data prediction and so on. However, it is difficult that ELM deal with multi-feature data directly, because each feature of multi-feature data has a specific statistical property. Therefore, we proposed a robust multi-feature model based on ELM, namely, multi-feature ELM (MFELM). In particular, MFELM builds models to each single feature, and optimize the combinatorial coefficient of multi-feature by iterating. Obtain the robust output weight and the most reasonable combinatorial coefficient that achieve the minimum of training errors sum in different features. In order to avoid the model degrade into single feature and to enhance the robustness of multi-feature, we induce the higher order combinatorial coefficient. Moreover, MFELM is developed to kernel method, and propose robust kernel multi-feature ELM (MFKELM), which solve the problem that different dimensions lead to operate difficultly. MFELM and MFKELM fully explore the complementary property of multi-feature to improve the recognition accuracy, and retain the robustness to multi-feature data. We demonstrate the performance of proposed in image, text, manual multi-feature datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Huang, G.B.: An insight into extreme learning machines: random neurons, random features and kernels. Cogn. Comput. 6(3), 376–390 (2014)
Huang, G., Huang, G.B., Song, S.: Trends in extreme learning machines: a review. Neural Netw. 61, 32–48 (2015)
Huang, G.B., Zhou, H., Ding, X.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(2), 513–529 (2012)
Frnay, B., Verleysen, M.: Parameter-insensitive kernel in extreme learning for non-linear support vector regression. Neurocomputing, 74(16), 2526–2531 (2011)
Zong, W., Huang, G.B., Chen, Y.: Weighted extreme learning machine for imbalance learning. Neurocomputing 101, 229–242 (2013)
Liu, S., Feng, L., Liu, Y., Wu, J., Sun, M., Wang, W.: Robust discriminative extreme learning machine for relevance feedback in image retrieval. Multidimens. Syst. Signal Process., 1–19 (2016). https://doi.org/10.1007/s11045-016-0386-3
Huang, G., Song, S., Gupta, J.N.D.: Semi-supervised and unsupervised extreme learning machines. IEEE Trans. Cybern. 44(12), 2405–2417 (2014)
Shenglan, L., Lin, F., Yao, X., Huibing, W.: Robust activation function and its application: semi-supervised kernel extreme learning method. Neurocomputing 144, 318–328 (2014)
Kasun, L.L.C., Yang, Y., Huang, G.B.: Dimension reduction with extreme learning machine. IEEE Trans. Image Process. 25(8), 3906–3918 (2016)
Martinez, A.M.: The AR face database. CVC Technical report, 24 (1998)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)
Guo, G., Li, S.Z., Chan, K.: Face recognition by support vector machines. In: Proceedings, Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 196–201. IEEE (2000)
Sim, T., Baker, S., The, Bsat M., CMU pose, illumination, and expression (PIE) database. In: Proceedings, Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–51. IEEE (2002)
Kim, T.K., Wong, S.F., Cipolla, R., Tensor canonical correlation analysis for action classification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007)
Kumar, A., Rai, P., Daume, H.: Co-regularized multi-view spectral clustering. In: Advances in Neural Information Processing Systems, pp. 1413–1421 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Jing, Z., Yonggong, R. (2019). Robust Multi-feature Extreme Learning Machine. In: Cao, J., Vong, C., Miche, Y., Lendasse, A. (eds) Proceedings of ELM-2017. ELM 2017. Proceedings in Adaptation, Learning and Optimization, vol 10. Springer, Cham. https://doi.org/10.1007/978-3-030-01520-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-01520-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01519-0
Online ISBN: 978-3-030-01520-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)