Abstract
The new method for incremental learning of SVM model incorporating recently proposed TEDA approach is proposed. The method updates the widely renowned incremental SVM approach, as well as introduces new TEDA and RDE kernels which are learnable and capable of adaptation to data. The slack variables are also adaptive and depend on each point’s ‘importance’ combining the outliers detection with SVM slack variables to deal with misclassifications. Some suggestions on the evolving systems based on SVM are also provided. The examples of image recognition are provided to give a ‘proof of concept’ for the method.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Vapnik, V., Lerner, A.: Pattern recognition using generalised portrait method. Automation and Remote Control 24, 774–780 (1963)
Vapnik, V.N., Ya, A., Chervonenkis.: Teorija raspoznavanija obrazov: Statisticheskie problemy obuchenija. (Russian) = Theory of pattern recognition: Statistical problems of learning. Nauka, Moscow (1974)
Boser, B.E., Guyon, I.M., Vapnik, V.N.: A training algorithm for optimal margin classifiers. In: COLT 1992: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144–152. ACM Press, New York (1992)
Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer-Verlag New York, Inc. (1995)
Yang, J., Estivill-Castro, V., Chalup, S.K.: Support vector clustering through proximity graph modelling. In: Proceedings of the 9th International Conference on Neural Information Processing, ICONIP 2002, vol. 2. IEEE (2002)
Chen, Y., Zhou, X., Huang, T.S.: One-class SVM for learning in image retrieval. In: Proceedings of the International Conference on Image Processing, vol. 1. IEEE (2001)
Tsochantaridis, I., et al.: Support vector machine learning for interdependent and structured output spaces. In: Proceedings of the Twenty-First International Conference on Machine Learning. ACM (2004)
Angelov, P.: Outside the Box: An Alternative Data Analytics Framework. Journal of Automation, Mobile Robotics and Intelligent Systems 8(2), 53–59 (2014)
Kangin, D., Angelov, P.: New Autonomously Evolving Classifier TEDAClass. IEEE Transactions on Cybernetics (2014, submitted)
Angelov, P.: Anomaly detection based on eccentricity analysis. In: 2014 IEEE Symposium Series on Computational Intelligence, 9-12 December, Orlando, Florida (2014, to appear, accepted to publication)
Angelov, P., Filev, D., Kasabov, N. (eds.) Evolving Intelligent Systems: Methodology and Applications. IEEE Press Series on Computational Intelligence, p. 444. John Willey and Sons (April 2010) ISBN: 978-0-470-28719-4
Angelov, P.: Autonomous Learning Systems: From Data Streams to Knowledge in Real time. John Willey and Sons (December 2012) ISBN: 978-1-1199-5152-0
Angelov, P., Kangin, D., Zhou, X., Kolev, D.: Symbol recognition with a new autonomously evolving classifier autoclass. In 2014 IEEE Conference on Evolving and Adaptive Intelligent Systems, pp. 1–6. IEEE (2014); DOI BibTeX
Angelov, P., Yager, R.: A new type of simplified fuzzy rule-based systems. International Journal of General Systems 41(2), 163–185 (2012)
Angelov, P., Zhou, X., Klawonn, F.: Evolving fuzzy rule-based classifiers. In: First 2007 IEEE International Conference on Computational Intelligence Applications for Signal and Image Processing, April 1-5, Honolulu, Hawaii, USA, pp. 220–225 (2007)
Kasabov, N., Liang, L., Krishnamurthi, R., Feigin, V., Othman, M., Hou, Z., Parmar, P.: Evolving Spiking Neural Networks for Personalised Modelling of Spatio-Temporal Data and Early Prediction of Events: A Case Study on Stroke. Neurocomputing 134, 269–279 (2014)
Bishop, C.M.: Pattern recognition and machine learning, pp. 325–358. Springer, New York (2006)
Schölkopf, B., Smola, A., Williamson, R.C., Bartlett, P.L.: New support vector algorithms. Neural Computation 12, 1207–1245 (2000)
Mahalanobis, P.C.: On the generalised distance in statistics. Proceedings of the National Institute of Sciences of India 2(1), 49–55 (1936)
Li, B., Han, L.: Distance weighted cosine similarity measure for text classification. In: Yin, H., Tang, K., Gao, Y., Klawonn, F., Lee, M., Weise, T., Li, B., Yao, X. (eds.) IDEAL 2013. LNCS, vol. 8206, pp. 611–618. Springer, Heidelberg (2013)
Keerthi, S.S., Lin, C.-J.: Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Computation 15(7), 1667–1689 (2003)
Maji, S., Berg, A.C., Malik, J.: Classification using intersection kernel support vector machines is efficient. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE (2008)
Chen, B., Zheng, N., Principe, J.C.: Survival kernel with application to kernel adaptive filtering. In: The 2013 International Joint Conference on IEEE Neural Networks (IJCNN) (2013)
Cauwenberghs, G., Poggio, T.: Incremental and Decremental Support Vector Machine Learning. NIPS, pp. 409–415 (2000)
Li, L.-J., Fei-Fei, L.: What, where and who? Classifying events by scene and object recognition. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8 (2007)
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision 42(3), 145–175 (2001). Gist Descriptor (Matlab code). http://people.csail.mit.edu/torralba/code/spatialenvelope/b
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Kangin, D., Angelov, P. (2015). Recursive SVM Based on TEDA. In: Gammerman, A., Vovk, V., Papadopoulos, H. (eds) Statistical Learning and Data Sciences. SLDS 2015. Lecture Notes in Computer Science(), vol 9047. Springer, Cham. https://doi.org/10.1007/978-3-319-17091-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-17091-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-17090-9
Online ISBN: 978-3-319-17091-6
eBook Packages: Computer ScienceComputer Science (R0)