Abstract
In many computer vision applications for recognition or classification, outlier detection plays an important role as it affects the accuracy and reliability of the result. We propose a novel approach for outlier detection using Gaussian process classification. With this approach, the outlier detection can be integrated to the classification process, instead of being treated separately. Experimental results on handwritten digit image recognition and vision based robot localization show that our approach performs better than other state of the art approaches.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
- Support Vector Machine
- Gaussian Process
- Class Support Vector Machine
- Outlier Detection
- Training Sequence
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Markou, M., Singh, S.: Novelty detection: a review-part 1: statistical approaches. Signal Processing 83, 2481–2497 (2003)
Automatic Outlier Detection: A Bayesian Approach. In: 2007 IEEE International Conference on Robotics and Automation (2007)
Tax, D.M.J., Duin, R.P.W.: Growing a multi-class classifier with a reject option. Pattern Recogn. Lett. 29, 1565–1570 (2008)
Singh, S., Markou, M.: An approach to novelty detection applied to the classification of image regions. IEEE Trans. on Knowl. and Data Eng. 16, 396–407 (2004)
Lukashevich, H., Nowak, S., Dunker, P.: Using one-class svm outliers detection for verification of collaboratively tagged image training sets. In: ICME 2009, pp. 682–685 (2009)
Loureiro, A., Torgo, L., Soares, C.: Outlier detection using clustering methods: a data cleaning application. In: Proceedings of the Data Mining for Business Workshop (2004)
Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets. SIGMOD Rec. 29, 427–438 (2000)
Lauer, M.: A mixture approach to novelty detection using training data with outliers. In: Flach, P.A., De Raedt, L. (eds.) ECML 2001. LNCS (LNAI), vol. 2167, pp. 300–311. Springer, Heidelberg (2001)
Xing, H., Wang, X., Zhu, R., Wang, D.: Application of kernel learning vector quantization to novelty detection, pp. 439–443 (2008)
Muñoz, A., Moguerza, J.M.: One-class support vector machines and density estimation: The precise relation. In: Sanfeliu, A., Martínez Trinidad, J.F., Carrasco Ochoa, J.A. (eds.) CIARP 2004. LNCS, vol. 3287, pp. 216–223. Springer, Heidelberg (2004)
Chen, Y., Zhou, X.S., Huang, T.: One-class Svm for Learning in Image Retrieval, vol. 1, pp. 34–37 (2001)
Masud, M.M., Gao, J., Khan, L., Han, J., Thuraisingham, B.: Integrating novel class detection with classification for concept-drifting data streams. In: Buntine, W., Grobelnik, M., Mladenić, D., Shawe-Taylor, J. (eds.) ECML PKDD 2009. LNCS, vol. 5782, pp. 79–94. Springer, Heidelberg (2009)
Hempstalk, K., Frank, E.: Discriminating against new classes: One-class versus multi-class classification. In: Wobcke, W., Zhang, M. (eds.) AI 2008. LNCS (LNAI), vol. 5360, pp. 325–336. Springer, Heidelberg (2008)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. The MIT Press, Cambridge (2006)
Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. In: ACM Special Interest Group on Graphics and Interactive Techniques Conference (SIGGRAPH), pp. 522–531 (2004)
Lawrence, N.D.: Gaussian process latent variable models for visualisation of high dimensional data. In: Advances in Neural Information Processing Systems, vol. 16 (2004)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, Chichester (2001)
Clifton, L.A., Yin, H., Clifton, D.A., Zhang, Y.: Combined support vector novelty detection for multi-channel combustion data. In: ICNSC, pp. 495–500 (2007)
Tax, D.M.J., Ypma, A., Duin, R.P.W.: Support Vector Data Description Applied to Machine Vibration Analysis (1999)
Heller, K.A., Svore, K.M., Keromytis, A.D., Stolfo, S.J.: One class support vector machines for detecting anomalous windows registry accesses. In: Proc. of the Workshop on Data Mining for Computer Security (2003)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines Software (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm
Luo, J., Pronobis, A., Caputo, B., Jensfelt, P.: Incremental learning for place recognition in dynamic environments. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), San Diego, CA, USA (2007)
Caputo, B., Pronobis, A., Jensfelt, P.: Overview of the clef 2009 robot vision track. In: CLEF working notes 2009, Corfu, Greece (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gao, Y., Li, Y. (2011). Improving Gaussian Process Classification with Outlier Detection, with Applications in Image Classification. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6495. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19282-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-19282-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19281-4
Online ISBN: 978-3-642-19282-1
eBook Packages: Computer ScienceComputer Science (R0)