Abstract
The kernel method is a very effective and popular method to extract features from data such as images. A novel method is presented to enhance traditional kernel method for face image representation in this paper, which is very suitable to treat the high-dimensional datasets. The proposed method is called weighted kernel representation-based method (WKRBM) in this paper. WKRBM assumes that the test sample can be expressed by all the training samples and linear solution in the mapping space. It uses the obtained linear combination to recognize face images. In particular, the coefficients of a linear combination can be set as the optimal weight that is an important factor to obtain better performance for image classification. The rationale, characteristics, and advantages of the proposed method are presented. The analysis describes that WKRBM outperforms collaborative representation-based kernel method for image recognition. Extensive experimental results illustrate that WKRBM has partial properties of sparsity, which is effective to recognize images.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Wang, G.; Shi, N.; Shu, Y.; et al.: Embedded manifold-based kernel Fisher discriminant analysis for face recognition. Neural Process. Lett. 43(1), 1–16 (2016)
Xu, Y.: A new kernel MSE algorithm for constructing efficient classification procedure. Int. J. Innov. Comput. Inf. Control 5(8), 2439–2447 (2009)
Min, H.K.; Hou, Y.; Park, S.; et al.: A computationally efficient scheme for feature extraction with kernel discriminant analysis. Pattern Recognit. 50, 45–55 (2016)
Wright, J.; Ma, Y.; Mairal, J.; et al.: Sparse representation for computer vision and pattern recognition. Proc. IEEE 98(6), 1031–1044 (2010)
Wright, J.; Yang, A.Y.; Ganesh, A.; et al.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)
Scholkopft, B.; Mullert, K.R.: Fisher discriminant analysis with kernels. In: Neural Networks for Signal Processing IX. pp. 41–48 (1999)
Xu, Y.; Zhang, D.; Jin, Z.; et al.: A fast kernel-based nonlinear discriminant analysis for multi-class problems. Pattern Recognit. 39(6), 1026–1033 (2006)
Tahir, M.A.; Kittler, J.; Bouridane, A.: Multi-label classification using stacked spectral kernel discriminant analysis. Neurocomputing 171, 127–137 (2016)
Liu, W.; Yu, Z.; Lu, L.; et al.: KCRC-LCD: Discriminative kernel collaborative representation with locality constrained dictionary for visual categorization. Pattern Recognit. 48(10), 3076–3092 (2015)
Billings, S.A.; Lee, K.L.: Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm. Neural Netw. 15(2), 263–270 (2002)
Cawley, G.C.; Talbot, N.L.C.: Efficient leave-one-out cross-validation of kernel fisher discriminant classifiers. Pattern Recognit. 36(11), 2585–2592 (2003)
Weston, J.; Schölkopf, B.; Smola, A.; et al.: Constructing descriptive and discriminative nonlinear features: Rayleigh coefficients in kernel feature spaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 623 (2003)
Tikhonov, A.N.; Arsenin, V.Y.: Solution of Ill-Posed Problems. Wiley, New York (1997)
Yang, M.H.: Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Method. In: Proceedings of Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 215–220 (2002)
Belhumeur, P.N.; Hespanha, J.P.; Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Baudat, G.; Anouar, F.: Generalized discriminant analysis using a kernel approach. Neural Comput. 12(10), 2385–2404 (2000)
Chen, L.F.; Liao, H.Y.M.; Lin, J.C.; Kao, M.D.; Yu, G.J.: A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognit. 33(10), 1713–1726 (2000)
Liu, K.; Cheng, Y.Q.; Yang, J.Y.; et al.: An efficient algorithm for Foley–Sammon optimal set of discriminant vectors by algebraic method. Int. J. Pattern Recognit. Artif. Intell. 6(05), 817–829 (1992)
Yu, H.; Yang, J.: A direct LDA algorithm for high-dimensional data—with application to face recognition. Pattern Recognit. 34(10), 2067–2070 (2001)
Yang, J.; Yang, J.: Why can LDA be performed in PCA transformed space? Pattern Recognit. 36(2), 563–566 (2003)
Yang, J.; Yang, J.: Optimal FLD algorithm for facial feature extraction. In: Intelligent Systems and Advanced Manufacturing, pp. 438–444. International Society for Optics and Photonics (2001)
Lu, J.; Plataniotis, K.N.; Venetsanopoulos, A.N.: Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans. Neural Netw. 14(1), 117–126 (2003)
Fan, Z.; Xu, Y.; Ni, M.; et al.: Individualized learning for improving kernel Fisher discriminant analysis. Pattern Recognit. 58, 100–109 (2016)
Eslami, M.; Jahanshahi, J.A.; Ghorashi, S.A.: Compressive sensing-based PSD map construction in cognitive radio networks. Arab. J. Sci. Eng. 39(2), 1147–1156 (2014)
Xu, Y.; Fan, Z.; Zhu, Q.: Feature space-based human face image representation and recognition. Opt. Eng. 51(1), 017205-1–017205-7 (2012)
Muller, K.R.; Mika, S.; Ratsch, G.; et al.: An introduction to kernel-based learning algorithms. IEEE Trans. Neural Netw. 12(2), 181–201 (2001)
Xu, Y.; Zhang, D.; Yang, J.; et al.: A two-phase test sample sparse representation method for use with face recognition. IEEE Trans. Circuits Syst. Video Technol. 21(9), 1255–1262 (2011)
Yang, M.; Zhang, L.; Yang, J. et al.: Robust sparse coding for face recognition. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 625–632. IEEE (2011)
Chen, S.; Hong, X.; Harris, C.J.: Regression based D-optimality experimental design for sparse kernel density estimation. Neurocomputing 73(4), 727–739 (2010)
Xu, Y.; Zhang, D.; Song, F.; et al.: A method for speeding up feature extraction based on KPCA. Neurocomputing 70(4), 1056–1061 (2007)
Mika, S.; Rätsch, G.; Müller, K. R.: A mathematical programming approach to the kernel fisher algorithm. In: Advances in Neural Information Processing Systems, vol. 13, pp. 591–597 (2001)
AT & T Laboratories, “The database of faces,” 2002. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html (29 December 2011)
Beck, A.; Teboulle, M.: A fast iterative shrinkage-thresholding algorithm with application to wavelet-based image deblurring. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 693–696. IEEE (2009)
Schmidt, M.; Fung, G.; Rosales, R.: Optimization methods for l1-regularization. University of British Columbia, Technical Report TR-2009, p. 19 (2009)
Yang, J.; Zhang, D.; Frangi, A.F.; et al.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 131–137 (2004)
Candès, E.J.; Li, X.; Ma, Y.; et al.: Robust principal component analysis? J. ACM (JACM) 58(3), 11 (2011)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Qin, Y., Tian, C. Weighted Feature Space Representation with Kernel for Image Classification. Arab J Sci Eng 43, 7113–7125 (2018). https://doi.org/10.1007/s13369-017-2952-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-017-2952-x