Abstract
The present investigation describes an adaptive non-symmetric fuzzy activation function-based extreme learning machines (ANF-ELM) for face recognition. ELMs are biologically inspired single hidden layer feed forward networks which present significant advantages over traditional back-propagation algorithm. Advantages of ELMs are low computational cost, fast learning speed, ease to implement and good performance results. In ELM, the hidden layer parameters are randomly selected and then the output weights are determined by calculating the inverse of the outputs of hidden layer. ANF-ELM is a simple single hidden layer feed forward network which gives nonlinear mapping from the input space to feature space by an adaptive non-symmetric fuzzy activation function (FAF), s. The s FAF is non-symmetric in nature with shifted origin which gives better performance compared to the symmetric activation function. The effectiveness of the ANF-ELM classifier is tested on four datasets: AT&T, Yale faces, CMU PIE and UMIST. The results show that an ANF-ELM provides good performance results and faster training speed when compared to other state of the art techniques.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Chellappa, R.; Wilson, C.L.; Sirohey, S.: Human and machine recognition of faces: a survey. Proc. IEEE 83(5), 705–740 (1995)
Zhao, W.; Chellappa, R.; Phillips, P.J.; Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 35(4), 399–458 (2003)
Li, S.Z.; Jain, A.K.: Handbook of Face Recognition. Springer, Berlin (2005)
Zou, X.; Kittler, J.; Messer, K.: Illumination invariant face recognition: a survey. In: Proceedings of 1st IEEE International Conference on Biometric: Theory, Application and Systems, pp. 1–8 (2007)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, Englewood Cliffs (1999)
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, New York (1995)
Intrator, N.; Reisfeld, D.; Yeshurun, Y.: Face recognition using a hybrid supervised/unsupervised neural network. Pattern Recognit. Lett. 17(1), 67–76 (1996)
Lin, S.H.; Kung, S.Y.; Lin, L.J.: Face recognition/detection by probabilistic decision-based neural networks. IEEE Trans. Neural Netw. 8(1), 114–132 (1997)
Huang, G.B.; Zhu, Q.Y.; Siew, C.K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of International Joint Conference on Neural Networks (Budapest, Hungary), 2(25–29), 985–990 (2004)
Haddadnia, J.; Ahmadi, M.: N-feature neural network human face recognition. Image Vis. Comput. 22(12), 1071–1082 (2004)
Brunelli, R.; Poggio, T.: Face recognition: features versus templates. IEEE Trans. Pattern Anal. Mach. Intell. 15(10), 1042–1053 (1993)
Turk, M.; Pentland, A.: Eigenfaces for recognition. J. Cogn. Neurosci. 3(1), 71–96 (1991)
Wang, Z.; Li, X.: Face recognition based on improved PCA reconstruction. Intell. Control Autom. 8, 6272–6276 (2010)
Huang, S.M.; Yang, J.F.: Improved principal component regression for face recognition under illumination variations. IEEE Trans. Signal Process. Lett. 19(4), 179–182 (2012)
Bartlett, M.S.; Movellan, J.R.; Sejnowski, T.J.: Face recognition by Independent component analysis. IEEE Trans. Neural Netw. 13(6), 1450–1464 (2002)
Etemad, K.; Chellapa, R.: Discriminant analysis for recognition of human face images. J. Opt. Soc. Am. 14(8), 1724–1733 (1997)
Shu, X.; Gao, Y.; Lu, H.: Efficient linear discriminant analysis with locality preserving for face recognition. Pattern Recognit. 45(5), 1892–1898 (2012)
Belhumeur, P.N.; Hespanha, J.P.; Kriegman, D.J.: Eigenfaces versus fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Comon, P.: Independent component analysis, a new concept. Signal Process. 36(3), 287–314 (1994)
Delac, K.; Grgic, M.; Grgic, S.: Independent comparative study of PCA, ICA, and LDA on the FERET data set. Int. J. Imaging Syst. Technol. 15(5), 252–260 (2005)
Penev, P.S.; Atick, J.J.: Local feature analysis: a general statistical theory for object representation. Comput. Neural Syst. 7, 477–500 (1996)
Wiskott, L.; Fellous, J.M.; Kruger, N.; Malsburg, C.V.: Face recognition by elastic graph matching. IEEE Trans. Pattern Recognit. Mach. Intell. 1(7), 775–779 (1997)
Bishop, C.M.: Neural Networks for Pattern Recognition‘. Oxford University Press, New York (1995)
LeCun, Y.; Boser, B.; Denker, J.; Henderson, D.; Howard, R.; Hubbard, W.; Jackel, L.: Back propagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)
Lawrence, S.; Giles, C.L.; Tsoi, A.C.; Back, A.D.: Face recognition: a convolutional neural network approach. IEEE Trans. Neural Netw. 8(1), 98–113 (1997)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Berlin (1995)
Fleming, M.; Cottrell, G.: Categorization of faces using unsupervised feature extraction. In: Proceedings of International Joint Conference on Neural Network, 90(2), 65–70 (1990)
Wright, J.; Yang, A.; Ganesh, A.; Sastry, S.; Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 1–18 (2009)
Mi, J.X.; Huang, D.S.; Wang, B.: The nearest-farthest subspace classification for face recognition. Neurocomputing 113, 241–250 (2013)
Huang, G.B.; Zhu, Q.Y.; Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1–3), 489–501 (2006)
Feng, G.; Huang, G.B.; Lin, Q.; Gay, R.: Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans. Neural Netw. 20(8), 1352–1357 (2009)
Huang, G.; Huang, G.B.; Song, S.; You, K.: Trends in extreme learning machines: a review. Neural Netw. 61(1), 32–48 (2015)
Zhu, Q.Y.; Huang, G.B.; Siew, C.K.: A fast constructive learning algorithm for single hidden layer neural networks. In: Proceedings of IEEE International Conference on Control, Automation, Robotics and Vision, pp. 1907–1911 (2004)
Li, M.B.; Er, M.J.: Nonlinear system identification using extreme learning machine. In: IEEE International Conference on Control, Automation, Robotics and Vision, 6, 1–4 (2006)
Liang, N.Y.; Huang, G.B.; Saratchandran, P.; Sundararajan, N.: A fast and accurate on-line sequential learning algorithm for feed-forward networks. IEEE Trans. Neural Netw. 17(6), 1411–1423 (2006)
Huang, G.B.; Ding, X.; Zhou, H.: Optimization method based extreme learning machine for classification. Neurocomputing 74, 155–163 (2010)
Huang, G.B.: An insight into extreme learning machines: random neurons, random features and kernels. Cogn. Comput. 6(3), 376–390 (2014)
Bai, Z.; Huang, G.B.; Wang, D.; Wang, H.; Westover, M.B.: Sparse extreme learning machine for classification. IEEE Trans. Cybern. 44(10), 1858–1870 (2014)
Tang, J.; Deng, C.; Huang, G.B.: Extreme learning machine for multilayer perceptron. IEEE Trans. Neural Netw. Learn. Syst. 27(4), 809–821 (2016)
Ghosh, A.; Shankar, B.U.; Meher, S.K.: A novel approach to neuro-fuzzy classification. Neural Netw. 22(1), 100–109 (2009)
Kwak, K.C.; Pedrycz, W.: Face recognition using a fuzzy fisher face classifier. Pattern Recognit. 38, 1717–1732 (2005)
Yang, W.; Yan, H.; Wang, J.; Yang, J.: Face recognition using complete fuzzy LDA. In: Proceedings of 19th International Conference on Pattern Recognition, 19, 1–4 (2008)
Vishwakarma, V.P.; Pandey, S.; Gupta, M.N.: Fuzzy based pixel wise information extraction for face recognition. Int. J. Eng. Technol. 2(1), 117–123 (2009)
Castano, A.; Navarro, F.F.; Martinez, C.H.: PCA-ELM: a robust and pruned extreme learning machine approach based on principal component analysis. Neural Process. Lett. 37(3), 377–392 (2013)
Xu, Y.; Zhu, Q.: A simple and fast representation-based face recognition method. Neural Comput. Appl. 22(7), 1543–1549 (2013)
Vishwakarma, V.P.: A non-iterative learning based artificial neural network classifier for face recognition under varying illuminations. Commun. Comput. Inf. Sci. Contemp. Comput. 306(5), 383–394 (2012)
Zadeh, L.A.: Fuzzy sets. Inf. Control 8, 338–353 (1965)
Klir, G.J.; Yuan, B.: Fuzzy Sets and Fuzzy Logic: Theory and Application. Prentice Hall, New Jersey (1995)
AT&T face database, [Online]. Available: http://www.cl.cam.ac.uk/Research/DTG/attarchive/pub/data/att_faces.tar.Z
Yale face database, [Online]. Available: http://cvc.cs.yale.edu/cvc/projects/yalefaces/yalefaces.html
Sim, T.; Baker, S.; Bsat, M.: The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)
UMIST Face Database, [Online]. Available: http://www.sheffield.ac.uk/eee/research/iel/research/face
MATLAB and Image Processing Toolbox Release (2010a), The MathWorks, Inc., Natick, Massachusetts, United States. retrieved on 05-05-2016
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Goel, T., Nehra, V. & Vishwakarma, V.P. An Adaptive Non-symmetric Fuzzy Activation Function-Based Extreme Learning Machines for Face Recognition. Arab J Sci Eng 42, 805–816 (2017). https://doi.org/10.1007/s13369-016-2338-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-016-2338-5