Skip to main content

Emotion Recognition Techniques

  • Conference paper
  • First Online:
Advances in Machine Intelligence and Computer Science Applications (ICMICSA 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 656))

  • 236 Accesses

Abstract

This article evaluates techniques for obtaining facial images from convolutional neural networks to identify emotion expressions. The primary goal of the paper is to discuss the most often used approaches to analyzing and recognizing emotional expressions on the face. The works that were reviewed might be divided into two major trends: the traditional techniques and those that were especially developed using neural networks.The analysis revealed that using CNNs improved level of performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Biswas, S., Sil, J.: An efficient expression recognition method using contourlet transform, In: Proceedings of the 2nd International Conference on Perception and Machine Intelligence, pp. 167–174. ACM (2015)

    Google Scholar 

  2. Lopes, A.T., et al.: A facial expression recognition system using convolutional networks. In: 28th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 273–280. IEEE (2015)

    Google Scholar 

  3. Puthanidam, R.V., Moh, T.S.: A hybrid approach for facial expression recognition. In: Proceedings of the 12th International Conference on Ubiquitous Information Management and Communication, p. 60. ACM (2018)

    Google Scholar 

  4. Turabzadeh, S., et al.: Real-time emotional state detection from facial expression on embedded devices. In: Seventh International Conference on Innovative Computing Technology (INTECH), pp. 46–51. IEEE (2017)

    Google Scholar 

  5. Canal, F.Z., et al.: A survey on facial emotion recognition techniques: a state-of-the-art literature review. Inf. Sci. 593–617 (2021)

    Google Scholar 

  6. Li, S., Deng, W.: Deep facial expression recognition: a survey (2018)

    Google Scholar 

  7. Abhishree, T.M., et al.: Face recognition using Gabor filter based feature extraction with anisotropic diffusion as a pre-processing technique. Procedia Comput. Sci. (2015)

    Google Scholar 

  8. Rajesh, G., et al.: Facial sentiment analysis using AI techniques: state-of-the-art, taxonomies, and challenges. 25 (2020)

    Google Scholar 

  9. Taylor, P., et al.: Depth camera-based facial expression recognition system using multilayer scheme (2014)

    Google Scholar 

  10. Ji, Y., Idrissi, K.: Automatic facial expression recognition based on spatiotemporal descriptors, 1373–1380 (2012)

    Google Scholar 

  11. Demir, Y., et al., A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering, 131–142 (2014)

    Google Scholar 

  12. Salmam, F.Z., et al.: Facial expression recognition using decision trees. IEEE (2016)

    Google Scholar 

  13. Cossetin, M.J., et al.: Facial expression recognition using a pairwise feature selection and classification approach. IEEE (2016)

    Google Scholar 

  14. Jayalekshmi, J., Mathew, T.: Facial expression recognition and emotion classification system for sentiment analysis. In: Conference on Networks and Advances in Computational Technologies, pp. 1–8 (2017)

    Google Scholar 

  15. Li, H., et al.: A convolutional neural network cascade for face detection. In: IEEE Conference on Computer Vision and Pattern Recognition (2015)

    Google Scholar 

  16. Ding, H., et al.: FaceNet2ExpNet: regularizing a deep face recognition net for expression recognition, pp. 118–126 (2017)

    Google Scholar 

  17. Chaudhari, M.N., et al.: Face detection using viola jones algorithm and neural networks. In: Conference on Computing Communication Control and Automation, ICCUBEA, pp. 1–6 (2018)

    Google Scholar 

  18. Kar, N.B., et al.: Face expression recognition system based on ripplet transform type II and least square SVM. 78 (2019)

    Google Scholar 

  19. Shah, H.M., et al.: Analysis of facial landmark features to determine the best subset for finding face orientation. In: ICCIDS, pp. 1–4 (2019)

    Google Scholar 

  20. Dhara Mungra et al., PRATIT: a CNN-based emotion recognition system using histogram equalization and data augmentation. Multimed. Tools Appl. 79, 2285–2307 (2019). Springer

    Google Scholar 

  21. Revina, I.M., Sam Emmanuel, W.R.: A survey on human face expression recognition techniques. J. King Saud Univ. - Comput. Inf. Sci. 10 (2018)

    Google Scholar 

  22. Lopes, N., et al.: Facial emotion recognition in the elderly using a SVM classifier. In: Proceedings of 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing, pp. 1–5 (2018)

    Google Scholar 

  23. Islam, B., et al.: Facial expression region segmentation based approach to emotion recognition using 2D Gabor filter and multiclass support vector machine, pp. 1–6 (2018)

    Google Scholar 

  24. Liu, S.-S., Tian, Y.-T.: Facial expression recognition method based on Gabor wavelet features and fractional power polynomial kernel PCA, pp. 144–151 (2010)

    Google Scholar 

  25. Mehta, N., Jadhav, S.: Facial emotion recognition using log Gabor filter and PCA, pp. 1–5 (2016)

    Google Scholar 

  26. Ramos, A.L.A., et al.: Classifying emotion based on facial expression analysis using Gabor filter: a basis for adaptive effective teaching strategy, pp. 469–479 (2020)

    Google Scholar 

  27. Verma, K., Khuntetatitle, A.: Facial expression recognition using Gabor filter and multi-layer artificial neural network, pp. 1–5 (2017)

    Google Scholar 

  28. Matamoros, H., et al.: A facial expression recognition with automatic segmentation of face regions, pp. 529–540 (2015)

    Google Scholar 

  29. Hegde, G.P., et al.: Kernel locality preserving symmetrical weighted fisher discriminant analysis based subspace approach for expression recognition (2016)

    Google Scholar 

  30. Luo, Y., et al.: Facial expression recognition based on fusion feature of PCA and LBP with SVM, pp. 2767–2770 (2013)

    Google Scholar 

  31. Biswas, S., Sil, J.: Facial expression recognition using modified local binary pattern, pp. 595–604 (2015)

    Google Scholar 

  32. Ravi, R., et al.: A face expression recognition using CNN & LBP. In: Proceedings of the Fourth International Conference on Computing Methodologies and Communication, pp. 684–689 (2020)

    Google Scholar 

  33. Chickerur, S., et al.: Parallel scale invariant feature transform based approach for facial expression recognition, creativity in intelligent technologies and data science, pp. 621–636 (2015)

    Google Scholar 

  34. Dahmane, M., Meunier, J.: Prototype-based modeling for facial expression analysis. IEEE (2014)

    Google Scholar 

  35. Sajjad, M., et al.: Facial appearance and texture feature-based robust facial expression recognition framework for sentiment knowledge discovery (2015)

    Google Scholar 

  36. Mollahosseini, A., et al.: Going deeper in facial expression recognition using deep neural networks. In: Winter Conference on Applications of Computer Vision (2016)

    Google Scholar 

  37. Jain, D.K., et al.: Extended deep neural network for facial emotion recognition (2019)

    Google Scholar 

  38. Agrawal, A., Mittal, N.: Using CNN for facial expression recognition: a study of the effects of kernel size and number of filters on accuracy (2019)

    Google Scholar 

  39. Goodfellow, I.J., et al.: Challenges in representation learning: a report on three machine learning contests, pp. 59–63 (2015)

    Google Scholar 

  40. Wen, G., et al.: Ensemble of deep neural networks with probability-based fusion for facial expression recognition, pp. 597–610 (2017)

    Google Scholar 

  41. Lucey, P., et al.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression, pp. 94–101. IEEE (2010)

    Google Scholar 

  42. Jadhav, R.S., Ghadekar, P.: Content based facial emotion recognition model using machine learning algorithm. In: ICACAT, pp. 1–5 (2018)

    Google Scholar 

  43. Pranav, E., et al.: Facial emotion recognition using deep convolutional neural network, pp. 317–320 (2020)

    Google Scholar 

  44. Zheng, W., et al.: Facial expression recognition using kernel canonical correlation analysis (KCCA), pp. 233–238 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maryam Knouzi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Knouzi, M., Ennaji, F.Z., Hafidi, I. (2023). Emotion Recognition Techniques. In: Aboutabit, N., Lazaar, M., Hafidi, I. (eds) Advances in Machine Intelligence and Computer Science Applications. ICMICSA 2022. Lecture Notes in Networks and Systems, vol 656. Springer, Cham. https://doi.org/10.1007/978-3-031-29313-9_14

Download citation

Publish with us

Policies and ethics