Skip to main content

COVID-19 Face Mask Classification Using Deep Learning

  • Conference paper
  • First Online:
Data Science and Emerging Technologies (DaSET 2022)

Abstract

The COVID-19 pandemic has triggered a global health disaster because its virus is spread mainly through minute respiratory droplets from coughing, sneezing, or prolonged close contact between individuals. Consequently, World Health Organization (WHO) urged wearing face masks in public places such as schools, train stations, hospitals, etc., as a precaution against COVID-19. However, it takes work to monitor people in these places manually. Therefore, an automated facial mask detection system is essential for such enforcement. Nevertheless, face detection systems confront issues, such as the use of accessories that obscure the face region, for example, face masks. Even existing detection systems that depend on facial features struggle to obtain good accuracy. Recent advancements in object detection, based on deep learning (DL) models, have shown good performance in identifying objects in images. This work proposed a DL-based approach to develop a face mask detector model to categorize masked and unmasked faces in images and real-time streaming video. The model is trained and evaluated on two different datasets, which are synthetic and real masked face datasets. Experiments on these two datasets showed that the performance accuracy rate of this model is 99% and 89%, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kocacinar, B., Tas, B., Akbulut, F.P., Catal, C., Mishra, D.: A real-time CNN-based lightweight mobile masked face recognition system. IEEE Access 10, 63496–63507 (2022). https://doi.org/10.1109/access.2022.3182055

    Article  Google Scholar 

  2. Tembhare, P.U., Sonekar, N., Rohankar, S., Chandankhede, A., Kothekar, S.: Face mask detection system using deep learning. Int. J. Creat. Res. Thoughts 9(5), 152–155 (2021)

    Google Scholar 

  3. Hussain, S., et al.: IoT and deep learning based approach for rapid screening and face mask detection for infection spread control of COVID-19. Appl. Sci. 11(3495), 1–27 (2021). https://doi.org/10.3390/app11083495

    Article  Google Scholar 

  4. Vinitha, V., Velantina, V.: Covid-19 facemask detection with deep learning and computer vision. Int. Res. J. Eng. Technol. 7(8), 3127–3132 (2020)

    Google Scholar 

  5. Sabir, M.F.S., et al.: An automated real-time face mask detection system using transfer learning with faster-rcnn in the era of the COVID-19 pandemic. Comput. Mater. Contin. 71(2), 4151–4166 (2022). https://doi.org/10.32604/cmc.2022.017865

    Article  Google Scholar 

  6. Jignesh Chowdary, G., Punn, N.S., Sonbhadra, S.K., Agarwal, S.: Face mask detection using transfer learning of inceptionV3. In: Bellatreche, L., Goyal, V., Fujita, H., Mondal, A., Reddy, P.K. (eds.) BDA 2020. LNCS, vol. 12581, pp. 81–90. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-66665-1_6

    Chapter  Google Scholar 

  7. Harriat Christa, G., Jesica, J., Anisha, K., Sagayam, K. M.: CNN-based mask detection system using OpenCV and MobileNetV2. In: 2021 3rd International Conference on Signal Processing and Communication, pp. 115–119 (2021). https://doi.org/10.1109/ICSPC51351.2021.9451688

  8. Bade, A., Sivaraja, T.: Enhanced AdaBoost haar cascade classifier model to detect partially occluded faces in digital images. ASM Sci. J. 13 (2020). https://doi.org/10.32802/asmscj.2020.sm26(5.12)

  9. Min, R., Hadid, A., Dugelay, J.-L.: Efficient detection of occlusion prior to robust face recognition. Sci. World J. 2014, 1–10 (2014). https://doi.org/10.1155/2014/519158

    Article  Google Scholar 

  10. Zeng, D., Veldhuis, R., Spreeuwers, L.: A survey of face recognition techniques under occlusion. IET Biometrics 10(6), 581–606 (2021). https://doi.org/10.1049/bme2.12029

    Article  Google Scholar 

  11. Hemathilaka, S., Aponso, A.: A comprehensive study on occlusion invariant face recognition under face mask occlusions. Mach. Learn. Appl. An Int. J. 8(4), 1 (2021). https://doi.org/10.5121/mlaij.2021.8401

    Article  Google Scholar 

  12. Min, R., Hadid, A., Dugelay, J.-L.: Improving the recognition of faces occluded by facial accessories. In: 2011 IEEE International Conference on Automation Face Gesture Recognition, pp. 442–447 (2011). https://doi.org/10.1109/FG.2011.5771439

  13. Akhtar, Z., Rattani, A.: A face in any form: new challenges and opportunities for face recognition technology. Comput. (Long. Beach. Calif.) 50(4), 80–90 (2017). https://doi.org/10.1109/MC.2017.119

    Article  Google Scholar 

  14. Park, S., Lee, H., Yoo, J., Kim, G., Kim, S.: Partially occluded facial image retrieval based on a similarity measurement. Math. Probl. Eng. 2015, 1–11 (2015). https://doi.org/10.1155/2015/217568

    Article  Google Scholar 

  15. Strueva, A.Y., Ivanova, E.V.: Student attendance control system with face recognition based on neural network. In: 2021 International Russian Automation Conference, pp. 929–933 (2021). https://doi.org/10.1109/RusAutoCon52004.2021.9537386

  16. Erakin, M.E., Demir, U., Ekenel, H.K.: On recognizing occluded faces in the wild. In: 2021 International Conference of the Biometrics Special Interest Group, pp. 1–5 (2021). https://doi.org/10.1109/BIOSIG52210.2021.9548293

  17. Sarker, I.H.: Deep learning: a comprehensive overview on techniques, taxonomy, applications and research directions. SN Comput. Sci. 2(6), 1–20 (2021). https://doi.org/10.1007/s42979-021-00815-1

    Article  MathSciNet  Google Scholar 

  18. Alzubaidi, L., et al.: Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J. Big Data 8(1), 1–74 (2021)

    Article  Google Scholar 

  19. Zaidi, S.S.A., Ansari, M.S., Aslam, A., Kanwal, N., Asghar, M., Lee, B.: A survey of modern deep learning based object detection models. Digit. Signal Process. 126, 103514 (2022). https://doi.org/10.1016/j.dsp.2022.103514

    Article  Google Scholar 

  20. Xia, Y., Zhang, B., Coenen, F.: Face occlusion detection based on multi-task convolution neural network. In: 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, pp. 375–379 (2015). https://doi.org/10.1109/FSKD.2015.7381971

  21. Martinez, A., Benavente, R.: The AR face database. Computer Vision Central Technical Report (1998)

    Google Scholar 

  22. Annagrebah, S., Maizate, P.A., Hassouni, P.L.: Real-time face recognition based on deep neural network methods to solve occlusion problems. In: 2019 Third International Conference on Intelligent Computing in Data Sciences, pp. 1–4 (2019). https://doi.org/10.1109/ICDS47004.2019.8942385

  23. Bhuiyan, M.R., Khushbu, S.A., Islam, M.S.: A deep learning based assistive system to classify COVID-19 face mask for human safety with YOLOv3. In: 2020 11th International Conference on Computing, Communication and Networking Technologies (2020). https://doi.org/10.1109/ICCCNT49239.2020.9225384

  24. Gathani, J., Shah, K.: Detecting masked faces using region-based convolutional neural network. In: 2020 IEEE 15th International Conference on Industrial and Information Systems, pp. 156–161 (2020). https://doi.org/10.1109/ICIIS51140.2020.9342737

  25. Loey, M., Manogaran, G., Taha, M.H.N., Khalifa, N.E.M.: Fighting against COVID-19: a novel deep learning model based on YOLO-v2 with ResNet-50 for medical face mask detection. Sustain. Cities Soc. 65, 102600 (2021). https://doi.org/10.1016/j.scs.2020.102600

    Article  Google Scholar 

  26. Ibitoye, O.: A brief review of convolutional neural network techniques for masked face recognition. In: 2021 IEEE Concurrent Processes Architectures and Embedded Systems Virtual Conference, pp. 1–4 (2021). https://doi.org/10.1109/COPA51043.2021.9541448

  27. Mbunge, E., Simelane, S., Fashoto, S.G., Akinnuwesi, B., Metfula, A.S.: Application of deep learning and machine learning models to detect COVID-19 face masks - a review. Sustain. Oper. Comput. 2, 235–245 (2021). https://doi.org/10.1016/j.susoc.2021.08.001

    Article  Google Scholar 

  28. Zhang, E.: A real-time deep transfer learning model for facial mask detection. In: 2021 Integrated Communications Navigation and Surveillance Conference, pp. 1–7 (2021). https://doi.org/10.1109/ICNS52807.2021.9441582

  29. Nithyashree, V., Roopashree, S., Duvvuri, A., Vanishree, L., Madival, D.A., Vidyashree, G.: A solution to COVID-19: detection and recognition of faces with mask. In: 2021 International Conference on Intelligent Technologies, pp. 1–6 (2021). https://doi.org/10.1109/CONIT51480.2021.9498426

  30. Ejaz, S.M., Islam, R.M.: Masked face recognition using convolutional neural network. In: 2019 International Conference on Sustainable Technology for Industry 4.0, pp. 1–6 (2019). https://doi.org/10.1109/STI47673.2019.9068044

  31. Ge, S., Li, J., Ye, Q., Luo, Z.: Detecting masked faces in the wild with LLE-CNNs. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition, pp. 426–434 (2017). https://doi.org/10.1109/CVPR.2017.53

  32. Ai, M.A.S., et al.: Real-time facemask detection for preventing COVID-19 spread using transfer learning based deep neural network. Electronics 11(14), 2250 (2022). https://doi.org/10.3390/electronics11142250

    Article  Google Scholar 

  33. Zhu, R., Yin, K., Xiong, H., Tang, H., Yin, G.: Masked face detection algorithm in the dense crowd based on federated learning. Wirel. Commun. Mob. Comput. 2021, 1–8 (2021). https://doi.org/10.1155/2021/8586016

    Article  Google Scholar 

  34. Ku, H., Dong, W.: Face recognition based on MTCNN and convolutional neural network. Front. Signal Process. 4(1), 37–42 (2020)

    Article  Google Scholar 

  35. Shinwari, A.R., Ayoubi, M.: A comparative study of face recognition algorithms under occlusion. Kardan J. Eng. Technol. 2(1), 86–96 (2020). https://doi.org/10.31841/KJET.2021.15

    Article  Google Scholar 

  36. Rahmani, M.K.I., Taranum, F., Nikhat, R., Farooqi, M.R., Khan, M.A.: automatic real-time medical mask detection using deep learning to fight COVID-19. Comput. Syst. Sci. Eng. 42(3), 1181–1198 (2022). https://doi.org/10.32604/csse.2022.022014

    Article  Google Scholar 

  37. Bhandary, P.: Mask Classifier (2020). https://github.com/prajnasb/observations.git. Accessed 02 June 2022

  38. Sandler, M. Howard, A., Zhu, M., Zhmoginov, A., Liang-Chieh, C.: MobileNetV2: inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4510–4520 (2018). https://doi.org/10.1109/CVPR.2018.00474

  39. Karim Sujon, M.R., Hossain, M.R., Al Amin, M.J., Bepery, C., Rahman, M.M.: Real-time face mask detection for COVID-19 prevention. In: 2022 IEEE 12th Annual Computing and Communication Workshop and Conference, pp. 0341–0346 (2022). https://doi.org/10.1109/CCWC54503.2022.9720764

Download references

Acknowledgement

The Fundamental Research Grant Scheme (FRGS) of the Ministry of Education (MOE) supported this work with grant number 600-IRMI/FRGS 5/3 (234/2019).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Firdaus Mustapha .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Abdul Aziz, N.A.S., Mustapha, M.F., Ab Hamid, S.H. (2023). COVID-19 Face Mask Classification Using Deep Learning. In: Wah, Y.B., Berry, M.W., Mohamed, A., Al-Jumeily, D. (eds) Data Science and Emerging Technologies. DaSET 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 165. Springer, Singapore. https://doi.org/10.1007/978-981-99-0741-0_6

Download citation

Publish with us

Policies and ethics