Review Article |
Advancements in Machine Learning-Based Face Mask Detection: A Review of Methods and Challenges
Author(s): Maad Shatnawi*, Khawla Alhanaee, Mitha Alhammadi and Nahla Almenhali
Published In : International Journal of Electrical and Electronics Research (IJEER) Volume 11, Issue 3
Publisher : FOREX Publication
Published : 25 September 2023
e-ISSN : 2347-470X
Page(s) : 844-850
Abstract
Wearing face masks is crucial in various environments, particularly where there is high potential of viral transmission. Proper wearing of face masks always is important in hospitals and healthcare facilities where the risk of transmission of different contagious diseases is very high. The COVID-19 pandemic has been recognized as a global health crisis, exerting deep impacts on various sectors such as industry, economy, public transportation, education, and residential domains. This rapidly spreading virus has created considerable public health risks, resulting in serious health consequences and fatalities. Wearing face masks in public locations and crowded regions has been identified as one of the most effective preventive methods for reducing viral transmission. Using powerful face mask detection systems in such contexts can thus significantly improve infection control efforts while protecting the health and well-being of healthcare personnel, patients, and visitors. In this paper, we present a comprehensive review of recent advancements in machine learning techniques applied to face mask identification. The existing approaches in this sector can be broadly categorized into three main groups: mask/no mask detection approaches, proper/improper mask detection approaches, and human identification through masked faces approaches. We discuss the advantages and limitations associated with each approach. Further, we explore into the technical challenges encountered in this field. Through this study, we aim to provide researchers and practitioners with a comprehensive understanding of the state-of-the-art machine learning techniques for face mask detection.
Keywords: Face mask detection
, proper mask detection
, masked face identification
, facial recognition
, Covid-19
, contagious disease transmission
.
Maad Shatnawi*, Department of Electrical Engineering Technology, Higher Colleges of Technology, Abu Dhabi, UAE; Email: mshatnawi@hct.ac.ae
Khawla Alhanaee, Saab Ltd, Abu Dhabi, UAE
Mitha Alhammadi, Department of Electrical Engineering Technology, Higher Colleges of Technology, Abu Dhabi, UAE
Nahla Almenhali, Department of Electrical Engineering Technology, Higher Colleges of Technology, Abu Dhabi, UAE
-
[1] K. Suresh, M. Palangappa and S. Bhuvan, "Face Mask Detection by using Optimistic Convolutional Neural Network," in 2021 6th International Conference on Inventive Computation Technologies (ICICT), 2021, pp. 1084--1089.
-
[2] B. Batagelj, P. Peer, V. Štruc and S. DobriŠek, "How to Correctly Detect Facemasks for COVID-19 from Visual Information," Applied Sciences, vol. 11, p. 2070, 2021.
-
[3] E. Naqa, Issam, Murphy and M. J, what is machine learning? Springer, 2015, pp. 3--11.
-
[4] M. Hargrave, "Deep Learning," Investopedia, 17 May 2021. [Online]. Available: https://www.investopedia.com/terms/d/deep-learning.asp.
-
[5] J. Brownlee, "A gentle introduction to transfer learning for deep learning. Retrieved fromhttps," machinelearningmastery. com/transfer-learning-for-deep-learning, 2017.
-
[6] K. Alhanaee, M. Alhammadi, N. Almenhali and M. Shatnawi, "Face Recognition Smart Attendance System using Deep Transfer Learning," Procedia Computer Science, vol. 192, pp. 4093--4102, 2021.
-
[7] T. Faisal, I. Negassi, G. Goitom, M. Yassin, A. Bashir and M. Awawdeh, "Systematic development of real-time driver drowsiness detection system using deep learning," IAES International Journal of Artificial Intelligence, vol. 11, no. 1, pp. 148--160, 2022.
-
[8] C. Couprie, C. Farabet, L. Najman and Y. LeCun, "Indoor semantic segmentation using depth information," arXiv preprint arXiv:1301.3572, 2013.
-
[9] K. He, X. Zhang, S. Ren and J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition," IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 9, pp. 1904--1916, 2015.
-
[10] Q. Wang, C. Rasmussen and C. Song, "Fast, deep detection and tracking of birds and nests," in International Symposium on Visual Computing, Springer, 2016, pp. 146--155.
-
[11] W. Ma and J. Lu, "An equivalence of fully connected layer and convolutional layer," arXiv preprint arXiv:1712.01252, 2017.
-
[12] E. Cengil and A. Çinar, "Multiple Classification of Flower Images Using Transfer Learning," in 2019 International Artificial Intelligence and Data Processing Symposium (IDAP), 2019.
-
[13] T. Faisal, A. Eyob, F. Debretsion, M. Tsegay, A. Bashir and M. Awawdeh, "Development of intelligent waste segregation system based on convolutional neural network," International Journal of Advanced Science and Technology, vol. 29, no. 3, pp. 14837--14849, 2020.
-
[14] L. Brown, "Accelerate Machine Learning with the cuDNN Deep Neural Network Library, 2014," 2016. [Online]. Available: https://devblogs. nvidia. com/parallelforall/accelerate-machine-learning-cudnn-deep-neural-network-library.
-
[15] S. Andrej Karpathy, "Convolutional Neural Networks for Visual Recognition," 2018.
-
[16] C.-Y. Lee, P. W. Gallagher and Z. Tu, "Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree," in Artificial intelligence and statistics, 2016.
-
[17] K. G. Pasi and S. R. Naik, "Effect of parameter variations on accuracy of Convolutional Neural Network," in 2016 international conference on computing, analytics and security trends (cast), 2016.
-
[18] M. Jiang, F. Xinqi and Y. Hong, "Retina facemask: A face mask detector," arXiv preprint arXiv:2005.03950, vol. 2, p. 2020.
-
[19] M. Loey, M. Gunasekaran, T. Mohamed, H. N, N. Khalifa and E. M, "A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic," Measurement, vol. 167, no. Elsevier, p. 108288, 2021.
-
[20] Z. Wang, G. Wang, B. Huang, Z. Xiong, Q. Hong, H. Wu, P. Yi, K. Jiang, N. Wang, Y. Pei and others, "Masked face recognition dataset and application," arXiv preprint arXiv:2003.09093, 2020.
-
[21] Prajnasb, "observations," 2020. [Online]. Available: https://github.com/prajnasb/observations.
-
[22] E. Learned-Miller, G. B. Huang, A. RoyChowdhury, H. Li and G. Hua, "Labeled Faces in the Wild: A Survey," in Advances in Face Detection and Facial Image Analysis, Springer International Publishing, 2016, pp. 189--248.
-
[23] A. Chavda, J. Dsouza, S. Badgujar and A. Damani, "Multi-stage cnn architecture for face mask detection," in 2021 6th International Conference for Convergence in Technology (I2CT), IEEE, 2021, pp. 1--8.
-
[24] Larxel, "Face Mask Detection," Kaggle - Version 1, 2020. [Online]. Available: https://www.kaggle.com/andrewmvd/face-mask-detection.
-
[25] P. Nagrath, J. Rachna, A. Mada, A. Rohan, K. Piyush and H. Jude, "SSDMNV2: A real time DNN-based face mask detection system using single shot multibox detector and MobileNetV2," Sustainable cities and society, vol. 66, p. 102692, 2021.
-
[26] E. Aydemir, M. Yalcinkaya, P. Barua, M. Baygin, O. Faust, S. Dogan, S. Chakraborty, T. Tuncer and R. Acharya, "Hybrid Deep Feature Generation for Appropriate Face Mask," International Journal of Environmental Research and Public Health, vol. 1939, p. 19, 2022.
-
[27] O. Y. Kasap and D. Cakir, Analysis of Transfer Learning Models for Face, 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC), Institute of Electrical and Electronics Engineers, 2022.
-
[28] R. M. Dellosa, D. C. Malunao, J. A. D. Doculan, R. R. Maaliw, J. M. Zarate, R. S. Evangelista and M. C. G. Adefuin, "Detecting appropriate and inappropriate covid-19 face mask wear in controlled environments using transfer learning-based convolutional neural network," in 2022 International Conference on Emerging Technologies in Electronics, Computing and Communication (ICETECC), 2022.
-
[29] M. A. Fikih, T. S. N. P. Putri, N. Kasan and N. Setyawan, "Face mask detection utilizing “You only look one (YOLOV3)” for Covid-19 response," in AIP Conference Proceedings, 2022.
-
[30] W. Hariri, "Efficient masked face recognition method during the covid-19 pandemic," rXiv preprint arXiv:2105.03026, 2021.
-
[31] "LFW Simulated Masked Face Dataset," 2020. [Online]. Available: https://www.kaggle.com/datasets/muhammeddalkran/lfw-simulated-masked-face-dataset.
-
[32] V. Aswal, O. Tupe, S. Shaikh and N. N. Charniya, "Single Camera Masked Face Identification," in 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), IEEE, 2020, pp. 57--60.
-
[33] W. Chen, H. Huang, S. Peng, C. Zhou and C. Zhang, "YOLO-face: a real-time face detector," The Visual Computer, vol. 37, no. 4, pp. 805--813, 2021.
-
[34] J. Deng, J. Guo, E. Ververas, I. Kotsia and S. Zafeiriou, "Retinaface: Single-shot multi-level face localisation in the wild," in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020.
-
[35] F. Ding, P. Peng, Y. Huang, M. Geng and Y. Tian, "Masked face recognition with latent part detection," in Proceedings of the 28th ACM International Conference on Multimedia, 2020, pp. 2281--2289.
-
[36] M. Shatnawi, N. Almenhali, M. Alhammadi and K. Alhanaee, "Deep Learning Approach for Masked Face Identification," International Journal of Advanced Computer Science and Applications, vol. 13, no. 6, 2022.
-
[37] Y. Guo, L. Zhang, Y. Hu, X. He and J. Gao, "Ms-celeb-1m: A dataset and benchmark for large-scale face recognition," in European conference on computer vision, 2016.
-
[38] X. Jin and X. Tan, "Face alignment in-the-wild: A survey," Computer Vision and Image Understanding}, vol. 162, pp. 1--22, 2017.
-
[39] S. Zafeiriou, C. Zhang and Z. Zhang, "A survey on face detection in the wild: past, present and future," Computer Vision and Image Understanding, vol. 138, pp. 1--24, 2015.
-
[40] E. Sariyanidi, H. Gunes and A. Cavallaro, "Automatic analysis of facial affect: A survey of registration, representation, and recognition," IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 6, pp. 1133--1133, 2014.
-
[41] A. F. Abate, M. Nappi, D. Riccio and G. Sabatino, "2D and 3D face recognition: A survey," Pattern recognition letters, vol. 28, no. 14, pp. 1885--1906, 2007. . Pasi and S. R. Naik, "Effect of parameter variations on accuracy of Convolutional Neural Network," in 2016 international conference on computing, analytics and security trends (cast), 2016.
-
[42] A. S. O. Ali, V. Sagayan, A. Malik and A. Aziz, "Proposed face recognition system after plastic surgery," IET Computer Vision, vol. 10, no. 5, pp. 344--350, 2016.
-
[43] M. O. Oloyede, G. P. Hancke and H. C. Myburgh, "A review on face recognition systems: recent approaches and challenges," Multimedia Tools and Applications, vol. 79, no. 37, pp. 27891--27922, 2020.
-
[44] M. Hassaballah and S. Aly, "Face recognition: challenges, achievementsand future directions," IET Computer Vision, vol. 9, no. 4, pp. 614-626, 2015.
-
[45] M. Shatnawi and N. Mohamed, "Statistical techniques for online personalized advertising: A survey," in Proceedings of the 27th Annual ACM Symposium on Applied Computing, 2012.
-
[46] R. Jayaswal and M. Dixit, "AI-based face mask detection system: a straightforward proposition to fight with Covid-19 situation," Multimedia Tools and Applications, pp. 1--33, 2022.
-
[47] A. R. Laddha and K. Chhajed, "A Face Mask Detector to Control Covid19 Using Machine Learning Technique," International Journal of Research in Engineering and Science (IJRES), vol. 9, no. 12, pp. 7--15, 2021.