No Detail Found!

Efficient face anti-spoofing identifier network (FASIN) with depth and near infrared deep learning methods

Author(s)
Mudunuru Suneel 1Department of Electronics and Communication Engineering, University College of Engineering, Acharya Nagarjuna University (ANU), Guntur, Andhra Pradesh, India
Tummala Ranga Babu 2Department of Electronics and Communication Engineering, RVR and JC College of Engineering, Guntur, Andhra Pradesh, India
Abstract
Face anti-spoofing (FAS) is a crucial task in the field of face recognition practices, which aims to detect and prevent attempts to spoof/attack a facial recognition system using fake or manipulated images. In this work, we aimed to develop a novel Face Anti-Spoofing Identifier Network (FASIN) with Depth and Near Infrared (NIR) embeddings, trained on multi modalities using multi stream Convolutional Neural Networks (CNNs). The proposed FASIN model is capable of processing RGB, Depth, and NIR images to extract discriminative features and effectively distinguish between genuine and fake faces. The depth maps and the near infrared (NIR) images are acquired from RGB images by constructing the depth map construction network (DMCN) and near infrared construction network (NIRCN) respectively. The FASIN model comprises three sub-networks: one for processing RGB images, a second for processing depth images, and the other subnetwork for processing NIR images. All the sub-networks consist of multiple CNN layers, which extract features at different scales and levels of abstraction. The inherent noise and other variables may reduce the efficacy of CNN, the wavelet spatial attention mechanism has been proposed to support the RGB CNN stream and it is named wavelet attention CNN (WA-CNN). The extracted features are then concatenated using a multi modal feature fusion module to obtain a robust feature representation that is used to classify real and fake faces. An ensemble learning mechanism has been attached to the model to learn the concatenated features effectively. Experimental results obtained on four benchmark datasets (namely, CelebA-Spoof, CASIA-SURF, WMCA, and MSU-MFSD) demonstrate the efficacy of the proposed FASIN model collated with the state-of-the-art methods. The proposed FASIN model achieves high accuracy and low average classification error rates (ACER), indicating its potential for real-world applications in face anti spoofing identification systems.
Publication Details
Page(s) 1255-1271
DOI DOI not available
Published Journal: ARPN Journal of Engineering and Applied Sciences, Volume: 19, Issue: 20, Year: 2024

Request the full text from PASTIC

Keywords
ensemble learning, multi modal feature fusion (MMFF), near infrared construction network (NIRCN), depth map construction network (DMCN), face anti-spoofing (FAS), wavelet attention
References
Learned-Miller E.,Huang G. B.,Li H.,Hua G. .2016 .Labeled faces in the wild: A survey. in Advances in face detection and facial image analysis. Springer, : 189-248.
Marcel S.,Nixon M.,Li S. .2014 .Handbook of biometric anti spoofing-trusted biometrics under spoofing attacks. Advances in Computer Vision and Pattern Recognition, : .
.2016 .. [3] Information technology Biometric presentation attack detection Part, 1 : .
Guo J.,Zhu X.,Zhao C.,Cao D.,Lei Z.,Li S. Z. .2020 .Learning Meta face recognition in unseen domains. (CVPR), : 6163-6172.
Zhang Z.,Yan J.,Liu S.,Lei Z.,Yi D.,Li S. Z. .2012 .A face anti spoofing database with diverse attacks. In Proc. 5th IAPR Int. Conf. Biometrics (ICB), : 26-31.
Erdogmus N.,Marcel S. .2013 .Spoofing in 2d face recognition with 3d masks and anti-spoofing with Kinect. In Proc. IEEE 6th Int. Conf. Biometrics, Theory, Appl. Syst. (BTAS), : 1-8.
Chingovska I.,Anjos A.,Marcel S. .2012 .On the effectiveness of local binary patterns in face antispoofing. In Proc. BIOSIG, : 1-7.
Shao R.,Lan X.,Li J.,Yuen P. C. .2019 .Multiadversarial discriminative deep domain generalization for face presentation attack detection. (CVPR), : 10023-10031.
Boulkenafet Z.,Komulainen J.,Hadid A. .2015 .Face anti-spoofing based on color texture analysis. 2015 IEEE International Conference on. IEEE, : 2636-2640.
Ma J. .2011 .Face spoofing detection ¨ from single images using micro-texture analysis. IEEE, : 1-7.
Anjos A.,Marcel S. .2011 .Counter-measures to photo attacks in face recognition: a public database and a baseline. IEEE, : 1-7.
Ramachandra R.,Busch C. .2017 .Presentation attack detection methods for face recognition systems: a comprehensive survey. ACM Computing Surveys (CSUR), 50(1) : 8.
Oeslle Lucena,Lotufo Roberto .2017 .Transfer learning using convolutional neural networks for face anti-spoofing. In International Conference Image Analysis and Recognition, : 27-34.
Nagpal Chaitanya .2018 .Shiv Ram Dubey. A performance evaluation of convolutional neural networks for face anti spoofing. arXiv preprint arXiv:1805.04176, : .
Xiao Song,Xu Zhao,Fang Liangji,Lin Tianwei .2019 .Discriminative representation combinations for accurate face spoofing detection. Pattern Recognition, 85 : 220-231.
T. de Freitas Pereira A.,Anjos A.,J. M. De Martino S.,Marcel S. .2012 .LBP-TOP based countermeasure against face spoofing attacks. In ACCV, : .
Ma J. .2011 .Face spoofing detection from single images using microtexture analysis. In IJCB. 1, (2) : .
Komulainen J.,Hadid A.,Pietikainen M. .2013 .Context based face anti-spoofing. In BTAS. 2., : .
Patel K.,Jain A. K. .2016 .Secure face unlock: Spoof detection on smartphones. In TIFS. 1, (2) : .
Boulkenafet Z.,Komulainen J.,Hadid A. .2017 .Face anti spoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Processing Letters. 2, : .
Liu S.,Yang B.,Yuen P. C.,Zhao Guoying .2016 .A 3D mask face anti-spoofing database with real world variations. In CVPRW. 1, (2) : 3.
Bao W.,Li H.,Li N.,Jiang W. .2009 .A liveness detection method for face recognition based on the optical flow field. In IEEE International Conference on Image Analysis and Signal Processing (IASP), 2 : .
Feng L.,Po L.,Li Y.,Xu X.,Yuan F.,Cheung T. C.,Cheung K. .2016 .Integration of image quality and motion cues for face anti-spoofing: A neural network approach. Journal of Visual Communication and Image Representation. 1., : .
Atoum Y.,Liu Y.,Jourabloo A.,Liu X. .2017 .Face anti-spoofing using the patch and depth-based CNNs. In IJCB. 1, (2) : .
Son Minh Nguyen,Zero-Shot Face Nguyen .2022 .Self-Attention Generative Distribution Adversarial Network for Few-. 2022 IEEE International Joint Conference on Biometrics (IJCB), : .
Li H.,He P.,Wang S.,Rocha A.,Jiang X.,Kot A. C. .2018 .Learning generalized deep feature representation for face anti-spoofing. IEEE Transactions on Information Forensics and Security, 13(10) : 2639-2652.
Liu Y.,Jourabloo A.,Liu X. .2018 .Learning deep models for face anti spoofing: Binary or auxiliary supervision. in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit, : 389-398.
Boulkenafet Z.,Komulainen J.,Hadid A. .2017 .Face anti spoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Processing Letters, 2 : .
Jourabloo A.,Liu Y.,Liu X. .2018 .Face despoofing: Anti spoofing via noise modeling. In ECCV., : .
Kim Y.,Na J.,Yoon S.,Yi J.,Opt J. .2009 .Masked fake face detection using radiance measurements. Image Sci, 26(4) : 760.
Zhang S. .2020 .CASIA-SURF: A large-scale multi-modal benchmark for face anti-spoofing. Identity Sci. 2, (2) : 182-193.
Wang Z. .2020 .Deep spatial gradient and temporal depth learning for face anti-spoofing,”. (CVPR), : 5042-5051.
Nguyen K.,Fookes C.,Ross A.,Sridharan S. .2017 .Iris Recognition with Off-the-Shelf CNN Features: A Deep Learning Perspective. IEEE Access, 6 : 18848-18855.
Yu Z. .2020 .Searching central difference convolutional networks for face anti-spoofing,”. (CVPR), : 5295-5305.
Stehouwer J.,Jourabloo A.,Liu Y.,Liu X. .2020 .Noise modeling, synthesis, and classification for generic object anti-spoofing. (CVPR), : 7294-7303.
Liu Y.,Stehouwer J.,Liu X. .2020 .On disentangling spoof trace for generic face antispoofing. In Proc. ECCV, : 406-422.
Xu Zhenqi,Li Shan,Deng Weihong .2015 .Learning temporal features using LSTM-CNN. , : .
Yuanhan Zhang .2020 .Celeba-spoof: Largescale face anti-spoofing dataset with rich annotations. Part XII 16, (28) : .
Shifeng Zhang .2020 .Casia-surf: A large-scale multi-modal benchmark for face anti-spoofing. IEEE Transactions on Biometrics, Behavior, and Identity Science, 2 : 182-193.
Anjith George .2019 .Biometric face presentation attack detection with a multi-channel convolutional neural network. IEEE Transactions on Information Forensics and Security, 15 : 42-55.
Wen Di,Anil K.,Jain K. .2015 .Face spoof detection with image distortion analysis. IEEE Transactions on Information Forensics and Security, 10 : 746-761.
Mikołajczyk Michał,Grochowski Michał .2018 .Data augmentation for improving deep learning in image classification problems. 2018 international interdisciplinary PhD workshop, : .
Ibraheem Alhashim,Wonka Peter .2018 .High quality monocular depth estimation via transfer learning. arXiv preprint arXiv: 1812, : .
Gao Huang .2017 .Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition., : .
Jia Deng .2009 .Imagenet: A large-scale hierarchical image database. IEEE conference on computer vision and pattern recognition. , : .
Hao Y.,Li Q.,Mo H.,Zhang H.,Li H. .2018 .AMI-net: Convolution neural networks with affine moment invariants. IEEE Signal Processing Letters, 25(7) : 1064-1068.
Zhao Xiangyu,Peng Huang Xiangbo,Shu Xiangbo .2022 .Wavelet-Attention CNN for image classification. Multimedia Systems, 28 : 915-924.
Large J.,Lines J.,Bagnall A. .2019 .A probabilistic classifier ensemble weighting scheme based on cross-validated accuracy estimates. DataMin. Knowl. Discov, 33(6) : 1674-1709.
Rahimzadeh M.,Attar A. .2020 .A modified deep convolutional neural network for detecting COVID19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2. Informatics Med, 19 : 100360.
Boulkenafet Z.,Komulainen J.,Li L.,Feng X.,Hadid A. .2017 .Oulu-npu: A mobile face presentation attack database with real-world variations. In: FGR, : 612-618.
Zitong Yu .2020 .Face anti-spoofing with human material perception. Part VII 16, (28) : .
Yu Z. .2020 .Searching central difference convolutional networks for face anti-spoofing. in Proc. CVPR, : 5295-5305.
George A.,Marcel S. .2021 .Cross modal focal loss for RGBD face anti spoofing. In Proc. CVPR, : 7882-7891.
Parkin A.,Grinchuk O. .2019 .Recognizing multimodal face spoofing with face recognition networks. In Proc. CVPR Workshops, : 1-8.
Zhuo Wang .2022 .Face anti-spoofing using transformers with relation-aware mechanism. IEEE Transactions on Biometrics, Behavior and Identity Science, 4 : 439-450.
Finn C.,Abbeel P.,Levine S. .2017 .Modelagnostic meta-learning for fast adaptation of deep networks. In Proc. Int. Conf. Mach. Learn, : 1126-1135.
Määttä J.,Hadid A.,Pietikainen M. .2011 .Face spoofing detection from single images using microtexture analysis. In Proc. IEEE Int. Joint Conf. Biometrics, : 1-7.
Lucena O.,Junior A.,Moia V.,Souza R.,Valle E.,Lotufo R. .2017 .Transfer learning using convolutional neural networks for face anti-spoofing. In ICIAR., : .
Wang Zezheng .2020 .Deep spatial gradient and temporal depth learning for face anti spoofing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, : 5042-5051.
0

Citations

0

Downloads

48

Views