No Detail Found!

Investigation and Morphing Attack Detection Techniques in Multimedia: A Detail Review

Author(s)
Ateeq Ur Rehman Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar 25000, Pakistan
Muhammad Mehran Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar 25000, Pakistan
Muniba Ashfaq Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar 25000, Pakistan
Zahid Wadud Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar 25000, Pakistan
Sadeeq Jan Department of Computer Systems Engineering, University of Engineering & Technology, Peshawar 25000, Pakistan
Ghassan Husnain Department of Computer Science, IQRA National University, Peshawar 25100, Pakistan
Waqas Ahmad Department of Computer Science, IQRA National University, Peshawar 25100, Pakistan
Abstract
Multimedia forensics is an emerging field that focuses on the analysis of digital media to identify and authenticate digital evidence. It is a rapidly growing field that is being used in a variety of applications, including law enforcement, intelligence gathering, and digital forensics. This paper provides an overview of the current state of multimedia forensics and examines the various techniques used to detect and analyze digital evidence. This work examines the challenges associated with the use of these techniques and provides an overview of the current research in the field. Multimedia forensics involves the analysis of digital media to identify and authenticate digital evidence. This includes the analysis of images, audio, video, and other digital media. In addition to being widely used in special effects for entertainment, it is also used in computer vision and digital media. In this article, we investigated various morphing detection methods, techniques, and approaches in multimedia, i.e., image and video. Examinations of the number of "critical sites" are to be identified for successful morph detection as well as potential issues are included in the detailed description of the algorithms employed. Despite being one of the oldest methods, the mesh warping method is highly efficient. Facial recognition systems are susceptible to various biometric assaults because modern picture modification is now possible due to advancements in technology. In this study, the latest morphing attack detection techniques (MADT) approaches are compared and analyzed. On a variety of source picture databases, the effectiveness of various MADT methodologies is also contrasted. This work lists the limitations, benefits, and drawbacks of each morphing approach as well as how to generate morph images. Results are examined and contrasted with an indepth analysis that sheds light on the weaknesses of current systems. The information presented in this paper is crucial for creating an advanced morphing attack detection scheme.
Publication Details
Page(s) 44-81
DOI DOI not available
Published Journal: The Sciencetech, Volume: 4, Issue: 2, Year: 2023

Request the full text from PASTIC

Keywords
morphed identities, Biometrics, morphing, identity recognition system, Forensics, Digital Forensic
References
Agarwal S.,Khan N.,Goyal D.,Singh R. .2022 .A novel morphing attack detection technique using an ensemble of CNNs and FPNs. In Proceedings of the International Conference on Computational Intelligence and Data Science (ICCIDS), : 183-190.
Alves A. X.,Ravanelli M. .2019 .. Continuous Wavelet Transform-based Audio Morphing. In 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), : 316-320.
Abdullah M. F. B.,Rajion Z. A.,Yap V. V. .2021 .Morphing attack detection using deep features and extreme learning machine. Multimedia Tools and Applications, 80(1) : 329-352.
Belongie S.,Malik J.,Puzicha J. .2002 .Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4) : 509-522.
Ahmad W.,Ahmed S.,Sheeraz N.,Khan A.,Ishtiaq A.,Saba M. .2020 .Localization Error Computation for RSSI Based Positioning System in VANETs. In 2019 International Conference on Advances in the Emerging Computing Technologies (AECT), : 1-6.
Biswas A.,Pramanik S.,Das S.,Sengupta S. .2020 .Morphing attack detection using CNN with triplet loss. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), : 1-8.
Bhat V. H.,Kumar P. .2018 .Video morphing: A review. International Journal of Computer Science and Mobile Computing, 7(9) : 277-284.
Beier T.,Neely S. .1992 .Feature-based image metamorphosis. In Proceedings of the SIGGRAPH'92: 19th Annual Conference on Computer Graphics and Interactive Techniques, : 35-42.
Bebis G.,Georgiopoulos M.,Rangarajan N.,Valavanis K. P. .2006 .Image morphing: a survey. In Advances in visual computing, : 1-10.
Besl P. J.,McKay N. D. .1992 .A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2) : 239-256.
Bradski G. .1998 .Computer Vision Face Tracking for Use in a Perceptual User Interface. Intel Technology Journal, 2(2) : 1-15.
Cox I. J. .1997 .Secure Spread Spectrum Watermarking for Multimedia. IEEE Transactions on Image Processing, 6(12) : 1673-1687.
Chiang C. T.,Chen S. W. .2015 .A novel morphing technique based on gradient vector flow and level set method. Signal, Image and Video Processing, 9(4) : 785-797.
Dolhansky B.,Bitton J.,Pflaum B.,Lu J.,Howes R.,Wang M.,Ferrer C. .2006 .The deepfake detection challenge dataset. , : .
Ferrara M.,Franco A.,Maltoni D. .2018 .Face Demorphing. IEEE Transactions on Information Security, 13(4) : 1008-1017.
Farid H. .2009 .Image Forgery Detection. IEEE Signal Processing Magazine, 26(2) : 16-25.
Godage S. R.,Løvåsdal F.,Venkatesh S.,Raja K.,Ramachandra R.,Busch C. .2022 .Analyzing human observer ability in morphing attack detection-where do we stand?. IEEE Transactions on Technology and Society., : .
Gao S.,Liu Y.,J. Y.,Wang Q.,Y. Q. .2020 .A survey of face morphing detection methods. IEEE Access, 8 : 210567-210583.
Ghosh S.,Das P.,Mukherjee J. .2021 .Morphing detection using local binary pattern variance and ensemble deep network. Journal of Ambient Intelligence and Humanized Computing, 12(7) : 6847-6860.
Grgic M.,Delac K.,Grgic S. .2011 .SCface-Surveillance Cameras Face Database. Multimedia Tools and Applications, 10 : 863-879.
Goodfellow I.,Bengio Y.,Courville A. .2016 .Deep learning. , : .
Ghosh S.,Pakray P. .2018 .A study on text morphing techniques. International Journal of Computer Science and Information Technologies, 9(4) : 5523-5526.
Anwar G.,S. G. .2022 .An intelligent probabilistic whale optimization algorithm (i-WOA) for clustering in vehicular ad hoc networks. International Journal of Wireless Information Networks, 29(2) : 143-156.
Hu Y.,Xie X.,Zhang J.,Song Y. .2020 .Deep learning-based morphing detection: A comprehensive review. Journal of Visual Communication and Image Representation, 67 : 102836.
Hossain A.,Chakraborty A.,Ali M. A.,Islam M. S. .2020 .A review on image morphing techniques and applications. Journal of Imaging, 6(11) : 138.
Husnain G.,Anwar S.,Shahzad F. .2023 .An Enhanced AI-Enabled Routing Optimization Algorithm for Internet of Vehicles (IoV). Wireless Personal Communications, : 1-21.
Hamza M.,Tehsin S.,Humayun M.,Almufareh M. F.,Alfayad M. .2022 .A Comprehensive Review of Face Morph Generation and Detection of Fraudulent Identities. Applied Sciences, 12(12) : 12545.
Husnain G.,Anwar S.,Sikander G.,Ali A.,Lim S. .2023 .A BioInspired Cluster Optimization Schema for Efficient Routing in Vehicular Ad Hoc Networks (VANETs). Energies, 16(3) : 1456.
Husnain G.,Anwar S.,Shahzad F.,Sikander G.,Tariq R.,Bakhtyar M.,Lim S. .2022 .An Intelligent Harris Hawks Optimization Based Cluster Optimization Scheme for VANETs. Journal of Sensors, : .
Ismail A. A.,Pathan A. K.,Wadud Z. .2019 .Text transformation techniques: A survey. Digital Communications and Networks, 5(1) : 1-11.
Jot J. M.,Arfib D.,Richard G. .2017 .Audio morphing based on time-frequency analysis and spectral envelope modeling. In Proceedings of the 20th International Conference on Digital Audio Effects (DAFx), : 1-10.
Jiang Y.,Liu J.,Zhang Q. .2018 .Deep learning-based video morphing. Journal of Electronic Imaging, 27(2) : 1-13.
Khattak N. Y.,Hussnain E. G.,Ahmad W.,Islam S. U.,Haq I. U. .2023 .Computer Vision-Based Human Activity Classification and Prediction. The Sciencetech, 4(1) : .
Kokaram A. C.,Morris B. T. .2017 .Video morphing: A survey. Proceedings of the IEEE, 105(2) : 174-188.
Kim Y.,Choi J. .2018 .Real-time face morphing using dynamic region-based blending. The Visual Computer, 34(12) : 1623-1636.
Knoche H.,Riegler M. .2018 .Face morphing: A critical review of the current state-of-the-art. EURASIP Journal on Information Security, : 1-17.
Kasiski A.,Florek A.,Schmidt A. .2008 .The PUT face database. Image Processing & Communications, 13 : 59-64.
Kong J.,Huang Y.,Bao S. .2017 .Audio morphing using linear interpolation and harmonic-percussive separation. In Proceedings of the International Conference on Audio, Language and Image Processing, : 140-145.
Kannala J.,Rahtu E. .2012 .BSIF: Binarized statistical image features. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), 10 : 1363-1366.
Kong J.,Huang Y.,Bao S. .2017 .Audio morphing using linear interpolation and harmonic-percussive separation. In Proceedings of the International Conference on Audio, Language and Image Processing, : 140-145.
Li C.,Cao Y.,Zhang Y.,Chen Y. .2017 .A pixel-level video morphing method based on optical flow and Laplacian pyramid. Multimedia Tools and Applications, 76(22) : 23657-23674.
Lu J.,Zeng B.,Liu J.,Zhang Y. .2017 .Feature-based video morphing using multiband blending. Journal of Electronic Imaging, 26(2) : 1-10.
Lee J. H.,Lee K. M. .2006 .Real-time video morphing using trilinear interpolation. In Proceedings of the Pacific-Rim Conference on Multimedia, : 44-55.
Liu J. (n.d.). .2012 .A study on face morphing algorithms. , : .
Lowe D. G. .2004 .Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2) : 91-110.
. .ensemble of deep learning classifiers. Multimedia Tools and Applications, 80(15) : 23617-23647.
Maraba M. E.,Maleh Y.,Alrabaee S. .2021 .A robust morphing attack detection framework using a two-stage classifier. IEEE Access, 9(50) : 260-50.
Martínez A.,Benavente R. .1998 .. The AR Face Database (Tech. Rep. No. 24), : .
McPherson A.,Plumbley M. D. .2018 .Signal processing for music analysis. In Handbook of Signal Processing Systems, : 1-53.
Ma D. S.,Correll J.,Wittenbrink B. .2015 .The Chicago face database: A free stimulus set of faces and norming data. Behavior Research Methods, 10 : 1122-1135.
Mullens S.,Notley S. .2006 .Image Morphing. , : .
Mudur S. P. .1996 .A survey of image morphing techniques. Computer Graphics Forum, 15(1) : 21-31.
Naveen S. N.,Hanumanthappa M.,Nagaraja R.,Padmavathi G. .2020 .Multi-modal biometric systems: A survey. Journal of Ambient Intelligence and Humanized Computing, 11(8) : 3469-3485.
Pan Y.,He X.,Zhang X.,Huang K.,Li W. .2021 .Morphing attack detection with adversarial examples. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), : 1-8.
Peeters G.,Giannoulis D.,Klapuri A. .2018 .Analyzing and synthesizing acoustic and musical sounds. , : 247-292.
Panetta K.,Wan Q.,Agaian S.,Rajeev S.,Kamath S.,Rajendran R.,Rao S. P.,Kaszowska A.,Taylor A.,Samani A. .2019 .A Comprehensive Database for Benchmarking Imaging Systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10 : 509-520.
Peng F.,Zhang L. B.,Long M. .2019 .FD-GAN: Face DeMorphing Generative Adversarial Network for Restoring Accomplice's Facial Image. IEEE Access, 7 : 75122-75131.
Raghavendra R.,Raja K. B.,Busch C. .2016 .Exploring the usefulness of light field cameras for biometrics: An empirical study on face and iris recognition. IEEE Transactions on Information Forensics and Security, 11(5) : 922-936.
Roads C. .2019 .The computer music tutorial. , : .
Inc Reallusion .2023 .. Reallusion iClone. Retrieved April 18, : .
Singh R. K.,Singh S.,Sharma V.,Raman B. .2021 .Morphing detection in face recognition using ensemble deep learning models. In Proceedings of the International Conference on Intelligent Computing and Communication (ICICC), : 1231-1240.
Silva D. C. D.,Figueiredo R. C.,Nascimento T. D.,Oliveira M. .2021 .Morphing attack detection using multi-channel convolutional neural network. IEEE Access, 9 : 95280-95292.
Singh A.,Saha S.,Ray A. .2021 .Morphing attack detection using attention based siamese networks. In Proceedings of the International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), : 168-174.
Shaker A. W. A. M. A.,Elshamy M. M.,Alshebeili S. A. .2021 .Morphing attack detection using enhanced LBP features and deep learning. Multimedia Systems, 27(1) : 57-75.
Singh R.,Kumar V.,Verma A. .2020 .A morphing attack detection framework for biometric authentication using deep learning and transfer learning. Multimedia Tools and Applications, 11 : 213-11.
Sandwell D. T. .1987 .Biharmonic spline interpolation of GEOS-3 and SEASAT altimeter data. Geophysical Research Letters, 2 : 139-142.
Song X.,Li M.,Liu Y.,Shen J. .2021 .Face morphing detection based on visual saliency and high-order statistics. IEEE Access, 9 : 84676-84686.
Smythe D. B. .1990 .A Two-Pass Mesh Warping Algorithm for Object Transformation. Technical Report 1030; ILM Computer, : .
Sim T.,Baker S.,Bsat M. .2003 .The CMU pose, Illumination, and expression database. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10 : 1615-1618.
Scherhag U.,Rathgeb C.,Merkle J.,Breithaupt R.,Busch C. .2019 .Face Recognition Systems Under Morphing Attacks: A Survey. IEEE Access, 7 : 23012-23026.
Smith S. W. .1998 .Image morphing techniques: a survey. ACM Computing Surveys (CSUR), 30(2) : 183-222.
Szeliski R. .2006 .Image alignment and stitching: a tutorial. Foundations and Trends® in Computer Graphics and Vision, 2(1) : 1-104.
Shrivastava A.,Pfister T.,Tuzel O.,Susskind J.,Wang W.,Webb R. .2017 .Learning from simulated and unsupervised images through adversarial training. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 2242-2251.
Saeed N.,Ahmad W.,Bhatti D. M. S. .2018 .Localization of vehicular ad-hoc networks with RSS based distance estimation. In 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET), : 1-6.
Spors S.,Dörfler M. .2018 .Analyzing and synthesizing acoustic and musical sounds. , : 293-320.
Smith Micro Software .2023 .. Poser. Retrieved April 18, : .
Szegedy C. .2015 .Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision, : .
Senthilkumar R.,Gnanamurthy R. K. .2014 .A detailed survey on 2D and 3D still face and face video databases part I. In Proceedings of the 2014 International Conference on Communication and Signal Processing, : 401-406.
Inc Sketchfab .2023 .. Sketchfab. Retrieved April 18, : .
Thies J.,Zollhöfer M.,Stamminger M.,Theobalt C.,Nießner M. .2016 .Face2Face: Real-time face capture and reenactment of RGB videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 2387-2395.
Talip F. A.,Alasfour F.,Zaidan B. B.,Zaidan A. A. .2021 .Biometric anti-spoofing: A survey on face morphing attacks and detection methods. In Proceedings of the 2nd International Conference on Computer Science and Engineering (IC2SE), : 1-5.
Tzanetakis G.,Cook P. .2009 .Audio analysis using the discrete wavelet transform. Journal of the Audio Engineering Society, 47(4) : 282-289.
Ullah T.,Hussnain E. G.,Ahmad W.,Sikander G.,Ashfaq M. .2023 .An Efficient Machine Learning based Multiclass Cyber Attacks Classification and Prediction. The Sciencetech, 4(1) : .
Venkatesh S.,Ramachandra R.,Raja K.,Damer N.,Busch C. .2020 .Can GAN generated morphs threaten face recognition systems equally as landmark based morphs?- vulnerability and detection. In Proceedings of the IWBF 2020: 8th International Workshop on Biometrics and Forensics, : 1-6.
Venkatesh S.,Ramachandra R.,Raja K.,Spreeuwers L.,Veldhuis R.,Busch C. .2020 .Detecting Morphing Face Attacks Using Residual Noise from Deep Multi-Scale Context Aggregation Network. In IEEE Winter Conference on Applications of Computer Vision, : 979-988.
Viola P.,Jones M. .2001 .Rapid Object Detection using a Boosted Cascade of Simple Features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1 : 511-518.
Vasconcelos F. A.,Vasconcelos L. A. .2021 .A novel approach to image morphing based on distance maps. Journal of Visual Communication and Image Representation, 74 : 103068.
Wang R.,Juefei-Xu F.,Guo Q.,Huang Y.,Xie X.,Ma L.,Liu Y. .2020 .Amora: Black-box adversarial morphing attack. In Proceedings of the 28th ACM International Conference on Multimedia, : 1376-1385.
Wolberg G. . .Image morphing: A survey. The Visual Computer, 14(8) : 360-372.
Wu Z.,Zhang C.,Zhang X.,Jia Y.,Y. Y. .2018 .Deep image morphing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 190-199.
Ahmad Waqas,Article ID .2023 ."Received Signal Strength-Based Localization for Vehicle Distance Estimation in Vehicular Ad Hoc Networks (VANETs)". Journal of Sensors, : .
Wang Z.,Feng S.,Sun J.,X. J. .2021 .Towards robust morphing attack detection: A survey. IEEE Transactions on Information Forensics and Security, 16 : 2386-2402.
Yadav R.,Rathore S.,Jha M. .2022 .A comprehensive review of face morphing attack detection methods using deep learning techniques. In Proceedings of the 6th International Conference on Machine Learning and Soft Computing (ICMLSC), : 66-72.
Yin L.,Chen X.,Sun Y.,Worm T.,Reale M. .2008 .A highresolution 3D dynamic facial expression database. In Proceedings of the 2008, 8th IEEE International Conference on Automatic Face Gesture Recognition, : 1-6.
Yip A. W.,Sinha P. .2002 .Contribution of Color to Face Recognition. Perception, 31(8) : 995-1003.
Yu K.,Chen H. .2011 .Feature-based video morphing. Journal of Software, 6(4) : 544-550.
Zhou T.,Brown M.,Snavely N.,Lowe D. G. .2018 .Unsupervised learning of depth and ego-motion from video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 1851-1858.
0

Citations

0

Downloads

4

Views