Research Article |
Deepfake Detection using Integrate-backward-integrate Logic Optimization Algorithm with CNN
Author(s): R. Uma Maheshwari*, B. Paulchamy, Arun M, Vairaprakash Selvaraj , Dr. N. Naga Saranya and Dr . Sankar Ganesh S
Published In : International Journal of Electrical and Electronics Research (IJEER) Volume 12, Issue 2
Publisher : FOREX Publication
Published : 28 June 2024
e-ISSN : 2347-470X
Page(s) : 696-710
Abstract
The emergence of deepfake technology has spurred the need for robust and adaptive methods to detect manipulated media content. This study explores the integration of the Integrate-backward-integrate (IbI) Logic Optimization Algorithm with Convolutional Neural Networks (CNNs) for enhanced deepfake detection. The proposed approach involves a multi-phase iterative process: the CNN initially trained on a diverse dataset encompassing both real and deepfake images. The CNN serves as the foundation for the IbI-driven optimization. The integration phase employs the trained CNN to forward-integrate images, classifying them as real or deepfake. Subsequently, the IbI Logic Optimization Algorithm engages in the backward phase, utilizing feedback from the CNN's performance to iteratively refine the network's parameters, architecture, and feature extraction capabilities. This iterative optimization process aims to adaptively enhance the CNN's ability to discern subtle nuances between authentic and manipulated visuals. The re-integration phase evaluates the refined CNN's performance through multiple iterations, seeking to iteratively improve deepfake detection accuracy. Validation occurs using separate datasets to prevent overfitting and ensure the model's generalizability. The proposed method aims to enhance the CNN's adaptability to evolving deepfake techniques, addressing the dynamic nature of manipulative media creation. This fusion of IbI Logic Optimization with CNNs presents a promising avenue for bolstering deepfake detection capabilities. However, the effectiveness of this approach relies on dataset quality, network architecture, and the dynamic nature of deepfake generation techniques. Continuous refinement and validation are essential to adapt the model to new challenges posed by advancing deepfake technologies.
Keywords: Deepfake Detection
, Integrate-backward-integrate (IbI)
, Convolutional Neural Networks (CNNs)
, Image Manipulation
, Iterative Optimization
, Adaptive Learning
.
R. Uma Maheshwari*, Hindusthan Institute of Technology, Coimbatore; Email: umamaheshwari897@gmail.com
B. Paulchamy, Professor, Hindusthan Institute of Technology, Coimbatore; Email: luckshanthpaul@gmail.com
Arun M, Assistant Professor, Department of ECE, Panimalar Engineering College, Chennai; Email: arunmemba@ieee.org
Vairaprakash Selvaraj, Associate Professor, Department of Electronics and Communication Engineering Ramco Institute of Technology; Email: vairaprakashklu@gmail.com
Dr. N. Naga Saranya, Associate Professor, Department of Computer Applications Saveetha College of Liberal Arts & Science, SIMATS, Chennai India; Email: drnagasaranya@gmail.com
Dr . Sankar Ganesh S, Associate professor, Department of Electronics and Communication Engineering, AVS Engineering college, Millitary Road, Ammapet, Salem-636003, Tamilnadu; Email: sankar.ganesh308@gmail.com
-
[1] Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022). Deepfake detection: A systematic literature review. IEEE access, 10, 25494-25513.
-
[2] Zhao, H., Zhou, W., Chen, D., Wei, T., Zhang, W., & Yu, N. (2021). Multi-attentional deepfake detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 2185-2194).
-
[3] Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y. G. (2020, October). Wilddeepfake: A challenging real-world dataset for deepfake detection. In Proceedings of the 28th ACM international conference on multimedia (pp. 2382-2390).
-
[4] Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2021). DeepFake detection based on discrepancies between faces and their context. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(10), 6111-6121.
-
[5] Seow, J. W., Lim, M. K., Phan, R. C., & Liu, J. K. (2022). A comprehensive overview of Deepfake: Generation, detection, datasets, and opportunities. Neurocomputing, 513, 351-371.
-
[6] Kwon, P., You, J., Nam, G., Park, S., & Chae, G. (2021). Kodf: A large-scale korean deepfake detection dataset. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 10744-10753).
-
[7] Güera, D., & Delp, E. J. (2018, November). Deepfake video detection using recurrent neural networks. In 2018 15th IEEE international conference on advanced video and signal-based surveillance (AVSS) (pp. 1-6). IEEE.
-
[8] Das, S., Seferbekov, S., Datta, A., Islam, M. S., & Amin, M. R. (2021). Towards solving the deepfake problem: An analysis on improving deepfake detection using dynamic face augmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 3776-3785).
-
[9] Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020, October). Emotions don't lie: An audio-visual deepfake detection method using affective cues. In Proceedings of the 28th ACM international conference on multimedia (pp. 2823-2832).
-
[10] Maksutov, A. A., Morozov, V. O., Lavrenov, A. A., & Smirnov, A. S. (2020, January). Methods of deepfake detection based on machine learning. In 2020 IEEE conference of russian young researchers in electrical and electronic engineering (EIConRus) (pp. 408-411). IEEE.
-
[11] Guarnera, L., Giudice, O., Guarnera, F., Ortis, A., Puglisi, G., Paratore, A., ... & Battiato, S. (2022). The face deepfake detection challenge. Journal of Imaging, 8(10), 263.
-
[12] Ahmed, S. R. A., & Sonuç, E. (2023). Deepfake detection using rationale-augmented convolutional neural network. Applied Nanoscience, 13(2).
-
[13] Ju, Y., Hu, S., Jia, S., Chen, G. H., & Lyu, S. (2024). Improving fairness in deepfake detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (pp. 4655-4665).
-
[14] De Lima, O., Franklin, S., Basu, S., Karwoski, B., & George, A. (2020). Deepfake detection using spatiotemporal convolutional networks. arXiv preprint arXiv:2006.14749.
-
[15] Neekhara, P., Dolhansky, B., Bitton, J., & Ferrer, C. C. (2021). Adversarial threats to deepfake detection: A practical perspective. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 923-932).
-
[16] Pan, D., Sun, L., Wang, R., Zhang, X., & Sinnott, R. O. (2020, December). Deepfake detection through deep learning. In 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) (pp. 134-143). IEEE.
-
[17] Coccomini, D. A., Messina, N., Gennaro, C., & Falchi, F. (2022, May). Combining efficientnet and vision transformers for video deepfake detection. In International conference on image analysis and processing (pp. 219-229). Cham: Springer International Publishing.
-
[18] Zhang, T. (2022). Deepfake generation and detection, a survey. Multimedia Tools and Applications, 81(5), 6259-6276.
-
[19] Wang, T., Cheng, H., Chow, K. P., & Nie, L. (2023). Deep convolutional pooling transformer for deepfake detection. ACM Transactions on Multimedia Computing, Communications and Applications, 19(6), 1-20.
-
[20] Gong, D., Kumar, Y. J., Goh, O. S., Ye, Z., & Chi, W. (2021). DeepfakeNet, an efficient deepfake detection method. International Journal of Advanced Computer Science and Applications, 12(6).
-
[21] Shad, H. S., Rizvee, M. M., Roza, N. T., Hoq, S. M., Monirujjaman Khan, M., Singh, A., ... & Bourouis, S. (2021). Comparative analysis of deepfake image detection method using convolutional neural network. Computational Intelligence and Neuroscience, 2021.
-
[22] Taeb, M., & Chi, H. (2022). Comparison of deepfake detection techniques through deep learning. Journal of Cybersecurity and Privacy, 2(1), 89-106.