An Intelligent Deep Learning Framework for Real-Time Detection and Classification of DeepFake Videos
Keywords:
Deep learning, DeepFake detection, Digital forensics, Fake media, Flask, LSTM, React, ResNeXt, Spatial features, Temporal features, Video classificationAbstract
DeepFakes are highly realistic synthetic media objects whose face or voice is substituted for another person's using deep learning. DeepFakes pose daunting challenges to the authenticity and credibility of digital media, and although they have potential applications in entertainment, education, and accessibility, they also prompt serious issues regarding misinformation, identity theft, political manipulation, and privacy violation. This paper introduces a DeepFake Detection System that is able to detect fake video content with high accuracy and reliability.
The system uses a hybrid deep learning model with ResNeXt for spatial feature extraction and Long Short-Term Memory (LSTM) networks for modeling temporal sequences. The videos are analyzed frame by frame to record both static visual hints and dynamic facial inconsistencies along a time axis. The backend is developed on Flask to deploy the trained model, and the frontend, which is developed using React, provides smooth video uploading and real-time user feedback. The model gives a binary prediction real or fake and confidence score, and the results are interpretable to end-users. This system uses spatial and temporal features together, improving detection accuracy and generalizing across different DeepFake datasets. The solution strives to make contributions to digital forensics and media integrity as the world becomes more saturated with synthetic content.
References
J. John and B. V. Sherif, "Comparative Analysis on Different DeepFake Detection Methods and Semi Supervised GAN Architecture for DeepFake Detection," 2022 Sixth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Dharan, Nepal, 2022, pp. 516-521, doi: https://doi.org/10.1109/I-SMAC55078.2022.9987265.
V. Devi, R. Kumar and V. Kumar, "Various Heuristic Fault Tolerance Routing Protocols and Factors in IoT Wireless Sensor Network," 2021 6th International Conference on Signal Processing, Computing and Control (ISPCC), Solan, India, 2021, pp. 701-707, doi: https://doi.org/10.1109/ISPCC53510.2021.9609424
A. Kaushal, S. Singh, S. Negi and S. Chhaukar, "A Comparative Study on Deepfake Detection Algorithms," 2022 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India, 2022, pp. 854-860, doi: https://doi.org/10.1109/ICAC3N56670.2022.10074593
K. Pradeep, N. Gobalakrishnan, N. Manikandan, L. J. Ali, P. K. and K. P. Vijayakumar, "A Review on Task Scheduling using Optimization Algorithm in Clouds," 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India, 2021, pp. 935-938, doi: https://doi.org/10.1109/ICOEI51242.2021.9452837
B. N. Jyothi and M. A. Jabbar, "Deep fake Video Detection Using Unsupervised Learning Models: Review," 2023 Second International Conference On Smart Technologies For Smart Nation (SmartTechCon), Singapore, Singapore, 2023, pp. 371-376, doi: https://doi.org/10.1109/SmartTechCon57526.2023.10391497
Z. Deng, B. Zhang, S. He and Y. Wang, "Deepfake Detection Method Based on Face Edge Bands," 2022 9th International Conference on Digital Home (ICDH), Guangzhou, China, 2022, pp. 251-256, doi: https://doi.org/10.1109/ICDH57206.2022.00046
U. Patil and P. M. Chouragade, "Deepfake Video Authentication Based on Blockchain," 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, India, 2021, pp. 1110-1113, doi: https://doi.org/10.1109/ICESC51422.2021.9532725
R. S. Dhanaraj and M. Sridevi, "A study on detection of copy-move forgery in digital images," 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India, 2021, pp. 900-905, doi: https://doi.org/10.1109/ICICV50876.2021.9388576
A. Moiz, A. Gupta, M. A. Akhtar, N. Agarwal and Kirti, "FPGA based ECG Denoising: Current Status and Future Technologies," 2021 6th International Conference on Signal Processing, Computing and Control (ISPCC), Solan, India, 2021, pp. 66-71, doi: https://doi.org/10.1109/ISPCC53510.2021.9609422
A. Barbadekar, S. Sole and A. Shekhavat, "Enhancing Social Media Security: LSTM-Based Deep Fake Video Detection," 2024 IEEE 9th International Conference for Convergence in Technology (I2CT), Pune, India, 2024, pp. 1-6, doi: https://doi.org/10.1109/I2CT61223.2024.10543604
F. Mira, "Deep Learning Technique for Recognition of Deep Fake Videos," 2023 IEEE IAS Global Conference on Emerging Technologies (GlobConET), London, United Kingdom, 2023, pp. 1-4, doi https://doi.org/10.1109/GlobConET56651.2023.10150143
