Detecting Deepfakes via Robust Spatio-Temporal Residual Learning Using Variational Autoencoders and EfficientNetV2
By: Ruby Chauhan, Renu Popli and Isha Kansal
References
- M. Kumar and H. K. Sharma, “A GAN-based model of deepfake detection in social media,” Procedia Comput. Sci., vol. 218, pp. 2153–2162, 2023.
- M. Alrashoud, “Deepfake video detection methods, approaches, and challenges,” Alex. Eng. J., vol. 125, pp. 265–277, 2025.
- B. A. Kumar et al., “Hybrid CMNV2: DeepFake faces classification and recognition using deep learning methods,” Results Eng., p. 107513, 2025.
- D.-C. Stanciu and B. Ionescu, “Autoencoder-based data augmentation for deepfake detection,” in Proceedings of the 2nd ACM International Workshop on Multimedia AI against Disinformation, 2023, pp. 19–27.
- S. Eidan, “Unmasking Deepfakes: A Systematic Review of Generation Techniques and Detection Strategies,” Iraqi J. Intell. Comput. Inform. IJICI, vol. 4, no. 2, pp. 134–154, 2025.
- D. Wodajo, S. Atnafu, and Z. Akhtar, “Deepfake video detection using generative convolutional vision transformer,” ArXiv Prepr. ArXiv230707036, 2023.
- Z. C. Bhaidasna, P. R. Swaminarayan, and H. Z. Bhaidasna, “Enhancing face recognition with deep learning architectures: a comprehensive review,” Int. J. Recent Innov. Trends Comput. Commun., vol. 11, no. 9, pp. 164–180, 2023.
- A. Rossler, D. Cozzolino, L. Verdoliva, C. Riess, J. Thies, and M. Nießner, “Faceforensics++: Learning to detect manipulated facial images,” in Proceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 1–11. Accessed: Mar. 01, 2025. [Online]. Available:
http://openaccess.thecvf.com/content_ICCV_2019/html/Rossler_FaceForensics_Learning_to_Detect_Manipulated_Facial_Images_ICCV_2019_paper.html - F. Chollet, “Xception: Deep learning with depthwise separable convolutions,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 1251–1258.
- M. Tan and Q. Le, “Efficientnetv2: Smaller models and faster training,” in International conference on machine learning, PMLR, 2021, pp. 10096–10106.
- H. H. Nguyen, J. Yamagishi, and I. Echizen, “Capsuleforensics: Using capsule networks to detect forged images and videos,” in ICASSP 2019–2019 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, 2019, pp. 2307–2311.
- Y. Li, X. Yang, P. Sun, H. Qi, and S. Lyu, “Celeb-df: A large-scale challenging dataset for deepfake forensics,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 3207–3216.
- D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” ArXiv Prepr. ArXiv13126114, 2013.
- R. Durall, M. Keuper, F.-J. Pfreundt, and J. Keuper, “Unmasking DeepFakes with simple Features,” Mar. 04, 2020, arXiv: arXiv:1911.00686. doi: 10.48550/arXiv.1911.00686.
- H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, “Multi-attentional deepfake detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 2185–2194. Accessed: Mar. 01, 2025. [Online]. Available:
https://openaccess.thecvf.com/content/CVPR2021/html/Zhao_Multi-Attentional_Deepfake_Detection_CVPR_2021_paper.html?ref=https://githubhelp.com - T. Jung, S. Kim, and K. Kim, “Deepvision: Deepfakes detection using human eye blinking pattern,” IEEE Access, vol. 8, pp. 83144–83154, 2020.
- L. Nataraj et al., “Detecting GAN generated fake images using co-occurrence matrices,” ArXiv Prepr. ArXiv190306836, 2019.
- E. Sabir, J. Cheng, A. Jaiswal, W. AbdAlmageed, I. Masi, and P. Natarajan, “Recurrent convolutional strategies for face manipulation detection in videos,” Interfaces GUI, vol. 3, no. 1, pp. 80–87, 2019.
- D. Güera and E. J. Delp, “Deepfake video detection using recurrent neural networks,” in 2018 15th IEEE international conference on advanced video and signal based surveillance (AVSS), IEEE, 2018, pp. 1–6.
- I. Amerini, L. Galteri, R. Caldelli, and A. Del Bimbo, “Deepfake video detection through optical flow based cnn,” in Proceedings of the IEEE/CVF international conference on computer vision workshops, 2019, pp. 0–0.
- N. Bonettini, E. D. Cannas, S. Mandelli, L. Bondi, P. Bestagini, and S. Tubaro, “Video face manipulation detection through ensemble of cnns,” in 2020 25th international conference on pattern recognition (ICPR), IEEE, 2021, pp. 5012–5019.
- I. J. Goodfellow, J. Shlens, and C. Szegedy, “Explaining and harnessing adversarial examples,” ArXiv Prepr. ArXiv14126572, 2014.
- A. Madry, A. Makelov, L. Schmidt, D. Tsipras, and A. Vladu, “Towards deep learning models resistant to adversarial attacks,” ArXiv Prepr. ArXiv170606083, 2017.
- N. Carlini and D. Wagner, “Towards evaluating the robustness of neural networks,” in 2017 ieee symposium on security and privacy (sp), Ieee, 2017, pp. 39–57.
- A. Gandhi and S. Jain, “Adversarial perturbations fool deepfake detectors,” in 2020 International joint conference on neural networks (IJCNN), IEEE, 2020, pp. 1–8.
- K. Zhang, Z. Zhang, Z. Li, and Y. Qiao, “Joint face detection and alignment using multitask cascaded convolutional networks,” IEEE Signal Process. Lett., vol. 23, no. 10, pp. 1499–1503, 2016.
- T. Zhao, X. Xu, M. Xu, H. Ding, Y. Xiong, and W. Xia, “Learning self-consistency for deepfake detection,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 15023–15033.
- A. Haliassos, K. Vougioukas, S. Petridis, and M. Pantic, “Lips don't lie: A generalisable and robust approach to face forgery detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2021, pp. 5039–5049.
- K. Shiohara and T. Yamasaki, “Detecting deepfakes with self-blended images,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 18720–18729.
DOI: https://doi.org/10.2478/ijssis-2026-0036 | Journal eISSN: 1178-5608
Language: English
Submitted on: Jan 17, 2026
Published on: Sep 20, 2026
Published by: International Journal on Smart Sensing and Intelligent Systems
In partnership with: Paradigm Publishing Services
Publication frequency: Volume open
Keywords:
Related subjects:
© 2026 Ruby Chauhan, Renu Popli, Isha Kansal, published by International Journal on Smart Sensing and Intelligent Systems
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.