Adversarial Attacks on Deepfake Detectors: A Challenge in the Era of AI-Generated Media
Francesco Guarnera, Luca Guarnera, Andrea Montibeller, Salvatore Alfio Sambataro, and 6 more authors
In Proceedings of the 34th ACM International Conference on Multimedia (MM ’26), 2026
The increasing realism of AI-generated media and its widespread dissemination through social media demand deepfake detectors that remain reliable under adversarial attacks and realistic post-processing. We present AADD-2026, a competitive benchmark for evaluating adversarial attacks against deepfake detectors under realistic deployment conditions. The challenge considers synthetic images from five generative families, social-media-inspired processing, JPEG and JPEG-AI compression, and eight heterogeneous detectors operating across spatial, frequency, and foundation-model representations. Ten teams submitted valid solutions, exploring latent-space, frequency-aware, ensemble, manifold-projection, and compression-aware attacks. Results show that explicitly accounting for compression and post-processing substantially improves transferability to unseen detectors. The winning approach achieves the highest attack success through a gradient-free real-face manifold projection strategy. Meanwhile, DINOv2- and SigLIP2-based detectors show substantially greater resilience than conventional architectures, highlighting a clear trade-off between attack transferability and perceptual fidelity.