Fact · Voice privacy and security
50percent
Open-source video deepfake detectors lost 50% of their AUC on the 2024 in-the-wild benchmark compared with earlier benchmarks.
Checked against its source on October 17, 2026
In the source's own words
“AUC decreasing by 50% for video, 48% for audio, and 45% for image models compared to previous benchmarks”
Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024, Nuria Alina Chandra et al., arXiv, 2025, Abstract.
Open the original- What it measures
- The same benchmark and comparison as the audio result, for video models.
- What it does not show
- Group result for open-source models, measured on a single benchmark.