Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social Dissemination

• URL: http://arxiv.org/abs/2608.14391v2
• Date: Mon, 17 Aug 2026 01:05:35 GMT
• Title: Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social Dissemination
• Abstract summary: RA-Bench is a benchmark for AI-generated video detection that uses Real videos as anchors.<n> RA-Bench contains 17,886 videos, comprising 1,830 real-video anchors across 10 social-risk categories.<n>None of the three detector families generalizes consistently across RA-Bench instances.
• Score: 81.00778788481266
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent video generators can fabricate realistic depictions of wars, disasters, public emergencies, and other real-world crises, creating substantial risks of misinformation. Existing benchmarks, however, provide limited evidence on detector and generator behavior in such settings, including how detectability varies with generation conditions, how people perceive generated videos, and whether detectors remain reliable during social dissemination. To address this gap, we introduce RA-Bench, a benchmark for AI-generated video detection that uses Real videos as Anchors. RA-Bench contains 17,886 videos, comprising 1,830 real-video anchors across 10 social-risk categories and 16,056 generated clips from four open-source and five closed-source generators. Based on RA-Bench, we organize our evaluation along three dimensions. We first assess detector generalization across seven traditional detectors, ten zero-shot multimodal models under three review settings, and two MLLMs specifically fine-tuned on AI-generated video detection. Across these methods, none of the three detector families generalizes consistently across RA-Bench instances. We then examine how detectability varies with generation quality, conditioning information, and sampling seeds. These analyses show that generation properties affect detector families differently, while source-level detection patterns remain stable across seeds. Finally, we study human authenticity judgments and detector reliability during social dissemination. We find that videos that mislead people are also difficult for current detectors, and that social dissemination makes detection harder. Together, these findings show that current methods struggle to detect realistic AI-generated videos, highlighting the need for detectors robust to evolving video generators.

Related papers

• CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection [12.128022166557754]
  CoCoVideo-26K is a contrastive, commercial-model-based AIGC video dataset covering 13 mainstream commercial generators.<n>Building on this dataset, we propose CoDetect, a framework integrating contrastive learning with confidence-gated multimodal large language model (MLLM) inference.
  arXiv  Detail & Related papers  (2026-05-26T03:18:44Z)
• Where Detectors Fail: Probing Generative Space for Generalizable AI-Generated Image Detection [69.6123714120735]
  Detecting AI-generated images (AIGI) remains challenging because detectors often fail to generalize to unseen generators.<n>We propose PROBE, a framework that improves detector generalization by actively exploring challenging regions of the generative process.
  arXiv  Detail & Related papers  (2026-05-24T07:15:06Z)
• Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning [66.51617619673587]
  We present Skyra, a specialized large language model (MLLM) that identifies human-perceivable visual artifacts in AI-generated videos.<n>To support this objective, we construct ViF-CoT-4K for Supervised Fine-Tuning (SFT), which represents the first large-scale AI-generated video dataset with fine-grained human annotations.<n>We then develop a two-stage training strategy that systematically enhances our model's artifact's-temporal perception, explanation capability, and detection accuracy.
  arXiv  Detail & Related papers  (2025-12-17T18:48:26Z)
• Benchmarking Fake Voice Detection in the Fake Voice Generation Arms Race [5.051497895059242]
  Existing benchmarks aggregate diverse fake voice samples into a single dataset for evaluation.<n>This practice masks method-specific artifacts and obscures the varying performance of detectors against different generation paradigms.<n>We introduce the first ecosystem-level benchmark that systematically evaluates the interplay between 17 state-of-the-art fake voice generators and 8 leading detectors through a novel one-to-one evaluation protocol.
  arXiv  Detail & Related papers  (2025-10-08T00:52:06Z)
• BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation [77.55074597806035]
  GenBuster-200K is a large-scale, high-quality AI-generated video dataset featuring 200K high-resolution video clips.<n>BusterX is a novel AI-generated video detection and explanation framework leveraging multimodal large language model (MLLM) and reinforcement learning.
  arXiv  Detail & Related papers  (2025-05-19T02:06:43Z)
• GenVidBench: A Challenging Benchmark for Detecting AI-Generated Video [35.05198100139731]
  We introduce GenVidBench, a challenging AI-generated video detection dataset with several key advantages.<n>The dataset includes videos from 8 state-of-the-art AI video generators.<n>It is analyzed from multiple dimensions and classified into various semantic categories based on their content.
  arXiv  Detail & Related papers  (2025-01-20T08:58:56Z)
• Turns Out I'm Not Real: Towards Robust Detection of AI-Generated Videos [16.34393937800271]
  generative models in creating high-quality videos have raised concerns about digital integrity and privacy vulnerabilities. Recent works to combat Deepfakes videos have developed detectors that are highly accurate at identifying GAN-generated samples. We propose a novel framework for detecting videos synthesized from multiple state-of-the-art (SOTA) generative models.
  arXiv  Detail & Related papers  (2024-06-13T21:52:49Z)
• DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark [38.604684882464944]
  We introduce the first AI-generated video detection dataset, GenVideo. It features a large volume of videos, including over one million AI-generated and real videos collected. We introduce a plug-and-play module, named Detail Mamba, to enhance detectors by identifying AI-generated videos.
  arXiv  Detail & Related papers  (2024-05-30T05:36:12Z)
• Assaying on the Robustness of Zero-Shot Machine-Generated Text Detectors [57.7003399760813]
  We explore advanced Large Language Models (LLMs) and their specialized variants, contributing to this field in several ways. We uncover a significant correlation between topics and detection performance. These investigations shed light on the adaptability and robustness of these detection methods across diverse topics.
  arXiv  Detail & Related papers  (2023-12-20T10:53:53Z)
• VideoForensicsHQ: Detecting High-quality Manipulated Face Videos [77.60295082172098]
  We show how the performance of forgery detectors depends on the presence of artefacts that the human eye can see. We introduce a new benchmark dataset for face video forgery detection, of unprecedented quality.
  arXiv  Detail & Related papers  (2020-05-20T21:17:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.