XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection

• URL: http://arxiv.org/abs/2607.03562v1
• Date: Fri, 03 Jul 2026 18:52:42 GMT
• Title: XPlainVerse: A Million-Scale Benchmark for Explainable Deepfake Detection
• Abstract summary: We introduce XPlainVerse, a large-scale benchmark for joint deepfake detection and human-centered explanation.<n>XPlainVerse comprises one million real and manipulated images, pairing authentic images from five established sources with forgeries generated by twelve off-the-shelf image editing and synthesis models.<n>Beyond dataset scale, XPlainVerse provides two complementary explanation styles: technical explanations for expert analysis and simplified explanations optimized for non-technical users.
• Score: 43.15397857869723
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As deepfake detection models increasingly produce natural language explanations, their reasoning often remains weakly grounded in visual artifacts, limiting reliability and user trust. Existing benchmarks mainly evaluate classification accuracy, overlooking whether explanations reflect the actual manipulations. This gap hinders progress toward deployable, explainable deepfake detection systems. To this end, we introduce XPlainVerse, a large-scale benchmark designed for joint deepfake detection and human-centered explanation. XPlainVerse comprises one million real and manipulated images, pairing authentic images from five established sources with forgeries generated by twelve off-the-shelf image editing and synthesis models. We further propose a multi-stage filtering pipeline, Edit-Check, to verify if manipulations satisfy their intended edits, enabling reliable reasoning supervision at scale. Beyond dataset scale, XPlainVerse provides two complementary explanation styles: technical explanations for expert analysis and simplified explanations optimized for non-technical users. To evaluate explanation quality beyond surface similarity, we propose novel metrics, EntityScore and EvidenceScore, that measure reasoning fidelity by checking whether explanations correctly identify manipulated entities and visual evidence. Human annotations on 2,000 explanation pairs validate our dataset quality against human judgment. We believe XPlainVerse will establish grounded explanation quality as a measurable dimension of deepfake detection and support scalable research on trustworthy, interpretable models.

Related papers

• Explainable Deepfake Detection with Feature-robust Augmentation and Evidence-grounded Explanation Optimization [46.970316236873515]
  The proposed approach wins the first place in ACM Multimedia 2026 Explainable Deepfake Detection Challenge.<n>We introduce Feature-robust Augmentation, which comprises diversified degradation-aware augmentation strategies, and a supervised contrastive learning pattern.<n>For explanation, we devise an evidence-grounded preference optimization process that guides model to prioritize genuine manipulation traces.
  arXiv  Detail & Related papers  (2026-08-21T09:30:34Z)
• Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection [8.599317072232198]
  We present Defake-o3, an AIGI detector that moves from speculative rationales to verifiable evidence.<n>It combines interactive visual search with verifier-guided evidence alignment.<n>Defake-o3 improves both detection accuracy and explanation quality.
  arXiv  Detail & Related papers  (2026-08-17T08:30:32Z)
• Explainable Deepfake Detection Challenge [42.4485282926075]
  The Explainable Deepfake Detection Challenge at ACM Multimedia 2026 is designed to benchmark this joint capability.<n>The evaluation combines classification metrics with semantic similarity, simplicity, and intent-aware grounding metrics.<n>The methodologies developed through the challenge will contribute to the development of next-generation explainable deepfake detectors.
  arXiv  Detail & Related papers  (2026-07-23T07:42:43Z)
• Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision [25.382800247901827]
  DeepfakeJudge is a framework for scalable reasoning supervision and evaluation.<n>It integrates an out-of-distribution benchmark containing recent generative and editing forgeries, a human-annotated subset with visual reasoning labels, and a suite of evaluation models.
  arXiv  Detail & Related papers  (2026-02-23T11:08:46Z)
• Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection [24.64785245180038]
  We provide the first systematic analysis of deepfake detectors in the context of multimodal misinformation detection.<n>Deepfake detectors offer limited standalone value, achieving F1 scores in the range of 0.26-0.53 on MMFakeBench and 0.33-0.49 on DGM4.<n>The evidence-centric fact-checking system achieves the highest performance, reaching F1 scores of approximately 0.81 on MMFakeBench and 0.55 on DGM4.
  arXiv  Detail & Related papers  (2026-02-02T09:28:16Z)
• TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection [28.635829897413416]
  TriDF is a benchmark for interpretable DeepFake detection.<n>This paper introduces TriDF, a comprehensive benchmark for interpretable DeepFake detection.
  arXiv  Detail & Related papers  (2025-12-11T14:01:01Z)
• Semantic Visual Anomaly Detection and Reasoning in AI-Generated Images [96.43608872116347]
  AnomReason is a large-scale benchmark with structured annotations as quadruple textbfAnomAgent<n>AnomReason and AnomAgent serve as a foundation for measuring and improving the semantic plausibility of AI-generated images.
  arXiv  Detail & Related papers  (2025-10-11T14:09:24Z)
• Common Sense Reasoning for Deepfake Detection [13.502008402754658]
  State-of-the-art deepfake detection approaches rely on image-based features extracted via neural networks. We frame deepfake detection as a Deepfake Detection VQA (DD-VQA) task and model human intuition. We introduce a new annotated dataset and propose a Vision and Language Transformer-based framework for the DD-VQA task.
  arXiv  Detail & Related papers  (2024-01-31T19:11:58Z)
• Linguistic Profiling of Deepfakes: An Open Database for Next-Generation Deepfake Detection [40.20982463380279]
  This paper introduces a deepfake database (DFLIP-3K) for the development of convincing and explainable deepfake detection. It encompasses about 300K diverse deepfake samples from approximately 3K generative models, which boasts the largest number of deepfake models in the literature. The two distinguished features enable DFLIP-3K to develop a benchmark that promotes progress in linguistic profiling of deepfakes.
  arXiv  Detail & Related papers  (2024-01-04T16:19:52Z)
• CrossDF: Improving Cross-Domain Deepfake Detection with Deep Information Decomposition [53.860796916196634]
  We propose a Deep Information Decomposition (DID) framework to enhance the performance of Cross-dataset Deepfake Detection (CrossDF) Unlike most existing deepfake detection methods, our framework prioritizes high-level semantic features over specific visual artifacts. It adaptively decomposes facial features into deepfake-related and irrelevant information, only using the intrinsic deepfake-related information for real/fake discrimination.
  arXiv  Detail & Related papers  (2023-09-30T12:30:25Z)
• Voice-Face Homogeneity Tells Deepfake [56.334968246631725]
  Existing detection approaches contribute to exploring the specific artifacts in deepfake videos. We propose to perform the deepfake detection from an unexplored voice-face matching view. Our model obtains significantly improved performance as compared to other state-of-the-art competitors.
  arXiv  Detail & Related papers  (2022-03-04T09:08:50Z)
• Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis [69.09526348527203]
  Deep generative models have led to highly realistic media, known as deepfakes, that are commonly indistinguishable from real to human eyes. We propose a novel fake detection that is designed to re-synthesize testing images and extract visual cues for detection. We demonstrate the improved effectiveness, cross-GAN generalization, and robustness against perturbations of our approach in a variety of detection scenarios.
  arXiv  Detail & Related papers  (2021-05-29T21:22:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.