DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection

• URL: http://arxiv.org/abs/2511.19111v2
• Date: Wed, 26 Nov 2025 08:16:05 GMT
• Title: DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection
• Abstract summary: Diffusion-based editing enables realistic modification of local image regions, making AI-generated content harder to detect.<n>We introduce DiffSeg30k, a dataset of 30k diffusion-edited images with pixel-level annotations to support fine-grained detection.
• Score: 48.00148913303519
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Diffusion-based editing enables realistic modification of local image regions, making AI-generated content harder to detect. Existing AIGC detection benchmarks focus on classifying entire images, overlooking the localization of diffusion-based edits. We introduce DiffSeg30k, a publicly available dataset of 30k diffusion-edited images with pixel-level annotations, designed to support fine-grained detection. DiffSeg30k features: 1) In-the-wild images--we collect images or image prompts from COCO to reflect real-world content diversity; 2) Diverse diffusion models--local edits using eight SOTA diffusion models; 3) Multi-turn editing--each image undergoes up to three sequential edits to mimic real-world sequential editing; and 4) Realistic editing scenarios--a vision-language model (VLM)-based pipeline automatically identifies meaningful regions and generates context-aware prompts covering additions, removals, and attribute changes. DiffSeg30k shifts AIGC detection from binary classification to semantic segmentation, enabling simultaneous localization of edits and identification of the editing models. We benchmark three baseline segmentation approaches, revealing significant challenges in semantic segmentation tasks, particularly concerning robustness to image distortions. Experiments also reveal that segmentation models, despite being trained for pixel-level localization, emerge as highly reliable whole-image classifiers of diffusion edits, outperforming established forgery classifiers while showing great potential in cross-generator generalization. We believe DiffSeg30k will advance research in fine-grained localization of AI-generated content by demonstrating the promise and limitations of segmentation-based methods. DiffSeg30k is released at: https://huggingface.co/datasets/Chaos2629/Diffseg30k

Related papers

• Masked Generative Transformer Is What You Need for Image Editing [91.7627902312967]
  Diffusion models entangle edited regions with surrounding context, causing modifications to propagate into areas that should remain intact.<n>We propose a fundamentally different approach by leveraging Masked Generative Transformers (MGTs), whose localized token-prediction paradigm naturally confines changes to intended regions.<n>We present EditMGT, an MGT-based editing framework that is the first of its kind.
  arXiv  Detail & Related papers  (2026-05-11T17:05:52Z)
• SEED: A Large-Scale Benchmark for Provenance Tracing in Sequential Deepfake Facial Edits [22.00097357292037]
  Sequential Editing in Diffusion (textbfSEED) is a large-scale benchmark for sequential tracing in facial imagery.<n>SEED contains over 90K images constructed via one to four sequential edits using diffusion-based editing pipelines.<n>SEED supports step-wise evidence analysis and support forgery detection, sequence prediction.
  arXiv  Detail & Related papers  (2026-04-12T08:27:17Z)
• LocateEdit-Bench: A Benchmark for Instruction-Based Editing Localization [21.62979058692505]
  We propose a large-scale dataset comprising $231$K edited images to benchmark forgery localization methods.<n>Our dataset incorporates four cutting-edge editing models and covers three common edit types.<n>Our work establishes a foundation to keep pace with the evolving landscape of image editing, thereby facilitating the development of effective methods for future forgery localization.
  arXiv  Detail & Related papers  (2026-02-05T12:01:09Z)
• DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline [23.338550669094655]
  Diffusion-based image manipulation (DIML) enables realistic local forgeries that are hard to localize.<n>We present a large scale dataset for diffusion-based image localization (DIML) with more than 300,000 images.<n>We propose a localization framework that uses a frozen Visual Foundation Model (VFM) together with Multi Frequency Prompt Tuning (T) to capture both semantic and frequency cues.
  arXiv  Detail & Related papers  (2025-11-28T17:22:07Z)
• FragFake: A Dataset for Fine-Grained Detection of Edited Images with Vision Language Models [48.85744313139525]
  We develop FragFake, the first dedicated benchmark dataset for edited image detection.<n>We use Vision Language Models (VLMs) for the first time in the task of edited image classification and edited region localization.<n>This work is the first to reformulate localized image edit detection as a vision-language understanding task.
  arXiv  Detail & Related papers  (2025-05-21T15:22:45Z)
• X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models [3.610796534465868]
  Experimental results demonstrate that X-Edit accurately localizes edits in images altered by text-guided diffusion models.<n>This highlights X-Edit's potential as a robust forensic tool for detecting and pinpointing manipulations introduced by advanced image editing techniques.
  arXiv  Detail & Related papers  (2025-05-16T23:29:38Z)
• PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models [80.98455219375862]
  We present the first text-based image editing approach for object parts based on pre-trained diffusion models.<n>Our approach is preferred by users 66-90% of the time in conducted user studies.
  arXiv  Detail & Related papers  (2025-02-06T13:08:43Z)
• EditScout: Locating Forged Regions from Diffusion-based Edited Images with Multimodal LLM [50.054404519821745]
  We present a novel framework that integrates a multimodal Large Language Model for enhanced reasoning capabilities.<n>Our framework achieves promising results on MagicBrush, AutoSplice, and PerfBrush datasets.<n> Notably, our method excels on the PerfBrush dataset, a self-constructed test set featuring previously unseen types of edits.
  arXiv  Detail & Related papers  (2024-12-05T02:05:33Z)
• LIME: Localized Image Editing via Attention Regularization in Diffusion Models [69.33072075580483]
  This paper introduces LIME for localized image editing in diffusion models.<n>LIME does not require user-specified regions of interest (RoI) or additional text input, but rather employs features from pre-trained methods and a straightforward clustering method to obtain precise editing mask.<n>We propose a novel cross-attention regularization technique that penalizes unrelated cross-attention scores in the RoI during the denoising steps, ensuring localized edits.
  arXiv  Detail & Related papers  (2023-12-14T18:59:59Z)
• Weakly-supervised deepfake localization in diffusion-generated images [4.548755617115687]
  We propose a weakly-supervised localization problem based on the Xception network as the backbone architecture. We show that the best performing detection method (based on local scores) is less sensitive to the looser supervision than to the mismatch in terms of dataset or generator.
  arXiv  Detail & Related papers  (2023-11-08T10:27:36Z)
• iEdit: Localised Text-guided Image Editing with Weak Supervision [53.082196061014734]
  We propose a novel learning method for text-guided image editing. It generates images conditioned on a source image and a textual edit prompt. It shows favourable results against its counterparts in terms of image fidelity, CLIP alignment score and qualitatively for editing both generated and real images.
  arXiv  Detail & Related papers  (2023-05-10T07:39:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.