The Courtroom Trial of Pixels: Robust Image Manipulation Localization via Adversarial Evidence and Reinforcement Learning Judgment

• URL: http://arxiv.org/abs/2604.14703v1
• Date: Thu, 16 Apr 2026 07:09:59 GMT
• Title: The Courtroom Trial of Pixels: Robust Image Manipulation Localization via Adversarial Evidence and Reinforcement Learning Judgment
• Abstract summary: We propose a courtroom-style IML framework that regards IML task as the confrontation of evidence followed by judgment.<n>We develop a reinforcement learning model that performs strategic re-inference and refinement on uncertain regions.<n> Experimental results show that our model achieves superior average performance compared with SOTA IML methods.
• Score: 15.520850734569564
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although some existing image manipulation localization (IML) methods incorporate authenticity-related supervision, this information is typically utilized merely as an auxiliary training signal to enhance the model's sensitivity to manipulation artifacts, rather than being explicitly modeled as localization evidence opposing the manipulated regions. Consequently, when manipulation traces are subtle or degraded by post-processing and noise, these methods struggle to explicitly compare manipulated and authentic evidence, resulting in unreliable predictions in ambiguous areas. To address these issues, we propose a courtroom-style adjudication framework that regards IML task as the confrontation of evidence followed by judgment. The framework comprises a prosecution stream, a defense stream, and a judge model. We first build a dual-hypothesis segmentation architecture on a shared multi-scale encoder, in which the prosecution stream asserts manipulation and the defense stream asserts authenticity. Guided by edge priors, it produces evidence for manipulated and authentic regions through cascaded multi-level fusion, bidirectional disagreement suppression, and dynamic debate refinement. We further develop a reinforcement learning judge model that performs strategic re-inference and refinement on uncertain regions, yielding a manipulated-region mask. The judge model is trained with advantage-based rewards and a soft-IoU objective, and reliability is calibrated via entropy and cross-hypothesis consistency. Experimental results show that our model achieves superior average performance compared with SOTA IML methods.

Related papers

• PNEC-Mamba: Prototype-Guided Positive-Negative Evidence Calibration for Hyperspectral Image Classification [49.52488260487956]
  In hyperspectral images, pixel representations are often ambiguous due to factors such as spectral similarity, mixed pixels, and local context interference.<n>We propose PNEC-Mamba, a prototype-guided positive-negative evidence calibration framework.<n>PNEC-Mamba achieves superior classification performance compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-08-03T08:45:13Z)
• Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning [6.951909224842812]
  Security-critical biometric and forensic applications require accurate predictions and reliable confidence estimates, particularly under distribution shift.<n>We propose an uncertainty-aware deepfake detection framework that identifies manipulations through inconsistencies across complementary evidence sources.<n>We introduce Inter-Branch Disagreement (IBDC), a disagreement-aware uncertainty modeling mechanism that links predictive uncertainty to conflicts among evidence streams.
  arXiv  Detail & Related papers  (2026-07-30T18:42:01Z)
• REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection [33.33464433821003]
  Multimodal manipulation detection aims to simultaneously identify forged image--text pairs and localize tampered regions.<n>Inspired by human comparative reasoning, we reformulate this task as a reference-grounded verification problem.<n>We propose REVEAL, a framework explicitly designed for this comparative paradigm.
  arXiv  Detail & Related papers  (2026-05-27T13:24:41Z)
• DWBench: Holistic Evaluation of Watermark for Dataset Copyright Auditing [43.881484429055654]
  dataset watermark technique holds promise for auditing and verifying usage.<n>We develop DWBench, a unified benchmark and open-source toolkit for systematically evaluating image dataset watermark techniques.<n>We present the results of two new metrics: sample significance for fine-grained watermark distinguishability and verification success rate for dataset-level auditing.
  arXiv  Detail & Related papers  (2026-02-14T01:09:19Z)
• Gaming the Judge: Unfaithful Chain-of-Thought Can Undermine Agent Evaluation [76.5533899503582]
  Large language models (LLMs) are increasingly used as judges to evaluate agent performance.<n>We show this paradigm implicitly assumes that the agent's chain-of-thought (CoT) reasoning faithfully reflects both its internal reasoning and the underlying environment state.<n>We demonstrate that manipulated reasoning alone can inflate false positive rates of state-of-the-art VLM judges by up to 90% across 800 trajectories spanning diverse web tasks.
  arXiv  Detail & Related papers  (2026-01-21T06:07:43Z)
• FakeRadar: Probing Forgery Outliers to Detect Unknown Deepfake Videos [56.782373316571444]
  We propose FakeRadar, a novel deepfake video detection framework.<n>FakeRadar addresses the challenges of cross-domain generalization in real-world scenarios.
  arXiv  Detail & Related papers  (2025-12-16T17:11:45Z)
• Beyond Artificial Misalignment: Detecting and Grounding Semantic-Coordinated Multimodal Manipulations [56.816929931908824]
  We pioneer the detection of semantically-coordinated manipulations in multimodal data.<n>We propose a Retrieval-Augmented Manipulation Detection and Grounding (RamDG) framework.<n>Our framework significantly outperforms existing methods, achieving 2.06% higher detection accuracy on SAMM compared to state-of-the-art approaches.
  arXiv  Detail & Related papers  (2025-09-16T04:18:48Z)
• A Few Large Shifts: Layer-Inconsistency Based Minimal Overhead Adversarial Example Detection [13.109309606764754]
  We introduce a plug-in detection framework that leverages internal layer-wise inconsistencies within the target model itself.<n>Our method achieves state-of-the-art detection performance with negligible computational overhead.
  arXiv  Detail & Related papers  (2025-05-19T00:48:53Z)
• A Knowledge-guided Adversarial Defense for Resisting Malicious Visual Manipulation [93.28532038721816]
  Malicious applications of visual manipulation have raised serious threats to the security and reputation of users in many fields.<n>We propose a knowledge-guided adversarial defense (KGAD) to actively force malicious manipulation models to output semantically confusing samples.
  arXiv  Detail & Related papers  (2025-04-11T10:18:13Z)
• CopyJudge: Automated Copyright Infringement Identification and Mitigation in Text-to-Image Diffusion Models [58.58208005178676]
  We propose CopyJudge, a novel automated infringement identification framework.<n>We employ an abstraction-filtration-comparison test framework to assess the likelihood of infringement.<n>We introduce a general LVLM-based mitigation strategy that automatically optimize infringing prompts.
  arXiv  Detail & Related papers  (2025-02-21T08:09:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.