ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning

• URL: http://arxiv.org/abs/2605.07477v1
• Date: Fri, 08 May 2026 09:23:26 GMT
• Title: ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning
• Abstract summary: We present ReasonEdit, an evaluation tool for text-guided image editing.<n>It is trained using reward signals derived from RE-Reward and the Group Relative Policy Optimization (GRPO) algorithm.<n>It is capable of generating high-quality interpretable evaluation text, enabling more transparent and trustworthy assessment for image editing.
• Score: 86.61218827780675
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation methods have been proposed, most existing approaches rely on scalar scores and lack interpretability. This limitation largely stems from the absence of high-quality interpretation datasets for TIE and effective reward models to train interpretable evaluators. To address these challenges, we introduce ReasonEdit-22K, the first dataset that combines 22K edited images with 113K Chain-of-Thought (CoT) samples, along with 1.3M human judgments assessing these interpretations in terms of logicality, accuracy, and usefulness. Building upon this dataset, we propose RE-Reward, a multimodal large language model (MLLM)-based reward model designed to provide human-aligned feedback for evaluating interpretable reasoning in image editing. Furthermore, we develop ReasonEdit, which is trained using reward signals derived from RE-Reward and the Group Relative Policy Optimization (GRPO) algorithm to learn an interpretable evaluation model. Extensive experiments demonstrate that ReasonEdit achieves superior alignment with human preferences and exhibits strong generalization across public benchmarks. In addition, it is capable of generating high-quality interpretable evaluation text, enabling more transparent and trustworthy assessment for image editing. The code is available at https://github.com/IntMeGroup/ReasonEdit.

Related papers

• Leveraging Verifier-Based Reinforcement Learning in Image Editing [41.64251379221566]
  We introduce Edit-R1, a framework that builds a chain-of-thought (CoT) verifier-based reasoning reward model (RRM) for downstream image editing.<n>Our experiments demonstrate that our Edit-RRM surpasses powerful VLMs as an editing-specific reward model.
  arXiv  Detail & Related papers  (2026-04-30T06:54:39Z)
• Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach [48.01137214342501]
  We introduce TIEdit, a benchmark for systematic evaluation of text-guided image editing methods.<n>To obtain reliable subjective ratings, 20 experts are recruited to produce 307,200 raw subjective ratings.<n>We further propose EditProbe, an LLM-based evaluator that estimates editing quality via intermediate-layer probing of hidden representations.
  arXiv  Detail & Related papers  (2026-03-20T09:05:10Z)
• EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing [80.4661213011098]
  We present textbfEditHF-1M, a million-scale image editing dataset with over 29M human preference pairs and 148K human mean opinion ratings.<n>We also introduce textbfEditHF-Reward, which utilizes EditHF as the reward signal to optimize the text-guided image editing models.
  arXiv  Detail & Related papers  (2026-03-16T07:24:56Z)
• Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis [95.89328387635176]
  We introduce a fine-grained Multimodal Large Language Model (MLLM)-as-a-Judge framework for image editing.<n>We present a new human-validated benchmark that integrates human judgments, MLLM-based evaluations, model outputs, and traditional metrics.
  arXiv  Detail & Related papers  (2026-02-13T15:34:32Z)
• ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing [33.888289858260706]
  Reinforcement learning (RL) has been investigated for improving the quality of image editing.<n>RL faces three key challenges: (1) limited reasoning exploration confined to denoising, (2) biased reward fusion, and (3) unstable VLM-based instruction rewards.<n>We propose ThinkRL-Edit, a reasoning-centric RL framework that decouples visual reasoning from image synthesis.
  arXiv  Detail & Related papers  (2026-01-06T23:43:00Z)
• Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing [84.16442052968615]
  We introduce RISEBench, the first benchmark for evaluating Reasoning-Informed viSual Editing (RISE)<n>RISEBench focuses on four key reasoning categories: Temporal, Causal, Spatial, and Logical Reasoning.<n>We conduct experiments evaluating nine prominent visual editing models, comprising both open-source and proprietary models.
  arXiv  Detail & Related papers  (2025-04-03T17:59:56Z)
• Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models [85.96013373385057]
  Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy objectives, can compromise the performance of fine-tuned models. We propose TextNorm, a method that enhances alignment based on a measure of reward model confidence estimated across a set of semantically contrastive text prompts.
  arXiv  Detail & Related papers  (2024-04-02T11:40:38Z)
• HIVE: Harnessing Human Feedback for Instructional Visual Editing [127.29436858998064]
  We present a novel framework to harness human feedback for instructional visual editing (HIVE) Specifically, we collect human feedback on the edited images and learn a reward function to capture the underlying user preferences. We then introduce scalable diffusion model fine-tuning methods that can incorporate human preferences based on the estimated reward.
  arXiv  Detail & Related papers  (2023-03-16T19:47:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.