RIRF: Reasoning Image Restoration Framework

• URL: http://arxiv.org/abs/2604.09511v1
• Date: Fri, 10 Apr 2026 17:29:31 GMT
• Title: RIRF: Reasoning Image Restoration Framework
• Abstract summary: We propose Reason and Restore (R&R), a novel framework that integrates structured Chain-of-Thought (CoT) reasoning into the image restoration pipeline.<n>R&R introduces an explicit reasoner, implemented by fine-tuning Qwen3-VL, to diagnose degradation types, quantify degradation severity, infer key degradation-related factors, and describe relevant scene and object semantics.<n>The resulting structured reasoning provides interpretable and fine-grained diagnostic priors for the restorer.
• Score: 18.387213732491393
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Universal image restoration (UIR) aims to recover clean images from diverse and unknown degradations using a unified model. Existing UIR methods primarily focus on pixel reconstruction and often lack explicit diagnostic reasoning over degradation composition, severity, and scene semantics prior to restoration. We propose Reason and Restore (R\&R), a novel framework that integrates structured Chain-of-Thought (CoT) reasoning into the image restoration pipeline. R\&R introduces an explicit reasoner, implemented by fine-tuning Qwen3-VL, to diagnose degradation types, quantify degradation severity, infer key degradation-related factors, and describe relevant scene and object semantics. The resulting structured reasoning provides interpretable and fine-grained diagnostic priors for the restorer. To further improve restoration quality, the quantified degradation severity produced by the reasoner is leveraged as reinforcement learning (RL) signals to guide and strengthen the restorer. Unlike existing multimodal LLM-based agentic systems that decouple reasoning from low-level vision tasks, R\&R tightly couples semantic diagnostic reasoning with pixel-level restoration in a unified framework. Extensive experiments across diverse UIR benchmarks demonstrate that R\&R achieves state-of-the-art performance while offering unique interpretability into the restoration process.

Related papers

• Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents [54.85451496831771]
  Causal-AgentIR is a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence.<n>It organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph.<n>This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions.
  arXiv  Detail & Related papers  (2026-07-23T09:59:44Z)
• MG-SpaIR: Multi-grade Sparse-guided Implicit Representation for Training-Data-Free Image Restoration [15.897294007874898]
  MG-SpaIR is a training-data-free framework for restoring a clean image from a single observation.<n>We introduce a multi-grade coarse-to-fine residual hierarchy that progressively refines the reconstruction across resolution grades.<n> Experiments on mixed-degradation benchmarks demonstrate that MG-SpaIR consistently outperforms strong training-data-free baselines.
  arXiv  Detail & Related papers  (2026-06-30T20:17:37Z)
• DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration [31.441586261696617]
  This paper proposes DVANet, a collaborative unfolding process between degradation-aware observation consistency and visual-prior-guided reconstruction.<n>Experiments demonstrate that DVANet achieves superior or competitive performance on multi-scenario degradation and cross-domain image restoration tasks.
  arXiv  Detail & Related papers  (2026-06-17T14:09:39Z)
• Universal Image Restoration via Internalized Chain-of-Thought Reasoning [52.763760468548504]
  Image restoration seeks to recover high-quality images from degraded inputs but becomes highly ill-posed under complex, mixed degradations.<n>Recent works adopt Chain-of-Thought (CoT) reasoning for multi-round restoration using specialized modules.<n>We introduce CoTIR, a universal image restoration framework that internalizes CoT reasoning within a single model.
  arXiv  Detail & Related papers  (2026-06-16T06:01:36Z)
• Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration [84.3817904120563]
  Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
  arXiv  Detail & Related papers  (2026-03-27T13:13:44Z)
• ClusIR: Towards Cluster-Guided All-in-One Image Restoration [72.16989784735796]
  ClusIR aims to recover high-quality images from diverse degradations within a unified framework.<n>ClusIR comprises two key components: a Probabilistic Cluster-Guided Routing Mechanism (PCGRM) and a Degradation-Aware Frequency Modulation Module (DAFMM)
  arXiv  Detail & Related papers  (2025-12-11T18:59:47Z)
• UniRes: Universal Image Restoration for Complex Degradations [53.74404005987783]
  Real-world image restoration is hampered by diverse degradations stemming from varying capture conditions, capture devices and post-processing pipelines.<n>A simple yet flexible diffusionbased framework, named UniRes, is proposed to address such degradations in an end-to-end manner.<n>Our proposed method is evaluated on both complex-degradation and single-degradation image restoration datasets.
  arXiv  Detail & Related papers  (2025-06-05T21:25:39Z)
• A Progressive Image Restoration Network for High-order Degradation Imaging in Remote Sensing [5.6223397629993626]
  HDI-PRNet is a progressive restoration network for high-order degradation imaging.<n>Our method achieves superior performance on both synthetic and real remote sensing images.
  arXiv  Detail & Related papers  (2024-12-10T05:08:39Z)
• Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers [53.298698981438]
  This paper proposes a new task setting, i.e. Universal Image Restoration (UIR)<n>UIR doesn't require training on all the degradation combinations but only on a set of degradation bases and then removing any degradation that these bases can potentially compose in a zero-shot manner.<n>We propose Chain-of-Restoration (CoR) mechanism, which instructs models to remove unknown composite degradations step-by-step.
  arXiv  Detail & Related papers  (2024-10-11T10:21:42Z)
• SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration [20.873676111265656]
  SSP-IR aims to fully exploit semantic and structure priors from low-quality images.<n>Our method outperforms other state-of-the-art methods overall on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2024-07-04T04:55:14Z)
• Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model [59.08821399652483]
  Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion model (DM)-based methods have shown promising performance but are often burdened by heavy computational demands and pixel misalignment issues when predicting the image-level distribution. We propose to leverage DM within a compact latent space to generate concise guidance priors and introduce a novel solution called Reti-Diff for the IDIR task. Reti-Diff comprises two key components: the Retinex-based latent DM (RLDM) and the Retinex-guided transformer (RG
  arXiv  Detail & Related papers  (2023-11-20T09:55:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.