Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration

• URL: http://arxiv.org/abs/2603.26385v1
• Date: Fri, 27 Mar 2026 13:13:44 GMT
• Title: Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration
• Abstract summary: Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
• Score: 84.3817904120563
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light. While recent studies have shown remarkable progress across individual or unified restoration tasks, they still suffer from limited generalization and inefficiency when handling unknown or composite degradations. To address these limitations, we propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework to iteratively and efficiently achieve high quality image restoration. Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification. The resulting model is fully trainable end to end and allows for an all-in-one assess and restore approach that dynamically adapts the restoration process. Also, the tight integration of IQA and IR into a unified model minimizes the latency and information loss that typically arises from keeping the two modules disjoint, (e.g. during image and/or text decoding). Extensive experiments show that our approach consistent improvements under single, unknown and composite degradations, thereby establishing a new state-of-the-art.

Related papers

• Restore What Matters: Lessons from Joint Restoration and Recognition [72.91692240810536]
  Recognition pipelines typically adopt a restore-then-recognize workflow, yet decades of experience show that generating visually pleasing images seldom to improved recognition.<n>We propose a Joint Restoration-for-Recognition paradigm: restore only what downstream tasks truly require, with task signals dictating where, how much, and whether restoration is necessary.<n>We conclude that better-looking images are neither necessary nor sufficient; restoration modules must be task-driven, selective, and physically aware.
  arXiv  Detail & Related papers  (2026-09-12T08:08:08Z)
• Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance [6.886139429160757]
  MGN-AIR is a novel pixel-level restoration framework for all-in-one image restoration.<n>Our approach first learns to estimate a pixel-level visual prompt.<n>Then, it leverages both textual and visual prompts to provide global and local degradation cues.
  arXiv  Detail & Related papers  (2026-08-10T11:48:22Z)
• Universal Image Restoration via Internalized Chain-of-Thought Reasoning [52.763760468548504]
  Image restoration seeks to recover high-quality images from degraded inputs but becomes highly ill-posed under complex, mixed degradations.<n>Recent works adopt Chain-of-Thought (CoT) reasoning for multi-round restoration using specialized modules.<n>We introduce CoTIR, a universal image restoration framework that internalizes CoT reasoning within a single model.
  arXiv  Detail & Related papers  (2026-06-16T06:01:36Z)
• UniRes: Universal Image Restoration for Complex Degradations [53.74404005987783]
  Real-world image restoration is hampered by diverse degradations stemming from varying capture conditions, capture devices and post-processing pipelines.<n>A simple yet flexible diffusionbased framework, named UniRes, is proposed to address such degradations in an end-to-end manner.<n>Our proposed method is evaluated on both complex-degradation and single-degradation image restoration datasets.
  arXiv  Detail & Related papers  (2025-06-05T21:25:39Z)
• UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity [79.90839080916913]
  We present our UniRestorer with improved restoration performance.<n>Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model.<n>In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration.
  arXiv  Detail & Related papers  (2024-12-28T14:09:08Z)
• Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers [53.298698981438]
  This paper proposes a new task setting, i.e. Universal Image Restoration (UIR)<n>UIR doesn't require training on all the degradation combinations but only on a set of degradation bases and then removing any degradation that these bases can potentially compose in a zero-shot manner.<n>We propose Chain-of-Restoration (CoR) mechanism, which instructs models to remove unknown composite degradations step-by-step.
  arXiv  Detail & Related papers  (2024-10-11T10:21:42Z)
• UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation [50.27688690379488]
  Existing unified methods treat multi-degradation image restoration as a multi-task learning problem. We propose a universal image restoration framework based on multiple low-rank adapters (LoRA) from multi-domain transfer learning. Our framework leverages the pre-trained generative model as the shared component for multi-degradation restoration and transfers it to specific degradation image restoration tasks.
  arXiv  Detail & Related papers  (2024-09-30T11:16:56Z)
• Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restoration [33.163161549726446]
  Perceive-IR is a novel backbone-agnostic All-in-One image restoration framework for fine-grained quality control.<n>Its modular structure allows core components to function independently of specific backbones, enabling seamless integration into advanced restoration models.
  arXiv  Detail & Related papers  (2024-08-28T17:58:54Z)
• OneRestore: A Universal Restoration Framework for Composite Degradation [33.556183375565034]
  In real-world scenarios, image impairments often manifest as composite degradations, presenting a complex interplay of elements such as low light, haze, rain, and snow. Our study proposes a versatile imaging model that consolidates four physical corruption paradigms to accurately represent complex, composite degradation scenarios. OneRestore is a novel transformer-based framework designed for adaptive, controllable scene restoration.
  arXiv  Detail & Related papers  (2024-07-05T16:27:00Z)
• Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration [19.87693298262894]
  We propose Diff-Restorer, a universal image restoration method based on the diffusion model. We utilize the pre-trained visual language model to extract visual prompts from degraded images. We also design a Degradation-aware Decoder to perform structural correction and convert the latent code to the pixel domain.
  arXiv  Detail & Related papers  (2024-07-04T05:01:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.