UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration
- URL: http://arxiv.org/abs/2603.07406v1
- Date: Sun, 08 Mar 2026 01:35:54 GMT
- Title: UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration
- Abstract summary: Universal image restoration aims to recover clean images from arbitrary real-world degradations.<n>Existing all-in-one restoration networks do not scale to multiple degradations.<n>We introduce a unified inference pipeline with a mixture-of-experts architecture that decomposes restoration knowledge across specialized task-adaptable experts.
- Score: 20.447922377156143
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Universal image restoration aims to recover clean images from arbitrary real-world degradations using a single inference model. Despite significant progress, existing all-in-one restoration networks do not scale to multiple degradations. As the number of degradations increases, training becomes unstable, models grow excessively large, and performance drops across both seen and unseen domains. In this work, we show that scaling universal restoration is fundamentally limited by interference across degradations during joint learning, leading to catastrophic task forgetting. To address this challenge, we introduce a unified inference pipeline with a multi-branch mixture-of-experts architecture that decomposes restoration knowledge across specialized task-adaptable experts. Our approach enables scalable learning (over sixteen degradations), adapts and generalizes robustly to unseen domains, and supports user-controllable restoration across degradations. Beyond achieving superior performance across benchmarks, this work establishes a new design paradigm for scalable and controllable universal image restoration.
Related papers
- Universal Image Restoration via Internalized Chain-of-Thought Reasoning [52.763760468548504]
Image restoration seeks to recover high-quality images from degraded inputs but becomes highly ill-posed under complex, mixed degradations.<n>Recent works adopt Chain-of-Thought (CoT) reasoning for multi-round restoration using specialized modules.<n>We introduce CoTIR, a universal image restoration framework that internalizes CoT reasoning within a single model.
arXiv Detail & Related papers (2026-06-16T06:01:36Z) - Divide and Restore: A Modular Task-Decoupled Framework for Universal Image Restoration [0.0]
Restoring images affected by various types of degradation remains a significant challenge in computer vision.<n>We propose a modular, task-decoupled image restoration framework based on an explicit diagnostic routing mechanism.
arXiv Detail & Related papers (2026-03-30T16:45:16Z) - Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration [84.3817904120563]
Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
arXiv Detail & Related papers (2026-03-27T13:13:44Z) - RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models [55.40883650570416]
We construct a large-scale dataset covering nine common real-world degradation types.<n>We train a state-of-the-art open-source model to narrow the gap with closed-source alternatives.<n>Our model ranks first among open-source methods, achieving state-of-the-art performance.
arXiv Detail & Related papers (2026-03-26T14:39:39Z) - UniRes: Universal Image Restoration for Complex Degradations [53.74404005987783]
Real-world image restoration is hampered by diverse degradations stemming from varying capture conditions, capture devices and post-processing pipelines.<n>A simple yet flexible diffusionbased framework, named UniRes, is proposed to address such degradations in an end-to-end manner.<n>Our proposed method is evaluated on both complex-degradation and single-degradation image restoration datasets.
arXiv Detail & Related papers (2025-06-05T21:25:39Z) - UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity [79.90839080916913]
We present our UniRestorer with improved restoration performance.<n>Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model.<n>In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration.
arXiv Detail & Related papers (2024-12-28T14:09:08Z) - Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers [53.298698981438]
This paper proposes a new task setting, i.e. Universal Image Restoration (UIR)<n>UIR doesn't require training on all the degradation combinations but only on a set of degradation bases and then removing any degradation that these bases can potentially compose in a zero-shot manner.<n>We propose Chain-of-Restoration (CoR) mechanism, which instructs models to remove unknown composite degradations step-by-step.
arXiv Detail & Related papers (2024-10-11T10:21:42Z) - Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration [19.87693298262894]
We propose Diff-Restorer, a universal image restoration method based on the diffusion model.
We utilize the pre-trained visual language model to extract visual prompts from degraded images.
We also design a Degradation-aware Decoder to perform structural correction and convert the latent code to the pixel domain.
arXiv Detail & Related papers (2024-07-04T05:01:10Z) - Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance [12.066756224383827]
textbfRestorer is a novel Transformer-based all-in-one image restoration model.
It can handle composite degradation in real-world scenarios without requiring additional training.
It is efficient during inference, suggesting the potential in real-world applications.
arXiv Detail & Related papers (2024-06-18T13:18:32Z) - All-in-one Multi-degradation Image Restoration Network via Hierarchical
Degradation Representation [47.00239809958627]
We propose a novel All-in-one Multi-degradation Image Restoration Network (AMIRNet)
AMIRNet learns a degradation representation for unknown degraded images by progressively constructing a tree structure through clustering.
This tree-structured representation explicitly reflects the consistency and discrepancy of various distortions, providing a specific clue for image restoration.
arXiv Detail & Related papers (2023-08-06T04:51:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.