Restoring Without Forgetting: Continual Learning Across Image Degradations

• URL: http://arxiv.org/abs/2608.23799v1
• Date: Mon, 24 Aug 2026 20:04:18 GMT
• Title: Restoring Without Forgetting: Continual Learning Across Image Degradations
• Abstract summary: Recent progress in image restoration has converged on all-in-one architectures that jointly handle multiple degradations within a single network.<n>In practice, degradations are encountered sequentially as field-deployed systems progressively face new environmental conditions.<n>We formulate multi-degradation image restoration as a continual domain-incremental learning problem.
• Score: 6.288045889067255
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent progress in image restoration has converged on all-in-one architectures that jointly handle multiple degradations within a single network. These methods are effective on static benchmarks but target a closed-world setting that assumes simultaneous access to every target degradation at training time. In practice, degradations are encountered sequentially as field-deployed systems progressively face new environmental conditions, and historical training data is often unavailable due to privacy or storage constraints. Accommodating a new degradation then requires either retraining on the union of all prior data, which is often costly or infeasible, or fine-tuning, which causes catastrophic forgetting. We formulate multi-degradation image restoration as a continual domain-incremental learning problem, in which degradations arrive incrementally and prior data is unavailable. Our proposed Restoring without Forgetting (RwF) framework learns a lightweight adapter for each new degradation, eliminating forgetting by construction at a fraction of the cost of dedicated per-domain networks. To isolate degradation learning from dataset variation, we construct a benchmark spanning five degradation domains under shared image content. At test time, an unsupervised routing mechanism identifies the appropriate restoration path for unknown inputs without requiring domain labels. Across the five-domain sequence, RwF improves final average PSNR over naive sequential fine-tuning by 15.25 dB and 11.83 dB on the Restormer and NAFNet backbones, respectively. The framework transfers to eleven canonical real-degradation benchmarks (3,465 images) at 89.5% routing accuracy with only a +0.94 dB oracle PSNR gap, establishing, to our knowledge, the first systematic baseline for continual multi-degradation image restoration.

Related papers

• GraLoD: Graphics-Inspired Continuous Level-of-Detail Learning for Image Restoration [54.85451496831771]
  We propose GraLoD, a plug-and-play framework that treats restoration scale as a spatially varying and stage-dependent variable.<n>GraLoD reuses the native encoder hierarchy, aligns its multi-scale features into a shared LOD representation space, and predicts a stage-conditioned LOD field at each decoder stage.<n>Experiments demonstrate consistent improvements in task-specific and all-in-one restoration.
  arXiv  Detail & Related papers  (2026-09-15T03:22:22Z)
• Bend the Basics: Degradation-Aware Deformable Tokenization for All-in-One Image Restoration [72.64498743287601]
  All-in-one image restoration seeks a single model that can recover images degraded by diverse and spatially non-uniform corruptions.<n>We present Flexible Image Transformer (FIT) that explicitly models degradation awareness across the entire pipeline.<n>FIT achieves state-of-the-art performance with 30.72 dB average PSNR on the five-degradation setting and 32.83 dB on the three-degradation setting, outperforming recent unified restoration methods by +0.5$sim$1.1 dB.
  arXiv  Detail & Related papers  (2026-08-07T05:44:31Z)
• MG-SpaIR: Multi-grade Sparse-guided Implicit Representation for Training-Data-Free Image Restoration [15.897294007874898]
  MG-SpaIR is a training-data-free framework for restoring a clean image from a single observation.<n>We introduce a multi-grade coarse-to-fine residual hierarchy that progressively refines the reconstruction across resolution grades.<n> Experiments on mixed-degradation benchmarks demonstrate that MG-SpaIR consistently outperforms strong training-data-free baselines.
  arXiv  Detail & Related papers  (2026-06-30T20:17:37Z)
• Task-Guided Prompting for Unified Remote Sensing Image Restoration [19.11145604183771]
  TGPNet is a unified framework capable of handling denoising, cloud removal, shadow removal, deblurring, and SAR despeckling.<n>The core of our framework is a novel Task-Guided Prompting (TGP) strategy.<n>This work presents a significant advancement for multi-task RSIR, offering a practical and scalable solution for operational pipelines.
  arXiv  Detail & Related papers  (2026-04-03T05:29:12Z)
• Divide and Restore: A Modular Task-Decoupled Framework for Universal Image Restoration [0.0]
  Restoring images affected by various types of degradation remains a significant challenge in computer vision.<n>We propose a modular, task-decoupled image restoration framework based on an explicit diagnostic routing mechanism.
  arXiv  Detail & Related papers  (2026-03-30T16:45:16Z)
• Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration [84.3817904120563]
  Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
  arXiv  Detail & Related papers  (2026-03-27T13:13:44Z)
• Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration [52.82397287366076]
  All-in-one image restoration aims to handle diverse degradations (e.g., noise, blur, adverse weather) within a unified framework.<n>In this work, we reveal a critical insight: well-crafted feature extraction inherently encodes degradation-carrying information.<n>Our symmetric design preserves intrinsic degradation signals robustly, rendering simple additive fusion in skip connections.
  arXiv  Detail & Related papers  (2025-12-11T12:20:31Z)
• Learning to Restore Multi-Degraded Images via Ingredient Decoupling and Task-Aware Path Adaptation [51.10017611491389]
  Real-world images often suffer from multiple coexisting degradations, such as rain, noise, and haze coexisting in a single image.<n>We propose an adaptive multi-degradation image restoration network that reconstructs images by leveraging decoupled representations of degradation ingredients.<n>The resulting tightly integrated architecture, termed IMDNet, is extensively validated through experiments.
  arXiv  Detail & Related papers  (2025-11-07T01:50:36Z)
• Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
  We present a learning-based solution for restoring images suffering from spatially-varying degradations. We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
  arXiv  Detail & Related papers  (2021-08-19T11:02:25Z)
• Multi-Stage Progressive Image Restoration [167.6852235432918]
  We propose a novel synergistic design that can optimally balance these competing goals. Our main proposal is a multi-stage architecture, that progressively learns restoration functions for the degraded inputs. The resulting tightly interlinked multi-stage architecture, named as MPRNet, delivers strong performance gains on ten datasets.
  arXiv  Detail & Related papers  (2021-02-04T18:57:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.