Conditional Meta-Network for Blind Super-Resolution with Multiple
Degradations
- URL: http://arxiv.org/abs/2104.03926v2
- Date: Fri, 9 Apr 2021 13:16:57 GMT
- Title: Conditional Meta-Network for Blind Super-Resolution with Multiple
Degradations
- Abstract summary: Single-image super-resolution (SISR) methods suffer performance drop with multiple degrading effects in real scenarios.
We propose a conditional meta-network framework (named CMDSR) for the first time, which helps SR framework learn how to adapt to changes in input distribution.
- Score: 23.026779510800047
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Although single-image super-resolution (SISR) methods have achieved great
success on single degradation, they still suffer performance drop with multiple
degrading effects in real scenarios. Recently, some blind and non-blind models
for multiple degradations have been explored. However, those methods usually
degrade significantly for distribution shifts between the training and test
data. Towards this end, we propose a conditional meta-network framework (named
CMDSR) for the first time, which helps SR framework learn how to adapt to
changes in input distribution. We extract degradation prior at task-level with
the proposed ConditionNet, which will be used to adapt the parameters of the
basic SR network (BaseNet). Specifically, the ConditionNet of our framework
first learns the degradation prior from a support set, which is composed of a
series of degraded image patches from the same task. Then the adaptive BaseNet
rapidly shifts its parameters according to the conditional features. Moreover,
in order to better extract degradation prior, we propose a task contrastive
loss to decrease the inner-task distance and increase the cross-task distance
between task-level features. Without predefining degradation maps, our blind
framework can conduct one single parameter update to yield considerable SR
results. Extensive experiments demonstrate the effectiveness of CMDSR over
various blind, even non-blind methods. The flexible BaseNet structure also
reveals that CMDSR can be a general framework for large series of SISR models.
Related papers
- LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection [50.3892176822492]
Infrared small target detection (IRSTD) aims to identify long distance small targets from complex infrared backgrounds.<n>Deep learning methods have improved IRSTD by learning discriminative image-to-mask mappings.<n>Deep unfolding methods partially address this issue by embedding model-driven iterations into neural networks.<n>We propose Latent Consistent Proximal unfolding network (LCPNet) to address these limitations.
arXiv Detail & Related papers (2026-07-06T02:15:09Z) - Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding [9.386011004825281]
Localizing document tampering is extremely challenging, as manipulations are crafted to appear visually consistent.<n>We propose textbfDiffNet, a relatively simple yet effective RGB--DCT early-fusion architecture driven by two key design choices.<n>Our approach achieves state-of-the-art performance on cross-domain and human-made document tampering localization, outperforming prior methods by around 30%.
arXiv Detail & Related papers (2026-06-21T00:29:59Z) - Task-Guided Prompting for Unified Remote Sensing Image Restoration [19.11145604183771]
TGPNet is a unified framework capable of handling denoising, cloud removal, shadow removal, deblurring, and SAR despeckling.<n>The core of our framework is a novel Task-Guided Prompting (TGP) strategy.<n>This work presents a significant advancement for multi-task RSIR, offering a practical and scalable solution for operational pipelines.
arXiv Detail & Related papers (2026-04-03T05:29:12Z) - Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration [52.82397287366076]
All-in-one image restoration aims to handle diverse degradations (e.g., noise, blur, adverse weather) within a unified framework.<n>In this work, we reveal a critical insight: well-crafted feature extraction inherently encodes degradation-carrying information.<n>Our symmetric design preserves intrinsic degradation signals robustly, rendering simple additive fusion in skip connections.
arXiv Detail & Related papers (2025-12-11T12:20:31Z) - A Lightweight Deep Exclusion Unfolding Network for Single Image Reflection Removal [68.0573194557999]
Single Image Reflection Removal (SIRR) is a canonical blind source separation problem.
We propose a novel Deep Exclusion unfolding Network (DExNet) for SIRR.
DExNet is constructed by unfolding and parameterizing a simple iterative Sparse and Auxiliary Feature Update (i-SAFU) algorithm.
arXiv Detail & Related papers (2025-03-03T07:54:27Z) - DORNet: A Degradation Oriented and Regularized Network for Blind Depth Super-Resolution [48.744290794713905]
In real-world scenarios, captured depth data often suffer from unconventional and unknown degradation due to sensor limitations and complex imaging environments.
We propose the Degradation Oriented and Regularized Network (DORNet), a novel framework designed to adaptively address unknown degradation in real-world scenes.
Our approach begins with the development of a self-supervised degradation learning strategy, which models the degradation representations of low-resolution depth data.
To facilitate effective RGB-D fusion, we further introduce a degradation-oriented feature transformation module that selectively propagates RGB content into the depth data based on the learned degradation priors.
arXiv Detail & Related papers (2024-10-15T14:53:07Z) - DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image
Enhancement [77.0360085530701]
Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments.
Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features.
Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
arXiv Detail & Related papers (2023-12-12T06:07:21Z) - Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution [91.3781512926942]
Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures.
This work investigates the potential of network pruning for super-resolution iteration to take advantage of off-the-shelf network designs and reduce the underlying computational overhead.
We propose a novel Iterative Soft Shrinkage-Percentage (ISS-P) method by optimizing the sparse structure of a randomly network at each and tweaking unimportant weights with a small amount proportional to the magnitude scale on-the-fly.
arXiv Detail & Related papers (2023-03-16T21:06:13Z) - Efficient and Degradation-Adaptive Network for Real-World Image
Super-Resolution [28.00231586840797]
Real-world image super-resolution (Real-ISR) is a challenging task due to the unknown complex degradation of real-world images.
Recent research on Real-ISR has achieved significant progress by modeling the image degradation space.
We propose an efficient degradation-adaptive super-resolution (DASR) network, whose parameters are adaptively specified by estimating the degradation of each input image.
arXiv Detail & Related papers (2022-03-27T05:59:13Z) - Image Superresolution using Scale-Recurrent Dense Network [30.75380029218373]
Recent advances in the design of convolutional neural network (CNN) have yielded significant improvements in the performance of image super-resolution (SR)
We propose a scale recurrent SR architecture built upon units containing series of dense connections within a residual block (Residual Dense Blocks (RDBs))
Our scale recurrent design delivers competitive performance for higher scale factors while being parametrically more efficient as compared to current state-of-the-art approaches.
arXiv Detail & Related papers (2022-01-28T09:18:43Z) - Learning Deep Context-Sensitive Decomposition for Low-Light Image
Enhancement [58.72667941107544]
A typical framework is to simultaneously estimate the illumination and reflectance, but they disregard the scene-level contextual information encapsulated in feature spaces.
We develop a new context-sensitive decomposition network architecture to exploit the scene-level contextual dependencies on spatial scales.
We develop a lightweight CSDNet (named LiteCSDNet) by reducing the number of channels.
arXiv Detail & Related papers (2021-12-09T06:25:30Z) - Style Normalization and Restitution for DomainGeneralization and
Adaptation [88.86865069583149]
An effective domain generalizable model is expected to learn feature representations that are both generalizable and discriminative.
In this paper, we design a novel Style Normalization and Restitution module (SNR) to ensure both high generalization and discrimination capability of the networks.
arXiv Detail & Related papers (2021-01-03T09:01:39Z) - OverNet: Lightweight Multi-Scale Super-Resolution with Overscaling
Network [3.6683231417848283]
We introduce OverNet, a deep but lightweight convolutional network to solve SISR at arbitrary scale factors with a single model.
We show that our network outperforms previous state-of-the-art results in standard benchmarks while using fewer parameters than previous approaches.
arXiv Detail & Related papers (2020-08-05T22:10:29Z) - Iterative Network for Image Super-Resolution [69.07361550998318]
Single image super-resolution (SISR) has been greatly revitalized by the recent development of convolutional neural networks (CNN)
This paper provides a new insight on conventional SISR algorithm, and proposes a substantially different approach relying on the iterative optimization.
A novel iterative super-resolution network (ISRN) is proposed on top of the iterative optimization.
arXiv Detail & Related papers (2020-05-20T11:11:47Z) - Deep Adaptive Inference Networks for Single Image Super-Resolution [72.7304455761067]
Single image super-resolution (SISR) has witnessed tremendous progress in recent years owing to the deployment of deep convolutional neural networks (CNNs)
In this paper, we take a step forward to address this issue by leveraging the adaptive inference networks for deep SISR (AdaDSR)
Our AdaDSR involves an SISR model as backbone and a lightweight adapter module which takes image features and resource constraint as input and predicts a map of local network depth.
arXiv Detail & Related papers (2020-04-08T10:08:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.