A Closer Look at Blind Super-Resolution: Degradation Models, Baselines,
and Performance Upper Bounds
- URL: http://arxiv.org/abs/2205.04910v1
- Date: Tue, 10 May 2022 14:02:49 GMT
- Title: A Closer Look at Blind Super-Resolution: Degradation Models, Baselines,
and Performance Upper Bounds
- Authors: Wenlong Zhang, Guangyuan Shi, Yihao Liu, Chao Dong, Xiao-Ming Wu
- Abstract summary: We propose a unified gated degradation model to generate a broad set of degradation cases using a random gate controller.
Based on the degradation model, we propose simple baseline networks that can effectively handle non-blind, classical, practical degradation cases.
Our empirical analysis shows that with the unified gated degradation model, the proposed baselines can achieve much better performance than existing methods.
- Score: 27.945034226654656
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Degradation models play an important role in Blind super-resolution (SR). The
classical degradation model, which mainly involves blur degradation, is too
simple to simulate real-world scenarios. The recently proposed practical
degradation model includes a full spectrum of degradation types, but only
considers complex cases that use all degradation types in the degradation
process, while ignoring many important corner cases that are common in the real
world. To address this problem, we propose a unified gated degradation model to
generate a broad set of degradation cases using a random gate controller. Based
on the gated degradation model, we propose simple baseline networks that can
effectively handle non-blind, classical, practical degradation cases as well as
many other corner cases. To fairly evaluate the performance of our baseline
networks against state-of-the-art methods and understand their limits, we
introduce the performance upper bound of an SR network for every degradation
type. Our empirical analysis shows that with the unified gated degradation
model, the proposed baselines can achieve much better performance than existing
methods in quantitative and qualitative results, which are close to the
performance upper bounds.
Related papers
- Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding [54.05243949024302]
Existing robust MLLMs rely on implicit training/adaptation that focuses solely on visual encoder generalization.<n>We propose Robust-R1, a novel framework that explicitly models visual degradations through structured reasoning chains.<n>Our approach integrates: (i) supervised fine-tuning for degradation-aware reasoning foundations, (ii) reward-driven alignment for accurately perceiving degradation parameters, and (iii) dynamic reasoning depth scaling adapted to degradation intensity.
arXiv Detail & Related papers (2025-12-19T12:56:17Z) - Not All Degradations Are Equal: A Targeted Feature Denoising Framework for Generalizable Image Super-Resolution [40.723558636912784]
Generalizable Image Super-Resolution aims to enhance model generalization capabilities under unknown degradations.<n>We propose a targeted feature denoising framework, comprising noise detection and denoising modules.<n>Our framework demonstrates superior performance compared to previous regularization-based methods.
arXiv Detail & Related papers (2025-09-18T11:04:51Z) - Unlocking the Potential of Diffusion Priors in Blind Face Restoration [63.419272650578165]
In this work, we use a unified network FLIPNET that switches between two modes to resolve specific gaps.<n>In Restoration mode, the model gradually integrates BFR-oriented features and face embeddings from LQ images to achieve authentic and faithful face restoration.<n>In Degradation mode, the model synthesizes real-world like degraded images based on the knowledge learned from real-world degradation datasets.
arXiv Detail & Related papers (2025-08-12T01:50:55Z) - CausalSR: Structural Causal Model-Driven Super-Resolution with Counterfactual Inference [2.147995542780459]
This paper formulates super-resolution using structural causal models to reason about image degradation processes.
We propose a novel counterfactual learning strategy that leverages semantic guidance to reason about hypothetical degradation scenarios.
Our approach achieves significant improvements over state-of-the-art methods, particularly in challenging scenarios with compound degradations.
arXiv Detail & Related papers (2025-01-27T08:19:17Z) - Mixed Degradation Image Restoration via Local Dynamic Optimization and Conditional Embedding [67.57487747508179]
Multiple-in-one image restoration (IR) has made significant progress, aiming to handle all types of single degraded image restoration with a single model.
In this paper, we propose a novel multiple-in-one IR model that can effectively restore images with both single and mixed degradations.
arXiv Detail & Related papers (2024-11-25T09:26:34Z) - Degradation Oriented and Regularized Network for Blind Depth Super-Resolution [48.744290794713905]
In real-world scenarios, captured depth data often suffer from unconventional and unknown degradation due to sensor limitations and complex imaging environments.
We propose the Degradation Oriented and Regularized Network (DORNet), a novel framework designed to adaptively address unknown degradation in real-world scenes.
Our approach begins with the development of a self-supervised degradation learning strategy, which models the degradation representations of low-resolution depth data.
To facilitate effective RGB-D fusion, we further introduce a degradation-oriented feature transformation module that selectively propagates RGB content into the depth data based on the learned degradation priors.
arXiv Detail & Related papers (2024-10-15T14:53:07Z) - Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors [75.24313405671433]
Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors.
We introduce a novel one-step SR model, which significantly addresses the efficiency issue of diffusion-based SR methods.
Unlike existing fine-tuning strategies, we designed a degradation-guided Low-Rank Adaptation (LoRA) module specifically for SR.
arXiv Detail & Related papers (2024-09-25T16:15:21Z) - A Simple and Generalist Approach for Panoptic Segmentation [57.94892855772925]
Generalist vision models aim for one and the same architecture for a variety of vision tasks.
While such shared architecture may seem attractive, generalist models tend to be outperformed by their bespoken counterparts.
We address this problem by introducing two key contributions, without compromising the desirable properties of generalist models.
arXiv Detail & Related papers (2024-08-29T13:02:12Z) - Pairwise Distance Distillation for Unsupervised Real-World Image Super-Resolution [38.79439380482431]
Real-world super-resolution (RWSR) faces unknown degradations in the low-resolution inputs, all the while lacking paired training data.
Existing methods approach this problem by learning blind general models through complex synthetic augmentations on training inputs.
We introduce a novel pairwise distance distillation framework to address the unsupervised RWSR for a targeted real-world degradation.
arXiv Detail & Related papers (2024-07-10T01:46:40Z) - IG-CFAT: An Improved GAN-Based Framework for Effectively Exploiting Transformers in Real-World Image Super-Resolution [2.1561701531034414]
Recently, composite fusion attention transformer (CFAT) outperformed previous state-of-the-art (SOTA) models in classic image super-resolution.
In this paper, we propose a novel GAN-based framework by incorporating the CFAT model to effectively exploit the performance of transformers in real-world image super-resolution.
arXiv Detail & Related papers (2024-06-19T20:21:26Z) - Incorporating Degradation Estimation in Light Field Spatial Super-Resolution [54.603510192725786]
We present LF-DEST, an effective blind Light Field SR method that incorporates explicit Degradation Estimation to handle various degradation types.
We conduct extensive experiments on benchmark datasets, demonstrating that LF-DEST achieves superior performance across a variety of degradation scenarios in light field SR.
arXiv Detail & Related papers (2024-05-11T13:14:43Z) - Crafting Training Degradation Distribution for the
Accuracy-Generalization Trade-off in Real-World Super-Resolution [53.0437282872811]
We introduce a novel approach to craft training degradation distributions using a small set of reference images.
Our results indicate that the proposed technique significantly improves the performance of test images while preserving generalization capabilities in real-world applications.
arXiv Detail & Related papers (2023-05-29T14:22:48Z) - Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for
Face Restoration [4.244692655670362]
Panini-Net is a degradation-aware feature network for face restoration.
It learns the abstract representations to distinguish various degradations.
It achieves state-of-the-art performance for multi-degradation face restoration and face super-resolution.
arXiv Detail & Related papers (2022-03-16T07:41:07Z) - Uncovering the Over-smoothing Challenge in Image Super-Resolution: Entropy-based Quantification and Contrastive Optimization [67.99082021804145]
We propose an explicit solution to the COO problem, called Detail Enhanced Contrastive Loss (DECLoss)
DECLoss utilizes the clustering property of contrastive learning to directly reduce the variance of the potential high-resolution distribution.
We evaluate DECLoss on multiple super-resolution benchmarks and demonstrate that it improves the perceptual quality of PSNR-oriented models.
arXiv Detail & Related papers (2022-01-04T08:30:09Z) - Fast and Robust Cascade Model for Multiple Degradation Single Image
Super-Resolution [2.1574781022415364]
Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years.
Here, we propose a new formulation of the Convolutional Neural Network (CNN) cascade model.
A new densely connected CNN-architecture is proposed where the output of each sub- module is restricted using some external knowledge.
arXiv Detail & Related papers (2020-11-16T18:59:49Z) - Role of Orthogonality Constraints in Improving Properties of Deep
Networks for Image Classification [8.756814963313804]
We propose an Orthogonal Sphere (OS) regularizer that emerges from physics-based latent-representations under simplifying assumptions.
Under further simplifying assumptions, the OS constraint can be written in closed-form as a simple orthonormality term and be used along with the cross-entropy loss function.
We demonstrate the effectiveness of the proposed OS regularization by providing quantitative and qualitative results on four benchmark datasets.
arXiv Detail & Related papers (2020-09-22T18:46:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.