KXNet: A Model-Driven Deep Neural Network for Blind Super-Resolution
- URL: http://arxiv.org/abs/2209.10305v2
- Date: Thu, 22 Sep 2022 04:27:50 GMT
- Title: KXNet: A Model-Driven Deep Neural Network for Blind Super-Resolution
- Authors: Jiahong Fu, Hong Wang, Qi Xie, Qian Zhao, Deyu Meng, and Zongben Xu
- Abstract summary: We propose a model-driven deep neural network, called KXNet, for blind SISR.
The proposed KXNet is fully integrated with the inherent physical mechanism underlying this SISR task.
Experiments on synthetic and real data finely demonstrate the superior accuracy and generality of our method.
- Score: 57.882146858582175
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Although current deep learning-based methods have gained promising
performance in the blind single image super-resolution (SISR) task, most of
them mainly focus on heuristically constructing diverse network architectures
and put less emphasis on the explicit embedding of the physical generation
mechanism between blur kernels and high-resolution (HR) images. To alleviate
this issue, we propose a model-driven deep neural network, called KXNet, for
blind SISR. Specifically, to solve the classical SISR model, we propose a
simple-yet-effective iterative algorithm. Then by unfolding the involved
iterative steps into the corresponding network module, we naturally construct
the KXNet. The main specificity of the proposed KXNet is that the entire
learning process is fully and explicitly integrated with the inherent physical
mechanism underlying this SISR task. Thus, the learned blur kernel has clear
physical patterns and the mutually iterative process between blur kernel and HR
image can soundly guide the KXNet to be evolved in the right direction.
Extensive experiments on synthetic and real data finely demonstrate the
superior accuracy and generality of our method beyond the current
representative state-of-the-art blind SISR methods. Code is available at:
https://github.com/jiahong-fu/KXNet.
Related papers
- Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution [91.3781512926942]
Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures.
This work investigates the potential of network pruning for super-resolution iteration to take advantage of off-the-shelf network designs and reduce the underlying computational overhead.
We propose a novel Iterative Soft Shrinkage-Percentage (ISS-P) method by optimizing the sparse structure of a randomly network at each and tweaking unimportant weights with a small amount proportional to the magnitude scale on-the-fly.
arXiv Detail & Related papers (2023-03-16T21:06:13Z) - RDRN: Recursively Defined Residual Network for Image Super-Resolution [58.64907136562178]
Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution.
We propose a novel network architecture which utilizes attention blocks efficiently.
arXiv Detail & Related papers (2022-11-17T11:06:29Z) - Adaptive Convolutional Dictionary Network for CT Metal Artifact
Reduction [62.691996239590125]
We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction.
Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image.
Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
arXiv Detail & Related papers (2022-05-16T06:49:36Z) - Rapid training of deep neural networks without skip connections or
normalization layers using Deep Kernel Shaping [46.083745557823164]
We identify the main pathologies present in deep networks that prevent them from training fast and generalizing to unseen data.
We show how these can be avoided by carefully controlling the "shape" of the network's kernel function.
arXiv Detail & Related papers (2021-10-05T00:49:36Z) - Accurate and Lightweight Image Super-Resolution with Model-Guided Deep
Unfolding Network [63.69237156340457]
We present and advocate an explainable approach toward SISR named model-guided deep unfolding network (MoG-DUN)
MoG-DUN is accurate (producing fewer aliasing artifacts), computationally efficient (with reduced model parameters), and versatile (capable of handling multiple degradations)
The superiority of the proposed MoG-DUN method to existing state-of-theart image methods including RCAN, SRDNF, and SRFBN is substantiated by extensive experiments on several popular datasets and various degradation scenarios.
arXiv Detail & Related papers (2020-09-14T08:23:37Z) - OverNet: Lightweight Multi-Scale Super-Resolution with Overscaling
Network [3.6683231417848283]
We introduce OverNet, a deep but lightweight convolutional network to solve SISR at arbitrary scale factors with a single model.
We show that our network outperforms previous state-of-the-art results in standard benchmarks while using fewer parameters than previous approaches.
arXiv Detail & Related papers (2020-08-05T22:10:29Z) - A Model-driven Deep Neural Network for Single Image Rain Removal [52.787356046951494]
We propose a model-driven deep neural network for the task, with fully interpretable network structures.
Based on the convolutional dictionary learning mechanism for representing rain, we propose a novel single image deraining model.
All the rain kernels and operators can be automatically extracted, faithfully characterizing the features of both rain and clean background layers.
arXiv Detail & Related papers (2020-05-04T09:13:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.