Attention Based Real Image Restoration
- URL: http://arxiv.org/abs/2004.13524v2
- Date: Thu, 1 Oct 2020 06:52:45 GMT
- Title: Attention Based Real Image Restoration
- Authors: Saeed Anwar, Nick Barnes, and Lars Petersson
- Abstract summary: Deep convolutional neural networks perform better on images containing synthetic degradations.
This paper proposes a novel single-stage blind real image restoration network (R$2$Net)
- Score: 48.933507352496726
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep convolutional neural networks perform better on images containing
spatially invariant degradations, also known as synthetic degradations;
however, their performance is limited on real-degraded photographs and requires
multiple-stage network modeling. To advance the practicability of restoration
algorithms, this paper proposes a novel single-stage blind real image
restoration network (R$^2$Net) by employing a modular architecture. We use a
residual on the residual structure to ease the flow of low-frequency
information and apply feature attention to exploit the channel dependencies.
Furthermore, the evaluation in terms of quantitative metrics and visual quality
for four restoration tasks i.e. Denoising, Super-resolution, Raindrop Removal,
and JPEG Compression on 11 real degraded datasets against more than 30
state-of-the-art algorithms demonstrate the superiority of our R$^2$Net. We
also present the comparison on three synthetically generated degraded datasets
for denoising to showcase the capability of our method on synthetics denoising.
The codes, trained models, and results are available on
https://github.com/saeed-anwar/R2Net.
Related papers
- Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Models [14.25759541950917]
This work leverages a capable vision-language model and a synthetic degradation pipeline to learn image restoration in the wild (wild IR)
Our base diffusion model is the image restoration SDE (IR-SDE)
arXiv Detail & Related papers (2024-04-15T12:34:21Z) - Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression [58.618625678054826]
This study presents an enhanced neural compression method designed for optimal visual fidelity.
We have trained our model with a sophisticated semantic ensemble loss, integrating Charbonnier loss, perceptual loss, style loss, and a non-binary adversarial loss.
Our empirical findings demonstrate that this approach significantly improves the statistical fidelity of neural image compression.
arXiv Detail & Related papers (2024-01-25T08:11:27Z) - DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image
Enhancement [77.0360085530701]
Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments.
Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features.
Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
arXiv Detail & Related papers (2023-12-12T06:07:21Z) - VCISR: Blind Single Image Super-Resolution with Video Compression
Synthetic Data [18.877077302923713]
We present a video compression-based degradation model to synthesize low-resolution image data in the blind SISR task.
Our proposed image synthesizing method is widely applicable to existing image datasets.
By introducing video coding artifacts to SISR degradation models, neural networks can super-resolve images with the ability to restore video compression degradations.
arXiv Detail & Related papers (2023-11-02T05:24:19Z) - Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [148.16279746287452]
We propose a swin-conv block to incorporate the local modeling ability of residual convolutional layer and non-local modeling ability of swin transformer block.
For the training data synthesis, we design a practical noise degradation model which takes into consideration different kinds of noise.
Experiments on AGWN removal and real image denoising demonstrate that the new network architecture design achieves state-of-the-art performance.
arXiv Detail & Related papers (2022-03-24T18:11:31Z) - Selective Residual M-Net for Real Image Denoising [6.909688694501238]
We propose a blind real image denoising network (SRMNet) to advance the performance of denoising algorithms.
Specifically, we use a selective kernel with residual block on the hierarchical structure called M-Net to enrich the multi-scale semantic information.
OurNet has competitive performance results on two synthetic and two real-world noisy datasets in terms of quantitative metrics and visual quality.
arXiv Detail & Related papers (2022-03-03T11:10:30Z) - Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
We present a learning-based solution for restoring images suffering from spatially-varying degradations.
We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
arXiv Detail & Related papers (2021-08-19T11:02:25Z) - Identity Enhanced Residual Image Denoising [61.75610647978973]
We learn a fully-convolutional network model that consists of a Chain of Identity Mapping Modules and residual on the residual architecture for image denoising.
The proposed network produces remarkably higher numerical accuracy and better visual image quality than the classical state-of-the-art and CNN algorithms.
arXiv Detail & Related papers (2020-04-26T04:52:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.