Burst Denoising of Dark Images
- URL: http://arxiv.org/abs/2003.07823v2
- Date: Thu, 18 Jun 2020 05:28:21 GMT
- Title: Burst Denoising of Dark Images
- Authors: Ahmet Serdar Karadeniz, Erkut Erdem, Aykut Erdem
- Abstract summary: We propose a deep learning framework for obtaining clean and colorful RGB images from extremely dark raw images.
The backbone of our framework is a novel coarse-to-fine network architecture that generates high-quality outputs in a progressive manner.
Our experiments demonstrate that the proposed approach leads to perceptually more pleasing results than state-of-the-art methods.
- Score: 19.85860245798819
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Capturing images under extremely low-light conditions poses significant
challenges for the standard camera pipeline. Images become too dark and too
noisy, which makes traditional image enhancement techniques almost impossible
to apply. Very recently, researchers have shown promising results using
learning based approaches. Motivated by these ideas, in this paper, we propose
a deep learning framework for obtaining clean and colorful RGB images from
extremely dark raw images. The backbone of our framework is a novel
coarse-to-fine network architecture that generates high-quality outputs in a
progressive manner. The coarse network predicts a low-resolution, denoised raw
image, which is then fed to the fine network to recover fine-scale details and
realistic textures. To further reduce noise and improve color accuracy, we
extend this network to a permutation invariant structure so that it takes a
burst of low-light images as input and merges information from multiple images
at the feature-level. Our experiments demonstrate that the proposed approach
leads to perceptually more pleasing results than state-of-the-art methods by
producing much sharper and higher quality images.
Related papers
- CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement [97.95330185793358]
Low-light image enhancement (LLIE) aims to improve low-illumination images.
Existing methods face two challenges: uncertainty in restoration from diverse brightness degradations and loss of texture and color information.
We propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement.
arXiv Detail & Related papers (2024-04-08T07:34:39Z) - Implicit Neural Image Stitching [41.28311406845525]
We propose a novel approach, implicit Neural Image Stitching (NIS) that extends arbitrary-scale super-resolution.
Our method estimates Fourier coefficients of images for quality-enhancing warps.
Our experiments show that our approach achieves improvement in resolving the low-definition imaging of the previous deep image stitching.
arXiv Detail & Related papers (2023-09-04T07:40:30Z) - Simplifying Low-Light Image Enhancement Networks with Relative Loss
Functions [14.63586364951471]
We introduce FLW-Net (Fast and LightWeight Network) and two relative loss functions to make learning easier in low-light image enhancement.
We first recognize the challenges of the need for a large receptive field to obtain global contrast.
Then, we propose an efficient global feature information extraction component and two loss functions based on relative information to overcome these challenges.
arXiv Detail & Related papers (2023-04-06T10:05:54Z) - Seeing Through The Noisy Dark: Toward Real-world Low-Light Image
Enhancement and Denoising [125.56062454927755]
Real-world low-light environment usually suffer from lower visibility and heavier noise, due to insufficient light or hardware limitation.
We propose a novel end-to-end method termed Real-world Low-light Enhancement & Denoising Network (RLED-Net)
arXiv Detail & Related papers (2022-10-02T14:57:23Z) - Designing An Illumination-Aware Network for Deep Image Relighting [69.750906769976]
We present an Illumination-Aware Network (IAN) which follows the guidance from hierarchical sampling to progressively relight a scene from a single image.
In addition, an Illumination-Aware Residual Block (IARB) is designed to approximate the physical rendering process.
Experimental results show that our proposed method produces better quantitative and qualitative relighting results than previous state-of-the-art methods.
arXiv Detail & Related papers (2022-07-21T16:21:24Z) - Enhancing Low-Light Images in Real World via Cross-Image Disentanglement [58.754943762945864]
We propose a new low-light image enhancement dataset consisting of misaligned training images with real-world corruptions.
Our model achieves state-of-the-art performances on both the newly proposed dataset and other popular low-light datasets.
arXiv Detail & Related papers (2022-01-10T03:12:52Z) - LEUGAN:Low-Light Image Enhancement by Unsupervised Generative
Attentional Networks [4.584570928928926]
We propose an unsupervised generation network with attention-guidance to handle the low-light image enhancement task.
Specifically, our network contains two parts: an edge auxiliary module that restores sharper edges and an attention guidance module that recovers more realistic colors.
Experiments validate that our proposed algorithm performs favorably against state-of-the-art methods.
arXiv Detail & Related papers (2020-12-24T16:49:19Z) - Zoom-to-Inpaint: Image Inpainting with High-Frequency Details [39.582275854002994]
We propose applying super-resolution to coarsely reconstructed outputs, refining them at high resolution, and then downscaling the output to the original resolution.
By introducing high-resolution images to the refinement network, our framework is able to reconstruct finer details that are usually smoothed out due to spectral bias.
Our zoom-in, refine and zoom-out strategy, combined with high-resolution supervision and progressive learning, constitutes a framework-agnostic approach for enhancing high-frequency details.
arXiv Detail & Related papers (2020-12-17T05:39:37Z) - Deep Bilateral Retinex for Low-Light Image Enhancement [96.15991198417552]
Low-light images suffer from poor visibility caused by low contrast, color distortion and measurement noise.
This paper proposes a deep learning method for low-light image enhancement with a particular focus on handling the measurement noise.
The proposed method is very competitive to the state-of-the-art methods, and has significant advantage over others when processing images captured in extremely low lighting conditions.
arXiv Detail & Related papers (2020-07-04T06:26:44Z) - Burst Photography for Learning to Enhance Extremely Dark Images [19.85860245798819]
In this paper, we aim to leverage burst photography to boost the performance and obtain much sharper and more accurate RGB images from extremely dark raw images.
The backbone of our proposed framework is a novel coarse-to-fine network architecture that generates high-quality outputs progressively.
Our experiments demonstrate that our approach leads to perceptually more pleasing results than the state-of-the-art methods by producing more detailed and considerably higher quality images.
arXiv Detail & Related papers (2020-06-17T13:19:07Z) - Reconstructing the Noise Manifold for Image Denoising [56.562855317536396]
We introduce the idea of a cGAN which explicitly leverages structure in the image noise space.
By learning directly a low dimensional manifold of the image noise, the generator promotes the removal from the noisy image only that information which spans this manifold.
Based on our experiments, our model substantially outperforms existing state-of-the-art architectures.
arXiv Detail & Related papers (2020-02-11T00:31:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.