Lightness Modulated Deep Inverse Tone Mapping
- URL: http://arxiv.org/abs/2107.07907v1
- Date: Fri, 16 Jul 2021 13:56:20 GMT
- Title: Lightness Modulated Deep Inverse Tone Mapping
- Authors: Kanglin Liu, Gaofeng Cao, Jiang Duan, Guoping Qiu
- Abstract summary: Single-image HDR reconstruction or inverse tone mapping (iTM) is a challenging task.
We present a deep learning based iTM method that takes advantage of the feature extraction and mapping power of deep convolutional neural networks (CNNs)
We present experimental results to demonstrate the effectiveness of the new technique.
- Score: 18.31269649436267
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Single-image HDR reconstruction or inverse tone mapping (iTM) is a
challenging task. In particular, recovering information in over-exposed regions
is extremely difficult because details in such regions are almost completely
lost. In this paper, we present a deep learning based iTM method that takes
advantage of the feature extraction and mapping power of deep convolutional
neural networks (CNNs) and uses a lightness prior to modulate the CNN to better
exploit observations in the surrounding areas of the over-exposed regions to
enhance the quality of HDR image reconstruction. Specifically, we introduce a
Hierarchical Synthesis Network (HiSN) for inferring a HDR image from a LDR
input and a Lightness Adpative Modulation Network (LAMN) to incorporate the the
lightness prior knowledge in the inferring process. The HiSN hierarchically
synthesizes the high-brightness component and the low-brightness component of
the HDR image whilst the LAMN uses a lightness adaptive mask that separates
detail-less saturated bright pixels from well-exposed lower light pixels to
enable HiSN to better infer the missing information, particularly in the
difficult over-exposed detail-less areas. We present experimental results to
demonstrate the effectiveness of the new technique based on quantitative
measures and visual comparisons. In addition, we present ablation studies of
HiSN and visualization of the activation maps inside LAMN to help gain a deeper
understanding of the internal working of the new iTM algorithm and explain why
it can achieve much improved performance over state-of-the-art algorithms.
Related papers
- Pano-NeRF: Synthesizing High Dynamic Range Novel Views with Geometry
from Sparse Low Dynamic Range Panoramic Images [82.1477261107279]
We propose the irradiance fields from sparse LDR panoramic images to increase the observation counts for faithful geometry recovery.
Experiments demonstrate that the irradiance fields outperform state-of-the-art methods on both geometry recovery and HDR reconstruction.
arXiv Detail & Related papers (2023-12-26T08:10:22Z) - LDM-ISP: Enhancing Neural ISP for Low Light with Latent Diffusion Models [54.93010869546011]
We propose to leverage the pre-trained latent diffusion model to perform the neural ISP for enhancing extremely low-light images.
Specifically, to tailor the pre-trained latent diffusion model to operate on the RAW domain, we train a set of lightweight taming modules.
We observe different roles of UNet denoising and decoder reconstruction in the latent diffusion model, which inspires us to decompose the low-light image enhancement task into latent-space low-frequency content generation and decoding-phase high-frequency detail maintenance.
arXiv Detail & Related papers (2023-12-02T04:31:51Z) - Low-Light Image Enhancement with Illumination-Aware Gamma Correction and
Complete Image Modelling Network [69.96295927854042]
Low-light environments usually lead to less informative large-scale dark areas.
We propose to integrate the effectiveness of gamma correction with the strong modelling capacities of deep networks.
Because exponential operation introduces high computational complexity, we propose to use Taylor Series to approximate gamma correction.
arXiv Detail & Related papers (2023-08-16T08:46:51Z) - Low-Light Hyperspectral Image Enhancement [90.84144276935464]
This work focuses on the low-light HSI enhancement task, which aims to reveal the spatial-spectral information hidden in darkened areas.
Based on Laplacian pyramid decomposition and reconstruction, we developed an end-to-end data-driven low-light HSI enhancement (HSIE) approach.
The effectiveness and efficiency of HSIE both in quantitative assessment measures and visual effects are demonstrated.
arXiv Detail & Related papers (2022-08-05T08:45:52Z) - INFWIDE: Image and Feature Space Wiener Deconvolution Network for
Non-blind Image Deblurring in Low-Light Conditions [32.35378513394865]
We propose a novel non-blind deblurring method dubbed image and feature space Wiener deconvolution network (INFWIDE)
INFWIDE removes noise and hallucinates saturated regions in the image space and suppresses ringing artifacts in the feature space.
Experiments on synthetic data and real data demonstrate the superior performance of the proposed approach.
arXiv Detail & Related papers (2022-07-17T15:22:31Z) - Lightweight HDR Camera ISP for Robust Perception in Dynamic Illumination
Conditions via Fourier Adversarial Networks [35.532434169432776]
We propose a lightweight two-stage image enhancement algorithm sequentially balancing illumination and noise removal.
We also propose a Fourier spectrum-based adversarial framework (AFNet) for consistent image enhancement under varying illumination conditions.
Based on quantitative and qualitative evaluations, we also examine the practicality and effects of image enhancement techniques on the performance of common perception tasks.
arXiv Detail & Related papers (2022-04-04T18:48:51Z) - Deep HDR Hallucination for Inverse Tone Mapping [7.310237013012436]
This work presents a GAN-based method that hallucinates missing information from badly exposed areas in LDR images.
It provides good dynamic range expansion for well-exposed areas and plausible hallucinations for saturated and under-exposed areas.
arXiv Detail & Related papers (2021-06-17T13:35:40Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Light Field Reconstruction Using Convolutional Network on EPI and
Extended Applications [78.63280020581662]
A novel convolutional neural network (CNN)-based framework is developed for light field reconstruction from a sparse set of views.
We demonstrate the high performance and robustness of the proposed framework compared with state-of-the-art algorithms.
arXiv Detail & Related papers (2021-03-24T08:16:32Z) - End-to-End Differentiable Learning to HDR Image Synthesis for
Multi-exposure Images [23.895981099137533]
High dynamic range () image reconstruction based on the multiple exposure stack from a given single exposure utilizes a deep learning framework to generate high-quality HDR images.
We tackle the problem in stack reconstruction-based methods by proposing a novel framework with a fully differentiable high dynamic range imaging (I) process.
In other words, our differentiable HDR synthesis layer helps the deep neural network to train to create multi-exposure stacks while reflecting the precise correlations between multi-exposure images in the HDRI process.
arXiv Detail & Related papers (2020-06-29T06:47:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.