Deep HDR Hallucination for Inverse Tone Mapping
- URL: http://arxiv.org/abs/2106.09486v1
- Date: Thu, 17 Jun 2021 13:35:40 GMT
- Title: Deep HDR Hallucination for Inverse Tone Mapping
- Authors: Demetris Marnerides, Thomas Bashford-Rogers, Kurt Debattista
- Abstract summary: This work presents a GAN-based method that hallucinates missing information from badly exposed areas in LDR images.
It provides good dynamic range expansion for well-exposed areas and plausible hallucinations for saturated and under-exposed areas.
- Score: 7.310237013012436
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Inverse Tone Mapping (ITM) methods attempt to reconstruct High Dynamic Range
(HDR) information from Low Dynamic Range (LDR) image content. The dynamic range
of well-exposed areas must be expanded and any missing information due to
over/under-exposure must be recovered (hallucinated). The majority of methods
focus on the former and are relatively successful, while most attempts on the
latter are not of sufficient quality, even ones based on Convolutional Neural
Networks (CNNs). A major factor for the reduced inpainting quality in some
works is the choice of loss function. Work based on Generative Adversarial
Networks (GANs) shows promising results for image synthesis and LDR inpainting,
suggesting that GAN losses can improve inverse tone mapping results. This work
presents a GAN-based method that hallucinates missing information from badly
exposed areas in LDR images and compares its efficacy with alternative
variations. The proposed method is quantitatively competitive with
state-of-the-art inverse tone mapping methods, providing good dynamic range
expansion for well-exposed areas and plausible hallucinations for saturated and
under-exposed areas. A density-based normalisation method, targeted for HDR
content, is also proposed, as well as an HDR data augmentation method targeted
for HDR hallucination.
Related papers
- Semantic Aware Diffusion Inverse Tone Mapping [5.65968650127342]
Inverse tone mapping attempts to boost captured Standard Dynamic Range (SDR) images back to High Dynamic Range ( HDR)
We present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach.
arXiv Detail & Related papers (2024-05-24T11:44:22Z) - Generating Content for HDR Deghosting from Frequency View [56.103761824603644]
Recent Diffusion Models (DMs) have been introduced in HDR imaging field.
DMs require extensive iterations with large models to estimate entire images.
We propose the Low-Frequency aware Diffusion (LF-Diff) model for ghost-free HDR imaging.
arXiv Detail & Related papers (2024-04-01T01:32:11Z) - HistoHDR-Net: Histogram Equalization for Single LDR to HDR Image
Translation [12.45632443397018]
High Dynamic Range ( HDR) imaging aims to replicate the high visual quality and clarity of real-world scenes.
The literature offers various data-driven methods for HDR image reconstruction from Low Dynamic Range (LDR) counterparts.
A common limitation of these approaches is missing details in regions of the reconstructed HDR images.
We propose a simple and effective method, Histo-Net, to recover the fine details.
arXiv Detail & Related papers (2024-02-08T20:14:46Z) - Towards High-quality HDR Deghosting with Conditional Diffusion Models [88.83729417524823]
High Dynamic Range (LDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques.
DNNs still generate ghosting artifacts when LDR images have saturation and large motion.
We formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition.
arXiv Detail & Related papers (2023-11-02T01:53:55Z) - SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked
Autoencoders [97.64072440883392]
We propose a novel semi-supervised approach to realize few-shot HDR imaging via two stages of training, called SSHDR.
Unlikely previous methods, directly recovering content and removing ghosts simultaneously, which is hard to achieve optimum.
Experiments demonstrate that SSHDR outperforms state-of-the-art methods quantitatively and qualitatively within and across different datasets.
arXiv Detail & Related papers (2023-04-14T03:42:51Z) - GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild [74.52723408793648]
We present the first method for learning a generative model of HDR images from in-the-wild LDR image collections in a fully unsupervised manner.
The key idea is to train a generative adversarial network (GAN) to generate HDR images which, when projected to LDR under various exposures, are indistinguishable from real LDR images.
Experiments show that our method GlowGAN can synthesize photorealistic HDR images in many challenging cases such as landscapes, lightning, or windows.
arXiv Detail & Related papers (2022-11-22T15:42:08Z) - UPHDR-GAN: Generative Adversarial Network for High Dynamic Range Imaging
with Unpaired Data [42.283022888414656]
The paper proposes a method to effectively fuse multiexposure inputs and generates high-quality high dynamic range (versa) images with unpaired datasets.
Deep learning-based HDR image generation methods rely heavily on paired datasets.
Generative Adrial Networks (GAN) have demonstrated their potentials of translating images from source domain X to target domain Y in the absence of paired examples.
arXiv Detail & Related papers (2021-02-03T03:09:14Z) - HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with
Large Motions [62.44802076971331]
We propose a novel GAN-based model, HDR-GAN, for synthesizing HDR images from multi-exposed LDR images.
By incorporating adversarial learning, our method is able to produce faithful information in the regions with missing content.
arXiv Detail & Related papers (2020-07-03T11:42:35Z) - Single-Image HDR Reconstruction by Learning to Reverse the Camera
Pipeline [100.5353614588565]
We propose to incorporate the domain knowledge of the LDR image formation pipeline into our model.
We model the HDRto-LDR image formation pipeline as the (1) dynamic range clipping, (2) non-linear mapping from a camera response function, and (3) quantization.
We demonstrate that the proposed method performs favorably against state-of-the-art single-image HDR reconstruction algorithms.
arXiv Detail & Related papers (2020-04-02T17:59:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.