DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models

• URL: http://arxiv.org/abs/2604.06161v2
• Date: Fri, 10 Apr 2026 00:14:18 GMT
• Title: DiffHDR: Re-Exposing LDR Videos with Video Diffusion Models
• Abstract summary: Diff is a framework that formulates LDR-to-generative conversion within the latent space of a video diffusion model.<n>Our framework further enables controllable LDR-to-video conversion guided by text or reference images.
• Score: 35.73610036182625
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance is lost due to saturation and quantization. This loss of highlight and shadow detail precludes mapping accurate luminance to HDR displays and limits meaningful re-exposure in post-production workflows. Although techniques have been proposed to convert LDR images to HDR through dynamic range expansion, they struggle to restore realistic detail in the over- and underexposed regions. To address this, we present DiffHDR, a framework that formulates LDR-to-HDR conversion as a generative radiance inpainting task within the latent space of a video diffusion model. By operating in Log-Gamma color space, DiffHDR leverages spatio-temporal generative priors from a pretrained video diffusion model to synthesize plausible HDR radiance in over- and underexposed regions while recovering the continuous scene radiance of the quantized pixels. Our framework further enables controllable LDR-to-HDR video conversion guided by text prompts or reference images. To address the scarcity of paired HDR video data, we develop a pipeline that synthesizes high-quality HDR video training data from static HDRI maps. Extensive experiments demonstrate that DiffHDR significantly outperforms state-of-the-art approaches in radiance fidelity and temporal stability, producing realistic HDR videos with considerable latitude for re-exposure.

Related papers

• Video Generation Models Are Inherent Lighting Estimators [54.44164570819254]
  Recent generation models can produce scenes with complex lighting, possessing an inherent understanding of lighting.<n>We introduce V-LITE (Video generation models are inherent lighting estimators), a framework that unlocks this internal knowledge by reframing estimation.<n>To bridge the gap from LDR-native models to the HDR domain, we design an HDR-aware VAE and employ an efficient LoRA-based fine-tuning strategy.
  arXiv  Detail & Related papers  (2026-07-06T04:59:17Z)
• InstantHDR: Single-forward Gaussian Splatting for High Dynamic Range 3D Reconstruction [48.64335106961342]
  Existing HDR pipelines rely on known camera poses, well-calibrated dense point clouds, and time-consuming per-scene optimization.<n>Current feed-forward alternatives overlook the HDR problem by assuming exposure-in appearance.<n>We propose Instant, a feed-forward network that reconstructs 3D HDR scenes from uncalibrated multi-exposure LDR collections in a single forward pass.
  arXiv  Detail & Related papers  (2026-03-11T20:51:47Z)
• HDR-NSFF: High Dynamic Range Neural Scene Flow Fields [25.023351117641358]
  We present HDR-NSFF, a paradigm shift from 2D-based merging to 4D-temporal modeling.<n>Experiments demonstrate that HDR-NSFF recovers fine details radiance coherent dynamics even under challenging exposure variations.<n>We present the first real-world HDR-GoPro dataset specifically designed for dynamic HDR scenes.
  arXiv  Detail & Related papers  (2026-03-09T12:36:46Z)
• Reconstructing 3D Scenes in Native High Dynamic Range [82.90064638813185]
  We present the first method for 3D scene reconstruction that directly models native HDR observations.<n>We propose bf Native High dynamic range 3D Gaussian Splatting (NH-3DGS), which preserves the full dynamic range throughout the reconstruction pipeline.<n>We demonstrate on both synthetic and real multi-view HDR datasets that NH-3DGS significantly outperforms existing methods in reconstruction quality and dynamic range preservation.
  arXiv  Detail & Related papers  (2025-11-17T02:33:31Z)
• LEDiff: Latent Exposure Diffusion for HDR Generation [11.669442066168244]
  LEDiff is a method that enables a generative model with HDR content generation through latent space exposure fusion techniques.<n>It also functions as an LDR-to- fusion converter, expanding the dynamic range of existing low-dynamic range images.
  arXiv  Detail & Related papers  (2024-12-19T02:15:55Z)
• Exposure Completing for Temporally Consistent Neural High Dynamic Range Video Rendering [17.430726543786943]
  We propose a novel paradigm to render HDR frames via completing the absent exposure information. Our approach involves interpolating neighbor LDR frames in the time dimension to reconstruct LDR frames for the absent exposures. This benefits the fusing process for HDR results, reducing noise and ghosting artifacts therefore improving temporal consistency.
  arXiv  Detail & Related papers  (2024-07-18T09:13:08Z)
• Diffusion-Promoted HDR Video Reconstruction [45.73396977607666]
  High dynamic range (LDR) video reconstruction aims to generate HDR videos from low dynamic range (LDR) frames captured with alternating exposures. Most existing works solely rely on the regression-based paradigm, leading to adverse effects such as ghosting artifacts and missing details in saturated regions. We propose a diffusion-promoted method for HDR video reconstruction, termed HDR-V-Diff, which incorporates a diffusion model to capture the HDR distribution.
  arXiv  Detail & Related papers  (2024-06-12T13:38:10Z)
• GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild [74.52723408793648]
  We present the first method for learning a generative model of HDR images from in-the-wild LDR image collections in a fully unsupervised manner. The key idea is to train a generative adversarial network (GAN) to generate HDR images which, when projected to LDR under various exposures, are indistinguishable from real LDR images. Experiments show that our method GlowGAN can synthesize photorealistic HDR images in many challenging cases such as landscapes, lightning, or windows.
  arXiv  Detail & Related papers  (2022-11-22T15:42:08Z)
• HDR-NeRF: High Dynamic Range Neural Radiance Fields [70.80920996881113]
  We present High Dynamic Range Neural Radiance Fields (-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. We are able to generate both novel HDR views and novel LDR views under different exposures.
  arXiv  Detail & Related papers  (2021-11-29T11:06:39Z)
• HDRVideo-GAN: Deep Generative HDR Video Reconstruction [19.837271879354184]
  We propose an end-to-end GAN-based framework for HDR video reconstruction from LDR sequences with alternating exposures. We first extract clean LDR frames from noisy LDR video with alternating exposures with a denoising network trained in a self-supervised setting. We then align the neighboring alternating-exposure frames to a reference frame and then reconstruct high-quality HDR frames in a complete adversarial setting.
  arXiv  Detail & Related papers  (2021-10-22T14:02:03Z)
• HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motions [62.44802076971331]
  We propose a novel GAN-based model, HDR-GAN, for synthesizing HDR images from multi-exposed LDR images. By incorporating adversarial learning, our method is able to produce faithful information in the regions with missing content.
  arXiv  Detail & Related papers  (2020-07-03T11:42:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.