RealRep: Generalized SDR-to-HDR Conversion with Style Disentangled Representation Learning

• URL: http://arxiv.org/abs/2505.07322v1
• Date: Mon, 12 May 2025 08:08:58 GMT
• Title: RealRep: Generalized SDR-to-HDR Conversion with Style Disentangled Representation Learning
• Authors: Gang He, Siqi Wang, Kepeng Xu, Lin Zhang,
• Abstract summary: High-Dynamic-Range Wide-Color-Gamut (WCG) technology is becoming increasingly prevalent, intensifying the demand for converting Standard Dynamic Range (SDR) content to HDR.<n>Existing methods primarily rely on fixed tone mapping operators, which are inadequate for handling SDR inputs with diverse styles commonly found in real-world scenarios.
• Score: 12.1967024885474
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: High-Dynamic-Range Wide-Color-Gamut (HDR-WCG) technology is becoming increasingly prevalent, intensifying the demand for converting Standard Dynamic Range (SDR) content to HDR. Existing methods primarily rely on fixed tone mapping operators, which are inadequate for handling SDR inputs with diverse styles commonly found in real-world scenarios. To address this challenge, we propose a generalized SDR-to-HDR method that handles diverse styles in real-world SDR content, termed Realistic Style Disentangled Representation Learning (RealRep). By disentangling luminance and chrominance, we analyze the intrinsic differences between contents with varying styles and propose a disentangled multi-view style representation learning method. This approach captures the guidance prior of true luminance and chrominance distributions across different styles, even when the SDR style distributions exhibit significant variations, thereby establishing a robust embedding space for inverse tone mapping. Motivated by the difficulty of directly utilizing degradation representation priors, we further introduce the Degradation-Domain Aware Controlled Mapping Network (DDACMNet), a two-stage framework that performs adaptive hierarchical mapping guided by a control-aware normalization mechanism. DDACMNet dynamically modulates the mapping process via degradation-conditioned hierarchical features, enabling robust adaptation across diverse degradation domains. Extensive experiments show that RealRep consistently outperforms state-of-the-art methods with superior generalization and perceptually faithful HDR color gamut reconstruction.

Related papers

• Manifold-aware Representation Learning for Degradation-agnostic Image Restoration [135.90908995927194]
  Image Restoration (IR) aims to recover high quality images from degraded inputs affected by various corruptions such as noise, blur, haze, rain, and low light conditions.<n>We present MIRAGE, a unified framework for all in one IR that explicitly decomposes the input feature space into three semantically aligned parallel branches.<n>This modular decomposition significantly improves generalization and efficiency across diverse degradations.
  arXiv  Detail & Related papers  (2025-05-24T12:52:10Z)
• Semantic Aware Diffusion Inverse Tone Mapping [5.65968650127342]
  Inverse tone mapping attempts to boost captured Standard Dynamic Range (SDR) images back to High Dynamic Range ( HDR) We present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach.
  arXiv  Detail & Related papers  (2024-05-24T11:44:22Z)
• FastHDRNet: A new efficient method for SDR-to-HDR Translation [5.224011800476952]
  We propose a neural network for SDR to HDR conversion, termed "FastNet" The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency.
  arXiv  Detail & Related papers  (2024-04-06T03:25:24Z)
• Generating Content for HDR Deghosting from Frequency View [56.103761824603644]
  Recent Diffusion Models (DMs) have been introduced in HDR imaging field. DMs require extensive iterations with large models to estimate entire images. We propose the Low-Frequency aware Diffusion (LF-Diff) model for ghost-free HDR imaging.
  arXiv  Detail & Related papers  (2024-04-01T01:32:11Z)
• DSR-Diff: Depth Map Super-Resolution with Diffusion Model [38.68563026759223]
  We present a novel CDSR paradigm that utilizes a diffusion model within the latent space to generate guidance for depth map super-resolution. Our proposed method has shown superior performance in extensive experiments when compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-11-16T14:18:10Z)
• Style-Hallucinated Dual Consistency Learning: A Unified Framework for Visual Domain Generalization [113.03189252044773]
  We propose a unified framework, Style-HAllucinated Dual consistEncy learning (SHADE), to handle domain shift in various visual tasks. Our versatile SHADE can significantly enhance the generalization in various visual recognition tasks, including image classification, semantic segmentation and object detection.
  arXiv  Detail & Related papers  (2022-12-18T11:42:51Z)
• Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification [84.32086702849338]
  We propose a novel modality-adaptive mixup and invariant decomposition (MID) approach for RGB-infrared person re-identification. MID designs a modality-adaptive mixup scheme to generate suitable mixed modality images between RGB and infrared images. Experiments on two challenging benchmarks demonstrate superior performance of MID over state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-03T14:26:49Z)
• Invertible Tone Mapping with Selectable Styles [19.03179521805971]
  In this paper, we propose an invertible tone mapping method that converts the multi-exposure HDR to a true LDR. Our invertible LDR can mimic the appearance of a user-selected tone mapping style. It can be shared over any existing social network platforms that may re-encode or format-convert the uploaded images.
  arXiv  Detail & Related papers  (2021-10-09T07:32:36Z)
• High-resolution Depth Maps Imaging via Attention-based Hierarchical Multi-modal Fusion [84.24973877109181]
  We propose a novel attention-based hierarchical multi-modal fusion network for guided DSR. We show that our approach outperforms state-of-the-art methods in terms of reconstruction accuracy, running speed and memory efficiency.
  arXiv  Detail & Related papers  (2021-04-04T03:28:33Z)
• MetaHDR: Model-Agnostic Meta-Learning for HDR Image Reconstruction [0.0]
  Existing approaches for converting low dynamic range images to high dynamic range images are limited by the assumption that all conversions are governed by the same nonlinear mapping. We propose "Meta-Learning for HDR-Agnostic Image Reconstruction" (Meta), which applies meta-learning to the LDR-to-Model conversion problem using existing HDR datasets.
  arXiv  Detail & Related papers  (2021-03-20T07:56:45Z)
• DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution [69.2432352477966]
  Real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR. Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair.
  arXiv  Detail & Related papers  (2020-02-25T18:24:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.