Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

• URL: http://arxiv.org/abs/2411.10775v1
• Date: Sat, 16 Nov 2024 11:20:29 GMT
• Title: Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion
• Authors: Kepeng Xu, Li Xu, Gang He, Zhiqiang Zhang, Wenxin Yu, Shihao Wang, Dajiang Zhou, Yunsong Li,
• Abstract summary: The rise of HDR-WCG display devices has highlighted the need to convert SDRTV to HDRTV. Existing methods primarily focus on designing neural networks to learn a single-style mapping from SDRTV to HDRTV. We propose a novel method for SDRTV to HDRTV conversion guided by real HDRTV priors.
• Score: 22.78096367667505
• License:
• Abstract: The rise of HDR-WCG display devices has highlighted the need to convert SDRTV to HDRTV, as most video sources are still in SDR. Existing methods primarily focus on designing neural networks to learn a single-style mapping from SDRTV to HDRTV. However, the limited information in SDRTV and the diversity of styles in real-world conversions render this process an ill-posed problem, thereby constraining the performance and generalization of these methods. Inspired by generative approaches, we propose a novel method for SDRTV to HDRTV conversion guided by real HDRTV priors. Despite the limited information in SDRTV, introducing real HDRTV as reference priors significantly constrains the solution space of the originally high-dimensional ill-posed problem. This shift transforms the task from solving an unreferenced prediction problem to making a referenced selection, thereby markedly enhancing the accuracy and reliability of the conversion process. Specifically, our approach comprises two stages: the first stage employs a Vector Quantized Generative Adversarial Network to capture HDRTV priors, while the second stage matches these priors to the input SDRTV content to recover realistic HDRTV outputs. We evaluate our method on public datasets, demonstrating its effectiveness with significant improvements in both objective and subjective metrics across real and synthetic datasets.

Related papers

• HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splatting [76.5908492298286]
  Existing HDR NVS methods are mainly based on NeRF. They suffer from long training time and slow inference speed. We propose a new framework, High Dynamic Range Gaussian Splatting (-GS)
  arXiv  Detail & Related papers  (2024-05-24T00:46:58Z)
• FastHDRNet: A new efficient method for SDR-to-HDR Translation [5.224011800476952]
  We propose a neural network for SDR to HDR conversion, termed "FastNet" The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency.
  arXiv  Detail & Related papers  (2024-04-06T03:25:24Z)
• Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation [51.26219245226384]
  Modern displays are capable of rendering video content with high dynamic range (WCG) and wide color gamut (SDR) The majority of available resources are still in standard dynamic range (SDR) We define and analyze the SDRTV-to-TV task by modeling the formation of SDRTV/TV content. Our method is primarily designed for ultra-high-definition TV content and is therefore effective and lightweight for processing 4K resolution images.
  arXiv  Detail & Related papers  (2023-09-08T02:50:54Z)
• Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Models [4.0336006284433665]
  In media industry, the demand of SDR-to-TV up-conversion arises when users possess HDR-WCG (high dynamic range-wide color gamut) Current methods tend to produce dim and desaturated result, making nearly no improvement on viewing experience. We propose new HDRTV dataset (dubbed HDRTV4K) and new HDR-to-SDR models.
  arXiv  Detail & Related papers  (2023-03-23T04:40:33Z)
• Towards Real World HDRTV Reconstruction: A Data Synthesis-based Approach [48.1492764654516]
  Existing deep learning based HDRTV reconstruction methods assume one kind of tone mapping operators (TMOs) as the procedure to synthesize SDRTV-TV pairs for supervised training. In this paper, we argue that, although traditional TMOs exploit efficient dynamic range compression priors, they have several drawbacks on modeling the degradation information over-preservation, color bias and possible artifacts. We propose a learning-based data synthesis approach to learn the properties of real-world SDRTVs by integrating several tone mapping priors into both network structures and loss functions.
  arXiv  Detail & Related papers  (2022-11-06T08:27:37Z)
• A New Journey from SDRTV to HDRTV [36.58487005995048]
  We conduct an analysis of SDRTV-to-TV task by modeling the formation of SDRTV/TV content. We present a lightweight network that utilizes global statistics as guidance to conduct image-adaptive color mapping.
  arXiv  Detail & Related papers  (2021-08-18T05:17:08Z)
• NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results [56.932867490888015]
  This paper reviews the first challenge on high-dynamic range imaging that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conjunction with CVPR 2021. The challenge aims at estimating a HDR image from one or multiple respective low-dynamic range (LDR) observations, which might suffer from under- or over-exposed regions and different sources of noise.
  arXiv  Detail & Related papers  (2021-06-02T19:45:16Z)
• BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment [90.81396836308085]
  We show that by empowering recurrent framework with enhanced propagation and alignment, one can exploit video information more effectively. Our model BasicVSR++ surpasses BasicVSR by 0.82 dB in PSNR with similar number of parameters. BasicVSR++ generalizes well to other video restoration tasks such as compressed video enhancement.
  arXiv  Detail & Related papers  (2021-04-27T17:58:31Z)
• HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motions [62.44802076971331]
  We propose a novel GAN-based model, HDR-GAN, for synthesizing HDR images from multi-exposed LDR images. By incorporating adversarial learning, our method is able to produce faithful information in the regions with missing content.
  arXiv  Detail & Related papers  (2020-07-03T11:42:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.