FastHDRNet: A new efficient method for SDR-to-HDR Translation
- URL: http://arxiv.org/abs/2404.04483v2
- Date: Sat, 11 May 2024 08:03:23 GMT
- Title: FastHDRNet: A new efficient method for SDR-to-HDR Translation
- Authors: Siyuan Tian, Hao Wang, Yiren Rong, Junhao Wang, Renjie Dai, Zhengxiao He,
- Abstract summary: We propose a neural network for SDR to HDR conversion, termed "FastNet"
The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency.
- Score: 5.224011800476952
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Modern displays nowadays possess the capability to render video content with a high dynamic range (HDR) and an extensive color gamut .However, the majority of available resources are still in standard dynamic range (SDR). Therefore, we need to identify an effective methodology for this objective.The existing deep neural networks (DNN) based SDR to HDR conversion methods outperforms conventional methods, but they are either too large to implement or generate some terrible artifacts. We propose a neural network for SDR to HDR conversion, termed "FastHDRNet". This network includes two parts, Adaptive Universal Color Transformation (AUCT) and Local Enhancement (LE). The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency. After the experiment, we find that our proposed method achieves state-of-the-art performance in both quantitative comparisons and visual quality with a lightweight structure and a enhanced infer speed.
Related papers
- HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splatting [76.5908492298286]
Existing HDR NVS methods are mainly based on NeRF.
They suffer from long training time and slow inference speed.
We propose a new framework, High Dynamic Range Gaussian Splatting (-GS)
arXiv Detail & Related papers (2024-05-24T00:46:58Z) - Generating Content for HDR Deghosting from Frequency View [56.103761824603644]
Recent Diffusion Models (DMs) have been introduced in HDR imaging field.
DMs require extensive iterations with large models to estimate entire images.
We propose the Low-Frequency aware Diffusion (LF-Diff) model for ghost-free HDR imaging.
arXiv Detail & Related papers (2024-04-01T01:32:11Z) - Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation [51.26219245226384]
Modern displays are capable of rendering video content with high dynamic range (WCG) and wide color gamut (SDR)
The majority of available resources are still in standard dynamic range (SDR)
We define and analyze the SDRTV-to-TV task by modeling the formation of SDRTV/TV content.
Our method is primarily designed for ultra-high-definition TV content and is therefore effective and lightweight for processing 4K resolution images.
arXiv Detail & Related papers (2023-09-08T02:50:54Z) - ArtHDR-Net: Perceptually Realistic and Accurate HDR Content Creation [12.45632443397018]
Many methods have been proposed to recreate the HDR counterparts of input Low Dynamic Range (LDR) images/videos given a single exposure or multi-exposure LDRs.
These conventional approaches do not emphasize preserving the artistic intent of the images in terms of human visual perception.
We propose an architecture called Art-Net that uses multi-exposed LDR as input.
arXiv Detail & Related papers (2023-09-07T16:40:49Z) - Lightweight Improved Residual Network for Efficient Inverse Tone Mapping [30.049931061503276]
Most media images on the internet remain in 8-bit standard dynamic range (SDR) format.
Inverse tone mapping (ITM) is crucial to unlock the full potential of abundant media images.
We propose a lightweight Improved Residual Network (IRNet) by enhancing the power of popular residual block for efficient ITM.
arXiv Detail & Related papers (2023-07-08T15:43:49Z) - SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked
Autoencoders [97.64072440883392]
We propose a novel semi-supervised approach to realize few-shot HDR imaging via two stages of training, called SSHDR.
Unlikely previous methods, directly recovering content and removing ghosts simultaneously, which is hard to achieve optimum.
Experiments demonstrate that SSHDR outperforms state-of-the-art methods quantitatively and qualitatively within and across different datasets.
arXiv Detail & Related papers (2023-04-14T03:42:51Z) - High Dynamic Range Imaging with Context-aware Transformer [3.1892103878735454]
We propose a novel hierarchical dual Transformer (HDT) method for ghost-free images.
First, we use a CNN-based head with spatial attention mechanisms to extract features from all the LDR images.
Second, the LDR features are delivered to the Transformer, while the local details are extracted using the channel attention mechanism.
arXiv Detail & Related papers (2023-04-10T06:56:01Z) - Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and
Degradation Models [4.0336006284433665]
In media industry, the demand of SDR-to-TV up-conversion arises when users possess HDR-WCG (high dynamic range-wide color gamut)
Current methods tend to produce dim and desaturated result, making nearly no improvement on viewing experience.
We propose new HDRTV dataset (dubbed HDRTV4K) and new HDR-to-SDR models.
arXiv Detail & Related papers (2023-03-23T04:40:33Z) - LHDR: HDR Reconstruction for Legacy Content using a Lightweight DNN [4.784524967912113]
We propose a lightweight method trained to tackle legacy SDR content with more degradation types.
Experiments show that our method reached appealing performance with minimal computational cost.
arXiv Detail & Related papers (2022-11-21T09:05:20Z) - Real Image Super Resolution Via Heterogeneous Model Ensemble using
GP-NAS [63.48801313087118]
We propose a new method for image superresolution using deep residual network with dense skip connections.
The proposed method won the first place in all three tracks of the AIM 2020 Real Image Super-Resolution Challenge.
arXiv Detail & Related papers (2020-09-02T22:33:23Z) - HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with
Large Motions [62.44802076971331]
We propose a novel GAN-based model, HDR-GAN, for synthesizing HDR images from multi-exposed LDR images.
By incorporating adversarial learning, our method is able to produce faithful information in the regions with missing content.
arXiv Detail & Related papers (2020-07-03T11:42:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.