Progressive and Selective Fusion Network for High Dynamic Range Imaging
- URL: http://arxiv.org/abs/2108.08585v1
- Date: Thu, 19 Aug 2021 09:42:03 GMT
- Title: Progressive and Selective Fusion Network for High Dynamic Range Imaging
- Authors: Qian Ye, Jun Xiao, Kin-man Lam, and Takayuki Okatani
- Abstract summary: This paper considers the problem of generating an HDR image of a scene from its LDR images.
Recent studies employ deep learning and solve the problem in an end-to-end fashion, leading to significant performance improvements.
We propose a novel method that can better fuse the features based on two ideas. One is multi-step feature fusion; our network gradually fuses the features in a stack of blocks having the same structure.
- Score: 28.639647755164916
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: This paper considers the problem of generating an HDR image of a scene from
its LDR images. Recent studies employ deep learning and solve the problem in an
end-to-end fashion, leading to significant performance improvements. However,
it is still hard to generate a good quality image from LDR images of a dynamic
scene captured by a hand-held camera, e.g., occlusion due to the large motion
of foreground objects, causing ghosting artifacts. The key to success relies on
how well we can fuse the input images in their feature space, where we wish to
remove the factors leading to low-quality image generation while performing the
fundamental computations for HDR image generation, e.g., selecting the
best-exposed image/region. We propose a novel method that can better fuse the
features based on two ideas. One is multi-step feature fusion; our network
gradually fuses the features in a stack of blocks having the same structure.
The other is the design of the component block that effectively performs two
operations essential to the problem, i.e., comparing and selecting appropriate
images/regions. Experimental results show that the proposed method outperforms
the previous state-of-the-art methods on the standard benchmark tests.
Related papers
- Progressive Feature Fusion Network for Enhancing Image Quality
Assessment [8.06731856250435]
We propose a new image quality assessment framework to decide which image is better in an image group.
To capture the subtle differences, a fine-grained network is adopted to acquire multi-scale features.
Experimental results show that compared with the current mainstream image quality assessment methods, the proposed network can achieve more accurate image quality assessment.
arXiv Detail & Related papers (2024-01-13T06:34:32Z) - Deep Progressive Feature Aggregation Network for High Dynamic Range
Imaging [24.94466716276423]
We propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes.
Our method implicitly samples high-correspondence features and aggregates them in a coarse-to-fine manner for alignment.
Experiments show that our proposed method can achieve state-of-the-art performance under different scenes.
arXiv Detail & Related papers (2022-08-04T04:37:35Z) - Rank-Enhanced Low-Dimensional Convolution Set for Hyperspectral Image
Denoising [50.039949798156826]
This paper tackles the challenging problem of hyperspectral (HS) image denoising.
We propose rank-enhanced low-dimensional convolution set (Re-ConvSet)
We then incorporate Re-ConvSet into the widely-used U-Net architecture to construct an HS image denoising method.
arXiv Detail & Related papers (2022-07-09T13:35:12Z) - SJ-HD^2R: Selective Joint High Dynamic Range and Denoising Imaging for
Dynamic Scenes [17.867412310873732]
Ghosting artifacts, motion blur, and low fidelity in highlight are the main challenges in High Dynamic Range (LDR) imaging.
We propose a joint HDR and denoising pipeline, containing two sub-networks.
We create the first joint HDR and denoising benchmark dataset.
arXiv Detail & Related papers (2022-06-20T07:49:56Z) - Hierarchical Similarity Learning for Aliasing Suppression Image
Super-Resolution [64.15915577164894]
A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing.
HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
arXiv Detail & Related papers (2022-06-07T14:55:32Z) - A Differentiable Two-stage Alignment Scheme for Burst Image
Reconstruction with Large Shift [13.454711511086261]
Joint denoising and demosaicking (JDD) for burst images, namely JDD-B, has attracted much attention.
One key challenge of JDD-B lies in the robust alignment of image frames.
We propose a differentiable two-stage alignment scheme sequentially in patch and pixel level for effective JDD-B.
arXiv Detail & Related papers (2022-03-17T12:55:45Z) - The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors.
We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS.
To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
arXiv Detail & Related papers (2020-05-16T08:17:44Z) - Single-Image HDR Reconstruction by Learning to Reverse the Camera
Pipeline [100.5353614588565]
We propose to incorporate the domain knowledge of the LDR image formation pipeline into our model.
We model the HDRto-LDR image formation pipeline as the (1) dynamic range clipping, (2) non-linear mapping from a camera response function, and (3) quantization.
We demonstrate that the proposed method performs favorably against state-of-the-art single-image HDR reconstruction algorithms.
arXiv Detail & Related papers (2020-04-02T17:59:04Z) - PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of
Generative Models [77.32079593577821]
PULSE (Photo Upsampling via Latent Space Exploration) generates high-resolution, realistic images at resolutions previously unseen in the literature.
Our method outperforms state-of-the-art methods in perceptual quality at higher resolutions and scale factors than previously possible.
arXiv Detail & Related papers (2020-03-08T16:44:31Z) - Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
We propose a dual-branch convolutional neural network to extract base features and recovered features separately.
By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
arXiv Detail & Related papers (2020-03-02T13:28:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.