DRHDR: A Dual branch Residual Network for Multi-Bracket High Dynamic Range Imaging

• URL: http://arxiv.org/abs/2206.04124v1
• Date: Wed, 8 Jun 2022 18:46:54 GMT
• Title: DRHDR: A Dual branch Residual Network for Multi-Bracket High Dynamic Range Imaging
• Authors: Juan Mar\'in-Vega, Michael Sloth, Peter Schneider-Kamp, Richard R\"ottger
• Abstract summary: We introduce DR, a Dual branch Residual Convolutional Neural Network for Multi-Bracket HDR Imaging. By using a dual branch approach we are able to achieve high quality results while constraining the computational resources required to estimate the HDR results.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce DRHDR, a Dual branch Residual Convolutional Neural Network for Multi-Bracket HDR Imaging. To address the challenges of fusing multiple brackets from dynamic scenes, we propose an efficient dual branch network that operates on two different resolutions. The full resolution branch uses a Deformable Convolutional Block to align features and retain high-frequency details. A low resolution branch with a Spatial Attention Block aims to attend wanted areas from the non-reference brackets, and suppress displaced features that could incur on ghosting artifacts. By using a dual branch approach we are able to achieve high quality results while constraining the computational resources required to estimate the HDR results.

Related papers

• The Devil is in the Details: Boosting Guided Depth Super-Resolution via Rethinking Cross-Modal Alignment and Aggregation [41.12790340577986]
  Guided depth super-resolution (GDSR) involves restoring missing depth details using the high-resolution RGB image of the same scene. Previous approaches have struggled with the heterogeneity and complementarity of the multi-modal inputs, and neglected the issues of modal misalignment, geometrical misalignment, and feature selection.
  arXiv  Detail & Related papers  (2024-01-16T05:37:08Z)
• Dual Residual Attention Network for Image Denoising [19.978731146465822]
  In image denoising, deep convolutional neural networks (CNNs) can obtain favorable performance on removing spatially invariant noise. We propose a novel Dual-branch Residual Attention Network (DRANet) for image denoising. Our DRANet can produce competitive denoising performance both on synthetic and real-world noise removal.
  arXiv  Detail & Related papers  (2023-05-07T13:11:55Z)
• SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked Autoencoders [97.64072440883392]
  We propose a novel semi-supervised approach to realize few-shot HDR imaging via two stages of training, called SSHDR. Unlikely previous methods, directly recovering content and removing ghosts simultaneously, which is hard to achieve optimum. Experiments demonstrate that SSHDR outperforms state-of-the-art methods quantitatively and qualitatively within and across different datasets.
  arXiv  Detail & Related papers  (2023-04-14T03:42:51Z)
• Gated Multi-Resolution Transfer Network for Burst Restoration and Enhancement [75.25451566988565]
  We propose a novel Gated Multi-Resolution Transfer Network (GMTNet) to reconstruct a spatially precise high-quality image from a burst of low-quality raw images. Detailed experimental analysis on five datasets validates our approach and sets a state-of-the-art for burst super-resolution, burst denoising, and low-light burst enhancement.
  arXiv  Detail & Related papers  (2023-04-13T17:54:00Z)
• SJ-HD^2R: Selective Joint High Dynamic Range and Denoising Imaging for Dynamic Scenes [17.867412310873732]
  Ghosting artifacts, motion blur, and low fidelity in highlight are the main challenges in High Dynamic Range (LDR) imaging. We propose a joint HDR and denoising pipeline, containing two sub-networks. We create the first joint HDR and denoising benchmark dataset.
  arXiv  Detail & Related papers  (2022-06-20T07:49:56Z)
• Progressive and Selective Fusion Network for High Dynamic Range Imaging [28.639647755164916]
  This paper considers the problem of generating an HDR image of a scene from its LDR images. Recent studies employ deep learning and solve the problem in an end-to-end fashion, leading to significant performance improvements. We propose a novel method that can better fuse the features based on two ideas. One is multi-step feature fusion; our network gradually fuses the features in a stack of blocks having the same structure.
  arXiv  Detail & Related papers  (2021-08-19T09:42:03Z)
• Crosslink-Net: Double-branch Encoder Segmentation Network via Fusing Vertical and Horizontal Convolutions [58.71117402626524]
  We present a novel double-branch encoder architecture for medical image segmentation. Our architecture is inspired by two observations: 1) Since the discrimination of features learned via square convolutional kernels needs to be further improved, we propose to utilize non-square vertical and horizontal convolutional kernels. The experiments validate the effectiveness of our model on four datasets.
  arXiv  Detail & Related papers  (2021-07-24T02:58:32Z)
• Multi-Attention Generative Adversarial Network for Remote Sensing Image Super-Resolution [17.04588012373861]
  Image super-resolution (SR) methods can generate remote sensing images with high spatial resolution without increasing the cost. We propose a network based on the generative adversarial network (GAN) to generate high resolution remote sensing images.
  arXiv  Detail & Related papers  (2021-07-14T08:06:19Z)
• Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline [100.5353614588565]
  We propose to incorporate the domain knowledge of the LDR image formation pipeline into our model. We model the HDRto-LDR image formation pipeline as the (1) dynamic range clipping, (2) non-linear mapping from a camera response function, and (3) quantization. We demonstrate that the proposed method performs favorably against state-of-the-art single-image HDR reconstruction algorithms.
  arXiv  Detail & Related papers  (2020-04-02T17:59:04Z)
• Gated Fusion Network for Degraded Image Super Resolution [78.67168802945069]
  We propose a dual-branch convolutional neural network to extract base features and recovered features separately. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process.
  arXiv  Detail & Related papers  (2020-03-02T13:28:32Z)
• DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution [69.2432352477966]
  Real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR. Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair.
  arXiv  Detail & Related papers  (2020-02-25T18:24:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.