Learning to Deblur using Light Field Generated and Real Defocus Images

• URL: http://arxiv.org/abs/2204.00367v1
• Date: Fri, 1 Apr 2022 11:35:51 GMT
• Title: Learning to Deblur using Light Field Generated and Real Defocus Images
• Authors: Lingyan Ruan, Bin Chen, Jizhou Li, Miuling Lam
• Abstract summary: Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. We propose a novel deep defocus deblurring network that leverages the strength and overcomes the shortcoming of light fields.
• Score: 4.926805108788465
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. While deep learning approach shows great promise in solving image restoration problems, defocus deblurring demands accurate training data that consists of all-in-focus and defocus image pairs, which is difficult to collect. Naive two-shot capturing cannot achieve pixel-wise correspondence between the defocused and all-in-focus image pairs. Synthetic aperture of light fields is suggested to be a more reliable way to generate accurate image pairs. However, the defocus blur generated from light field data is different from that of the images captured with a traditional digital camera. In this paper, we propose a novel deep defocus deblurring network that leverages the strength and overcomes the shortcoming of light fields. We first train the network on a light field-generated dataset for its highly accurate image correspondence. Then, we fine-tune the network using feature loss on another dataset collected by the two-shot method to alleviate the differences between the defocus blur exists in the two domains. This strategy is proved to be highly effective and able to achieve the state-of-the-art performance both quantitatively and qualitatively on multiple test sets. Extensive ablation studies have been conducted to analyze the effect of each network module to the final performance.

Related papers

• Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs [65.25002116216771]
  We introduce a reblurring-guided learning framework for single image defocus deblurring. Our reblurring module ensures spatial consistency between the deblurred image, the reblurred image and the input blurry image. We have collected a new dataset specifically for single image defocus deblurring with typical misalignments.
  arXiv  Detail & Related papers  (2024-09-26T12:37:50Z)
• Towards Real-World Focus Stacking with Deep Learning [97.34754533628322]
  We introduce a new dataset consisting of 94 high-resolution bursts of raw images with focus bracketing. This dataset is used to train the first deep learning algorithm for focus stacking capable of handling bursts of sufficient length for real-world applications.
  arXiv  Detail & Related papers  (2023-11-29T17:49:33Z)
• Learning Single Image Defocus Deblurring with Misaligned Training Pairs [80.13320797431487]
  We propose a joint deblurring and reblurring learning framework for single image defocus deblurring. Our framework can be applied to boost defocus deblurring networks in terms of both quantitative metrics and visual quality.
  arXiv  Detail & Related papers  (2022-11-26T07:36:33Z)
• Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild [9.246199263116067]
  We propose a novel defocus deblurring method that uses the guidance of the defocus map to implement image deblurring. The proposed method consists of a learnable blur kernel to estimate the defocus map, and a single-image defocus deblurring generative adversarial network (DefocusGAN) for the first time.
  arXiv  Detail & Related papers  (2022-11-25T10:47:19Z)
• Multi-task Learning for Monocular Depth and Defocus Estimations with Real Images [3.682618267671887]
  Most existing methods treat depth estimation and defocus estimation as two separate tasks, ignoring the strong connection between them. We propose a multi-task learning network consisting of an encoder with two decoders to estimate the depth and defocus map from a single focused image. Our depth and defocus estimations achieve significantly better performance than other state-of-art algorithms.
  arXiv  Detail & Related papers  (2022-08-21T08:59:56Z)
• Single-image Defocus Deblurring by Integration of Defocus Map Prediction Tracing the Inverse Problem Computation [25.438654895178686]
  We propose a simple but effective network with spatial modulation based on the defocus map. Experimental results show that our method can achieve better quantitative and qualitative evaluation performance than the existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-07-07T02:15:33Z)
• Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image [54.10957300181677]
  We present a method that takes as input a single dual-pixel image, and simultaneously estimates the image's defocus map. Our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.
  arXiv  Detail & Related papers  (2021-10-12T00:09:07Z)
• Single image deep defocus estimation and its applications [82.93345261434943]
  We train a deep neural network to classify image patches into one of the 20 levels of blurriness. The trained model is used to determine the patch blurriness which is then refined by applying an iterative weighted guided filter. The result is a defocus map that carries the information of the degree of blurriness for each pixel.
  arXiv  Detail & Related papers  (2021-07-30T06:18:16Z)
• Defocus Blur Detection via Salient Region Detection Prior [11.5253648614748]
  Defocus blur Detection aims to separate the out-of-focus and depth-of-field areas in photos. We propose a novel network for defocus blur detection.
  arXiv  Detail & Related papers  (2020-11-19T05:56:11Z)
• Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing [57.90239401665367]
  Whole slide imaging (WSI) is an emerging technology for digital pathology. We propose the concept of textitvirtual autofocusing, which does not rely on mechanical adjustment to conduct refocusing.
  arXiv  Detail & Related papers  (2020-03-14T13:40:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.