Single-image Defocus Deblurring by Integration of Defocus Map Prediction Tracing the Inverse Problem Computation

• URL: http://arxiv.org/abs/2207.03047v1
• Date: Thu, 7 Jul 2022 02:15:33 GMT
• Title: Single-image Defocus Deblurring by Integration of Defocus Map Prediction Tracing the Inverse Problem Computation
• Authors: Qian Ye, Masanori Suganuma, Takayuki Okatani
• Abstract summary: We propose a simple but effective network with spatial modulation based on the defocus map. Experimental results show that our method can achieve better quantitative and qualitative evaluation performance than the existing state-of-the-art methods.
• Score: 25.438654895178686
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we consider the problem in defocus image deblurring. Previous classical methods follow two-steps approaches, i.e., first defocus map estimation and then the non-blind deblurring. In the era of deep learning, some researchers have tried to address these two problems by CNN. However, the simple concatenation of defocus map, which represents the blur level, leads to suboptimal performance. Considering the spatial variant property of the defocus blur and the blur level indicated in the defocus map, we employ the defocus map as conditional guidance to adjust the features from the input blurring images instead of simple concatenation. Then we propose a simple but effective network with spatial modulation based on the defocus map. To achieve this, we design a network consisting of three sub-networks, including the defocus map estimation network, a condition network that encodes the defocus map into condition features, and the defocus deblurring network that performs spatially dynamic modulation based on the condition features. Moreover, the spatially dynamic modulation is based on an affine transform function to adjust the features from the input blurry images. Experimental results show that our method can achieve better quantitative and qualitative evaluation performance than the existing state-of-the-art methods on the commonly used public test datasets.

Related papers

• Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs [65.25002116216771]
  We introduce a reblurring-guided learning framework for single image defocus deblurring. Our reblurring module ensures spatial consistency between the deblurred image, the reblurred image and the input blurry image. We have collected a new dataset specifically for single image defocus deblurring with typical misalignments.
  arXiv  Detail & Related papers  (2024-09-26T12:37:50Z)
• FocusTune: Tuning Visual Localization through Focus-Guided Sampling [61.79440120153917]
  FocusTune is a focus-guided sampling technique to improve the performance of visual localization algorithms. We demonstrate that FocusTune both improves or matches state-of-the-art performance whilst keeping ACE's appealing low storage and compute requirements. This combination of high performance and low compute and storage requirements is particularly promising for applications in areas like mobile robotics and augmented reality.
  arXiv  Detail & Related papers  (2023-11-06T04:58:47Z)
• Learning Single Image Defocus Deblurring with Misaligned Training Pairs [80.13320797431487]
  We propose a joint deblurring and reblurring learning framework for single image defocus deblurring. Our framework can be applied to boost defocus deblurring networks in terms of both quantitative metrics and visual quality.
  arXiv  Detail & Related papers  (2022-11-26T07:36:33Z)
• Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild [9.246199263116067]
  We propose a novel defocus deblurring method that uses the guidance of the defocus map to implement image deblurring. The proposed method consists of a learnable blur kernel to estimate the defocus map, and a single-image defocus deblurring generative adversarial network (DefocusGAN) for the first time.
  arXiv  Detail & Related papers  (2022-11-25T10:47:19Z)
• Learning to Deblur using Light Field Generated and Real Defocus Images [4.926805108788465]
  Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. We propose a novel deep defocus deblurring network that leverages the strength and overcomes the shortcoming of light fields.
  arXiv  Detail & Related papers  (2022-04-01T11:35:51Z)
• Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image [54.10957300181677]
  We present a method that takes as input a single dual-pixel image, and simultaneously estimates the image's defocus map. Our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.
  arXiv  Detail & Related papers  (2021-10-12T00:09:07Z)
• Single image deep defocus estimation and its applications [82.93345261434943]
  We train a deep neural network to classify image patches into one of the 20 levels of blurriness. The trained model is used to determine the patch blurriness which is then refined by applying an iterative weighted guided filter. The result is a defocus map that carries the information of the degree of blurriness for each pixel.
  arXiv  Detail & Related papers  (2021-07-30T06:18:16Z)
• Learning to Estimate Kernel Scale and Orientation of Defocus Blur with Asymmetric Coded Aperture [19.472377706422474]
  Consistent in-focus input imagery is an essential precondition for machine vision systems to perceive the dynamic environment. A defocus blur severely degrades the performance of vision systems. We propose a deep-learning-based framework estimating the kernel scale and orientation of the defocus blur to adjust lens focus rapidly.
  arXiv  Detail & Related papers  (2021-03-10T03:12:15Z)
• Defocus Blur Detection via Salient Region Detection Prior [11.5253648614748]
  Defocus blur Detection aims to separate the out-of-focus and depth-of-field areas in photos. We propose a novel network for defocus blur detection.
  arXiv  Detail & Related papers  (2020-11-19T05:56:11Z)
• Rapid Whole Slide Imaging via Learning-based Two-shot Virtual Autofocusing [57.90239401665367]
  Whole slide imaging (WSI) is an emerging technology for digital pathology. We propose the concept of textitvirtual autofocusing, which does not rely on mechanical adjustment to conduct refocusing.
  arXiv  Detail & Related papers  (2020-03-14T13:40:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.