Geometric Scene Refocusing

• URL: http://arxiv.org/abs/2012.10856v1
• Date: Sun, 20 Dec 2020 06:33:55 GMT
• Title: Geometric Scene Refocusing
• Authors: Parikshit Sakurikar, P. J. Narayanan
• Abstract summary: We study the fine characteristics of images with a shallow depth-of-field in the context of focal stacks. We identify in-focus pixels, dual-focus pixels, pixels that exhibit bokeh and spatially-varying blur kernels between focal slices. We present a comprehensive algorithm for post-capture refocusing in a geometrically correct manner.
• Score: 9.198471344145092
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: An image captured with a wide-aperture camera exhibits a finite depth-of-field, with focused and defocused pixels. A compact and robust representation of focus and defocus helps analyze and manipulate such images. In this work, we study the fine characteristics of images with a shallow depth-of-field in the context of focal stacks. We present a composite measure for focus that is a combination of existing measures. We identify in-focus pixels, dual-focus pixels, pixels that exhibit bokeh and spatially-varying blur kernels between focal slices. We use these to build a novel representation that facilitates easy manipulation of focal stacks. We present a comprehensive algorithm for post-capture refocusing in a geometrically correct manner. Our approach can refocus the scene at high fidelity while preserving fine aspects of focus and defocus blur.

Related papers

• Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs [65.25002116216771]
  We introduce a reblurring-guided learning framework for single image defocus deblurring. Our reblurring module ensures spatial consistency between the deblurred image, the reblurred image and the input blurry image. We have collected a new dataset specifically for single image defocus deblurring with typical misalignments.
  arXiv  Detail & Related papers  (2024-09-26T12:37:50Z)
• Towards Real-World Focus Stacking with Deep Learning [97.34754533628322]
  We introduce a new dataset consisting of 94 high-resolution bursts of raw images with focus bracketing. This dataset is used to train the first deep learning algorithm for focus stacking capable of handling bursts of sufficient length for real-world applications.
  arXiv  Detail & Related papers  (2023-11-29T17:49:33Z)
• Learning Depth from Focus in the Wild [16.27391171541217]
  We present a convolutional neural network-based depth estimation from single focal stacks. Our method allows depth maps to be inferred in an end-to-end manner even with image alignment. For the generalization of the proposed network, we develop a simulator to realistically reproduce the features of commercial cameras.
  arXiv  Detail & Related papers  (2022-07-20T05:23:29Z)
• Learning to Deblur using Light Field Generated and Real Defocus Images [4.926805108788465]
  Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. We propose a novel deep defocus deblurring network that leverages the strength and overcomes the shortcoming of light fields.
  arXiv  Detail & Related papers  (2022-04-01T11:35:51Z)
• Precise Point Spread Function Estimation [6.076995573805468]
  We develop a precise mathematical model of the camera's point spread function to describe the defocus process. Our experiments on standard planes and actual objects show that the proposed algorithm can accurately describe the defocus process.
  arXiv  Detail & Related papers  (2022-03-06T12:43:27Z)
• Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image [54.10957300181677]
  We present a method that takes as input a single dual-pixel image, and simultaneously estimates the image's defocus map. Our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.
  arXiv  Detail & Related papers  (2021-10-12T00:09:07Z)
• Selective Light Field Refocusing for Camera Arrays Using Bokeh Rendering and Superresolution [27.944215174962995]
  We propose a light field refocusing method to improve the imaging quality of camera arrays. In our method, the unfocused region (bokeh) is rendered by using a depth-based anisotropic filter. Our method achieves superior visual performance with acceptable computational cost as compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-08-09T10:19:21Z)
• Single image deep defocus estimation and its applications [82.93345261434943]
  We train a deep neural network to classify image patches into one of the 20 levels of blurriness. The trained model is used to determine the patch blurriness which is then refined by applying an iterative weighted guided filter. The result is a defocus map that carries the information of the degree of blurriness for each pixel.
  arXiv  Detail & Related papers  (2021-07-30T06:18:16Z)
• An End-to-End Autofocus Camera for Iris on the Move [48.14011526385088]
  In this paper, we introduce a novel rapid autofocus camera for active refocusing of the iris area ofthe moving objects using a focus-tunable lens. Our end-to-end computational algorithm can predict the best focus position from one single blurred image and generate a lens diopter control signal automatically. The results demonstrate the advantages of our proposed camera for biometric perception in static and dynamic scenes.
  arXiv  Detail & Related papers  (2021-06-29T03:00:39Z)
• Defocus Blur Detection via Depth Distillation [64.78779830554731]
  We introduce depth information into DBD for the first time. In detail, we learn the defocus blur from ground truth and the depth distilled from a well-trained depth estimation network. Our approach outperforms 11 other state-of-the-art methods on two popular datasets.
  arXiv  Detail & Related papers  (2020-07-16T04:58:09Z)
• Defocus Deblurring Using Dual-Pixel Data [41.201653787083735]
  Defocus blur arises in images that are captured with a shallow depth of field due to the use of a wide aperture. We propose an effective defocus deblurring method that exploits data available on dual-pixel (DP) sensors found on most modern cameras.
  arXiv  Detail & Related papers  (2020-05-01T10:38:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.