Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

• URL: http://arxiv.org/abs/2202.13055v1
• Date: Sat, 26 Feb 2022 04:21:08 GMT
• Title: Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance
• Authors: Yuki Fujimura and Masaaki Iiyama and Takuya Funatomi and Yasuhiro Mukaigawa
• Abstract summary: We propose a learning-based depth from focus/defocus (DFF) which takes a focal stack as input for estimating scene depth. We show that our method is robust against a synthetic-to-real domain gap, and exhibits state-of-the-art performance.
• Score: 19.460887007137607
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a learning-based depth from focus/defocus (DFF), which takes a focal stack as input for estimating scene depth. Defocus blur is a useful cue for depth estimation. However, the size of the blur depends on not only scene depth but also camera settings such as focus distance, focal length, and f-number. Current learning-based methods without any defocus models cannot estimate a correct depth map if camera settings are different at training and test times. Our method takes a plane sweep volume as input for the constraint between scene depth, defocus images, and camera settings, and this intermediate representation enables depth estimation with different camera settings at training and test times. This camera-setting invariance can enhance the applicability of learning-based DFF methods. The experimental results also indicate that our method is robust against a synthetic-to-real domain gap, and exhibits state-of-the-art performance.

Related papers

• Camera-Independent Single Image Depth Estimation from Defocus Blur [6.516967182213821]
  We show how several camera-related parameters affect the defocus blur using optical physics equations. We create a synthetic dataset which can be used to test the camera independent performance of depth from defocus blur models.
  arXiv  Detail & Related papers  (2023-11-21T23:14:42Z)
• Blur aware metric depth estimation with multi-focus plenoptic cameras [8.508198765617196]
  We present a new metric depth estimation algorithm using only raw images from a multi-focus plenoptic camera. The proposed approach is especially suited for the multi-focus configuration where several micro-lenses with different focal lengths are used.
  arXiv  Detail & Related papers  (2023-08-08T13:38:50Z)
• FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene [57.26600120397529]
  It has long been an ill-posed problem to predict absolute depth maps from single images in real (unseen) indoor scenes. We develop a focal-and-scale depth estimation model to well learn absolute depth maps from single images in unseen indoor scenes.
  arXiv  Detail & Related papers  (2023-07-27T04:49:36Z)
• Depth and DOF Cues Make A Better Defocus Blur Detector [27.33757097343283]
  Defocus blur detection (DBD) separates in-focus and out-of-focus regions in an image. Previous approaches mistakenly mistook homogeneous areas in focus for defocus blur regions. We propose an approach called D-DFFNet, which incorporates depth and DOF cues in an implicit manner.
  arXiv  Detail & Related papers  (2023-06-20T07:03:37Z)
• Fully Self-Supervised Depth Estimation from Defocus Clue [79.63579768496159]
  We propose a self-supervised framework that estimates depth purely from a sparse focal stack. We show that our framework circumvents the needs for the depth and AIF image ground-truth, and receives superior predictions.
  arXiv  Detail & Related papers  (2023-03-19T19:59:48Z)
• Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervision [10.547816678110417]
  The proposed method can be trained either supervisedly with ground truth depth, or emphunsupervisedly with AiF images as supervisory signals. We show in various experiments that our method outperforms the state-of-the-art methods both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2021-08-24T17:09:13Z)
• Single image deep defocus estimation and its applications [82.93345261434943]
  We train a deep neural network to classify image patches into one of the 20 levels of blurriness. The trained model is used to determine the patch blurriness which is then refined by applying an iterative weighted guided filter. The result is a defocus map that carries the information of the degree of blurriness for each pixel.
  arXiv  Detail & Related papers  (2021-07-30T06:18:16Z)
• An End-to-End Autofocus Camera for Iris on the Move [48.14011526385088]
  In this paper, we introduce a novel rapid autofocus camera for active refocusing of the iris area ofthe moving objects using a focus-tunable lens. Our end-to-end computational algorithm can predict the best focus position from one single blurred image and generate a lens diopter control signal automatically. The results demonstrate the advantages of our proposed camera for biometric perception in static and dynamic scenes.
  arXiv  Detail & Related papers  (2021-06-29T03:00:39Z)
• Defocus Blur Detection via Depth Distillation [64.78779830554731]
  We introduce depth information into DBD for the first time. In detail, we learn the defocus blur from ground truth and the depth distilled from a well-trained depth estimation network. Our approach outperforms 11 other state-of-the-art methods on two popular datasets.
  arXiv  Detail & Related papers  (2020-07-16T04:58:09Z)
• Defocus Deblurring Using Dual-Pixel Data [41.201653787083735]
  Defocus blur arises in images that are captured with a shallow depth of field due to the use of a wide aperture. We propose an effective defocus deblurring method that exploits data available on dual-pixel (DP) sensors found on most modern cameras.
  arXiv  Detail & Related papers  (2020-05-01T10:38:00Z)
• Single Image Depth Estimation Trained via Depth from Defocus Cues [105.67073923825842]
  Estimating depth from a single RGB image is a fundamental task in computer vision. In this work, we rely, instead of different views, on depth from focus cues. We present results that are on par with supervised methods on KITTI and Make3D datasets and outperform unsupervised learning approaches.
  arXiv  Detail & Related papers  (2020-01-14T20:22:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.