Fast Two-step Blind Optical Aberration Correction

• URL: http://arxiv.org/abs/2208.00950v1
• Date: Mon, 1 Aug 2022 16:04:46 GMT
• Title: Fast Two-step Blind Optical Aberration Correction
• Authors: Thomas Eboli and Jean-Michel Morel and Gabriele Facciolo
• Abstract summary: We propose a two-step scheme to correct optical aberrations in a single raw or JPEG image. First, we estimate local Gaussian blur kernels for overlapping patches and sharpen them with a non-blind deblurring technique. Second, we remove the remaining lateral chromatic aberrations with a convolutional neural network.
• Score: 15.555393702795076
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The optics of any camera degrades the sharpness of photographs, which is a key visual quality criterion. This degradation is characterized by the point-spread function (PSF), which depends on the wavelengths of light and is variable across the imaging field. In this paper, we propose a two-step scheme to correct optical aberrations in a single raw or JPEG image, i.e., without any prior information on the camera or lens. First, we estimate local Gaussian blur kernels for overlapping patches and sharpen them with a non-blind deblurring technique. Based on the measurements of the PSFs of dozens of lenses, these blur kernels are modeled as RGB Gaussians defined by seven parameters. Second, we remove the remaining lateral chromatic aberrations (not contemplated in the first step) with a convolutional neural network, trained to minimize the red/green and blue/green residual images. Experiments on both synthetic and real images show that the combination of these two stages yields a fast state-of-the-art blind optical aberration compensation technique that competes with commercial non-blind algorithms.

Related papers

• MonoPCC: Photometric-invariant Cycle Constraint for Monocular Depth Estimation of Endoscopic Images [20.439758719616048]
  Photometric constraint is indispensable for self-supervised monocular depth estimation. Built-in light causes significant brightness fluctuations, making photometric constraint unreliable. We propose MonoPCC to address the brightness inconsistency radically by reshaping the photometric constraint into a cycle form.
  arXiv  Detail & Related papers  (2024-04-25T12:34:23Z)
• Classification robustness to common optical aberrations [64.08840063305313]
  This paper proposes OpticsBench, a benchmark for investigating robustness to realistic, practically relevant optical blur effects. Experiments on ImageNet show that for a variety of different pre-trained DNNs, the performance varies strongly compared to disk-shaped kernels. We show on ImageNet-100 with OpticsAugment that can be increased by using optical kernels as data augmentation.
  arXiv  Detail & Related papers  (2023-08-29T08:36:00Z)
• Frequency-Aware Self-Supervised Monocular Depth Estimation [41.97188738587212]
  We present two versatile methods to enhance self-supervised monocular depth estimation models. The high generalizability of our methods is achieved by solving the fundamental and ubiquitous problems in photometric loss function. We are the first to propose blurring images to improve depth estimators with an interpretable analysis.
  arXiv  Detail & Related papers  (2022-10-11T14:30:26Z)
• Learning Enriched Illuminants for Cross and Single Sensor Color Constancy [182.4997117953705]
  We propose cross-sensor self-supervised training to train the network. We train the network by randomly sampling the artificial illuminants in a sensor-independent manner. Experiments show that our cross-sensor model and single-sensor model outperform other state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2022-03-21T15:45:35Z)
• Light Lies: Optical Adversarial Attack [24.831391763610046]
  This paper introduces an optical adversarial attack, which physically alters the light field information arriving at the image sensor so that the classification model yields misclassification. We present experiments based on both simulation and a real hardware optical system, from which the feasibility of the proposed optical attack is demonstrated.
  arXiv  Detail & Related papers  (2021-06-18T04:20:49Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo [61.6260594326246]
  We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously. Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
  arXiv  Detail & Related papers  (2021-03-22T18:06:58Z)
• Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy [6.09170287691728]
  We present a method that improves the resolution of light microscopy images of thin, yet non-flat objects. We estimate the parameters of a spatially-variant Point-Spread function (PSF) model using a Convolutional Neural Network (CNN) Our method recovers PSF parameters from the image itself with up to a squared Pearson correlation coefficient of 0.99 in ideal conditions.
  arXiv  Detail & Related papers  (2020-10-08T14:20:16Z)
• Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics [72.9038524082252]
  We propose a compact single-shot monocular hyperspectral-depth (HS-D) imaging method. Our method uses a diffractive optical element (DOE), the point spread function of which changes with respect to both depth and spectrum. To facilitate learning the DOE, we present a first HS-D dataset by building a benchtop HS-D imager.
  arXiv  Detail & Related papers  (2020-09-01T14:19:35Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Identification of splicing edges in tampered image based on Dichromatic Reflection Model [11.757875734469398]
  manipulation against an original image will destroy these signatures and inevitably leave some traces in the final forgery. We present a novel optic-physical method to discriminate splicing edges from natural edges in a tampered image.
  arXiv  Detail & Related papers  (2020-04-09T01:25:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.