Computational Optics for Mobile Terminals in Mass Production

• URL: http://arxiv.org/abs/2305.05886v1
• Date: Wed, 10 May 2023 04:17:33 GMT
• Title: Computational Optics for Mobile Terminals in Mass Production
• Authors: Shiqi Chen, Ting Lin, Huajun Feng, Zhihai Xu, Qi Li, Yueting Chen
• Abstract summary: We construct the perturbed lens system model to illustrate the relationship between the system parameters and the deviated frequency response measured from photographs. An optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs. Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the aberration-based algorithms.
• Score: 17.413494778377565
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical degradation. In this work, we systematically construct the perturbed lens system model to illustrate the relationship between the deviated system parameters and the spatial frequency response measured from photographs. To further address this issue, an optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs. Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the learning-based algorithms. In correcting aberration, although promising results have been shown recently with convolutional neural networks, they are hard to generalize to stochastic machining biases. Therefore, we propose a dilated Omni-dimensional dynamic convolution and implement it in post-processing to account for the manufacturing degradation. Extensive experiments which evaluate multiple samples of two representative devices demonstrate that the proposed optimization framework accurately constructs the proxy camera. And the dynamic processing model is well-adapted to manufacturing deviations of different cameras, realizing perfect computational photography. The evaluation shows that the proposed method bridges the gap between optical design, system machining, and post-processing pipeline, shedding light on the joint of image signal reception (lens and sensor) and image signal processing.

Related papers

• The Marginal Importance of Distortions and Alignment in CASSI systems [4.3983517012036994]
  This paper introduces a differentiable ray-tracing based model that incorporates aberrations and distortions to render realistic hyperspectral acquisitions using Coded-Aperture Spectral Snapshot Imagers (CASSI) Four comparable CASSI systems with varying degree of optical aberrations have been designed and modeled. The resulting rendered hyperspectral acquisitions from each of these systems are combined with five state-of-the-art hyperspectral cube reconstruction processes.
  arXiv  Detail & Related papers  (2025-01-22T08:20:53Z)
• Successive optimization of optics and post-processing with differentiable coherent PSF operator and field information [9.527960631238173]
  We introduce a precise optical simulation model, and every operation in pipeline is differentiable. To efficiently address various degradation, we design a joint optimization procedure that leverages field information.
  arXiv  Detail & Related papers  (2024-12-19T07:49:40Z)
• A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization [19.83939112821776]
  End-to-end optimization has emerged as a powerful data-driven method for computational imaging system design. It is challenging to model both aberration and diffraction in light transport for end-to-end optimization of compound optics. We propose a differentiable optics simulator that efficiently models both aberration and diffraction for compound optics.
  arXiv  Detail & Related papers  (2024-12-13T00:57:47Z)
• Cross-Scan Mamba with Masked Training for Robust Spectral Imaging [51.557804095896174]
  We propose the Cross-Scanning Mamba, named CS-Mamba, that employs a Spatial-Spectral SSM for global-local balanced context encoding. Experiment results show that our CS-Mamba achieves state-of-the-art performance and the masked training method can better reconstruct smooth features to improve the visual quality.
  arXiv  Detail & Related papers  (2024-08-01T15:14:10Z)
• Revealing the preference for correcting separated aberrations in joint optic-image design [19.852225245159598]
  We characterize the optics with separated aberrations to achieve efficient joint design of complex systems such as smartphones and drones. An image simulation system is presented to reproduce the genuine imaging procedure of lenses with large field-of-views. Experiments reveal that the preference for correcting separated aberrations in joint design is as follows: longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, field curvature, and coma, with astigmatism coming last.
  arXiv  Detail & Related papers  (2023-09-08T14:12:03Z)
• Optical Aberration Correction in Postprocessing using Imaging Simulation [17.331939025195478]
  The popularity of mobile photography continues to grow. Recent cameras have shifted some of these correction tasks from optical design to postprocessing systems. We propose a practical method for recovering the degradation caused by optical aberrations.
  arXiv  Detail & Related papers  (2023-05-10T03:20:39Z)
• Pixelated Reconstruction of Foreground Density and Background Surface Brightness in Gravitational Lensing Systems using Recurrent Inference Machines [116.33694183176617]
  We use a neural network based on the Recurrent Inference Machine to reconstruct an undistorted image of the background source and the lens mass density distribution as pixelated maps. When compared to more traditional parametric models, the proposed method is significantly more expressive and can reconstruct complex mass distributions.
  arXiv  Detail & Related papers  (2023-01-10T19:00:12Z)
• Retrieving space-dependent polarization transformations via near-optimal quantum process tomography [55.41644538483948]
  We investigate the application of genetic and machine learning approaches to tomographic problems. We find that the neural network-based scheme provides a significant speed-up, that may be critical in applications requiring a characterization in real-time. We expect these results to lay the groundwork for the optimization of tomographic approaches in more general quantum processes.
  arXiv  Detail & Related papers  (2022-10-27T11:37:14Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• SIR: Self-supervised Image Rectification via Seeing the Same Scene from Multiple Different Lenses [82.56853587380168]
  We propose a novel self-supervised image rectification (SIR) method based on an important insight that the rectified results of distorted images of the same scene from different lens should be the same. We leverage a differentiable warping module to generate the rectified images and re-distorted images from the distortion parameters. Our method achieves comparable or even better performance than the supervised baseline method and representative state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-11-30T08:23:25Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.