Mobile Image Restoration via Prior Quantization
- URL: http://arxiv.org/abs/2305.05899v1
- Date: Wed, 10 May 2023 05:05:58 GMT
- Title: Mobile Image Restoration via Prior Quantization
- Authors: Shiqi Chen, Jinwen Zhou, Menghao Li, Yueting Chen, Tingting Jiang
- Abstract summary: We propose a prior quantization model to correct the optical aberrations in image processing systems.
Our model promises to analyze the correlation between the various priors and the optical aberration of devices.
- Score: 15.577548135102404
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In digital images, the performance of optical aberration is a multivariate
degradation, where the spectral of the scene, the lens imperfections, and the
field of view together contribute to the results. Besides eliminating it at the
hardware level, the post-processing system, which utilizes various prior
information, is significant for correction. However, due to the content
differences among priors, the pipeline that aligns these factors shows limited
efficiency and unoptimized restoration. Here, we propose a prior quantization
model to correct the optical aberrations in image processing systems. To
integrate these messages, we encode various priors into a latent space and
quantify them by the learnable codebooks. After quantization, the prior codes
are fused with the image restoration branch to realize targeted optical
aberration correction. Comprehensive experiments demonstrate the flexibility of
the proposed method and validate its potential to accomplish targeted
restoration for a specific camera. Furthermore, our model promises to analyze
the correlation between the various priors and the optical aberration of
devices, which is helpful for joint soft-hardware design.
Related papers
- Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors [52.195637608631955]
Non-line-of-sight (NLOS) imaging has attracted increasing attention due to its potential applications.
Existing NLOS reconstruction approaches are constrained by the reliance on empirical physical priors.
We introduce a novel learning-based solution, comprising two key designs: Learnable Path Compensation (LPC) and Adaptive Phasor Field (APF)
arXiv Detail & Related papers (2024-09-21T04:39:45Z) - CodeEnhance: A Codebook-Driven Approach for Low-Light Image Enhancement [97.95330185793358]
Low-light image enhancement (LLIE) aims to improve low-illumination images.
Existing methods face two challenges: uncertainty in restoration from diverse brightness degradations and loss of texture and color information.
We propose a novel enhancement approach, CodeEnhance, by leveraging quantized priors and image refinement.
arXiv Detail & Related papers (2024-04-08T07:34:39Z) - AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulation [99.57024606542416]
We propose an adaptive all-in-one image restoration network based on frequency mining and modulation.
Our approach is motivated by the observation that different degradation types impact the image content on different frequency subbands.
The proposed model achieves adaptive reconstruction by accentuating the informative frequency subbands according to different input degradations.
arXiv Detail & Related papers (2024-03-21T17:58:14Z) - Revealing the preference for correcting separated aberrations in joint
optic-image design [19.852225245159598]
We characterize the optics with separated aberrations to achieve efficient joint design of complex systems such as smartphones and drones.
An image simulation system is presented to reproduce the genuine imaging procedure of lenses with large field-of-views.
Experiments reveal that the preference for correcting separated aberrations in joint design is as follows: longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, field curvature, and coma, with astigmatism coming last.
arXiv Detail & Related papers (2023-09-08T14:12:03Z) - Computational Optics for Mobile Terminals in Mass Production [17.413494778377565]
We construct the perturbed lens system model to illustrate the relationship between the system parameters and the deviated frequency response measured from photographs.
An optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs.
Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the aberration-based algorithms.
arXiv Detail & Related papers (2023-05-10T04:17:33Z) - Optical Aberration Correction in Postprocessing using Imaging Simulation [17.331939025195478]
The popularity of mobile photography continues to grow.
Recent cameras have shifted some of these correction tasks from optical design to postprocessing systems.
We propose a practical method for recovering the degradation caused by optical aberrations.
arXiv Detail & Related papers (2023-05-10T03:20:39Z) - Neural Invertible Variable-degree Optical Aberrations Correction [6.6855248718044225]
We propose a novel aberration correction method with an invertible architecture by leveraging its information-lossless property.
Within the architecture, we develop conditional invertible blocks to allow the processing of aberrations with variable degrees.
Our method is evaluated on both a synthetic dataset from physics-based imaging simulation and a real captured dataset.
arXiv Detail & Related papers (2023-04-12T01:56:42Z) - Spatially-Adaptive Image Restoration using Distortion-Guided Networks [51.89245800461537]
We present a learning-based solution for restoring images suffering from spatially-varying degradations.
We propose SPAIR, a network design that harnesses distortion-localization information and dynamically adjusts to difficult regions in the image.
arXiv Detail & Related papers (2021-08-19T11:02:25Z) - Universal and Flexible Optical Aberration Correction Using Deep-Prior
Based Deconvolution [51.274657266928315]
We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors.
Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
arXiv Detail & Related papers (2021-04-07T12:00:38Z) - Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and
Pixel Exposures for Compressive Imaging Systems [56.154190098338965]
We show that our proposed time multiplexed coded aperture (TMCA) can be optimized end-to-end.
TMCA induces better coded snapshots enabling superior reconstructions in two different applications: compressive light field imaging and hyperspectral imaging.
This codification outperforms the state-of-the-art compressive imaging systems by more than 4dB in those applications.
arXiv Detail & Related papers (2021-04-06T22:42:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.