Guided Lensless Polarization Imaging

• URL: http://arxiv.org/abs/2603.27357v1
• Date: Sat, 28 Mar 2026 18:09:03 GMT
• Title: Guided Lensless Polarization Imaging
• Abstract summary: Polarization imaging captures the polarization state of light, revealing information invisible to the human eye yet valuable in domains such as biomedical diagnostics, autonomous driving, and remote sensing.<n>We introduce a RGB-guided lensless polarization imaging system that combines a compact polarization-RGB sensor with an auxiliary, widely available conventional RGB camera providing structural guidance.<n>Our two-stage method significantly improves reconstruction quality and fidelity over lensless-only baselines, generalizes across datasets and imaging conditions, and achieves high-quality real-world results on our physical prototype lensless camera without any fine-tuning.
• Score: 26.881165902533326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Polarization imaging captures the polarization state of light, revealing information invisible to the human eye yet valuable in domains such as biomedical diagnostics, autonomous driving, and remote sensing. However, conventional polarization cameras are often expensive, bulky, or both, limiting their practical use. Lensless imaging offers a compact, low-cost alternative by replacing the lens with a simple optical element like a diffuser and performing computational reconstruction, but existing lensless polarization systems suffer from limited reconstruction quality. To overcome these limitations, we introduce a RGB-guided lensless polarization imaging system that combines a compact polarization-RGB sensor with an auxiliary, widely available conventional RGB camera providing structural guidance. We reconstruct multi-angle polarization images for each RGB color channel through a two-stage pipeline: a physics-based inversion recovers an initial polarization image, followed by a Transformer-based fusion network that refines this reconstruction using the RGB guidance image from the conventional RGB camera. Our two-stage method significantly improves reconstruction quality and fidelity over lensless-only baselines, generalizes across datasets and imaging conditions, and achieves high-quality real-world results on our physical prototype lensless camera without any fine-tuning.

Related papers

• High-Resolution Single-Shot Polarimetric Imaging Made Easy [76.04914313843774]
  EasyPolar is a multi-view polarimetric imaging framework.<n>Three synchronized RGB cameras capture one unpolarized view and two polarized views with distinct orientations.<n>A confidence-guided polarization reconstruction network is proposed to address the potential misalignment in multi-view fusion.
  arXiv  Detail & Related papers  (2026-04-07T08:20:58Z)
• A Lensless Polarization Camera [22.93600880518825]
  We propose a compact lensless polarization camera composed of a diffuser and a simple striped polarization mask.<n>By combining this optical design with a reconstruction algorithm that explicitly models the polarization-encoded lensless measurements, four linear polarization images are recovered from a single snapshot.
  arXiv  Detail & Related papers  (2026-03-17T21:39:35Z)
• PolarAnything: Diffusion-based Polarimetric Image Synthesis [59.14294818211059]
  We propose PolarAnything, capable of synthesizing polarization images from a single RGB input with both photorealism and physical accuracy.<n>Experiments show that our model generates high-quality polarization images and supports downstream tasks like shape from polarization.
  arXiv  Detail & Related papers  (2025-07-23T07:09:10Z)
• PIDSR: Complementary Polarized Image Demosaicing and Super-Resolution [63.87900679891159]
  The resolution of a polarization camera is often much lower than that of a conventional RGB camera.<n>Existing polarized image demosaicing (PID) methods are limited in that they cannot enhance resolution.<n>We propose PIDSR, a joint framework that performs complementary Polarized Image Demosaicing and Super-Resolution.
  arXiv  Detail & Related papers  (2025-04-10T13:56:33Z)
• Glossy Object Reconstruction with Cost-effective Polarized Acquisition [41.96986483856648]
  This work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools.<n>The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields.<n>By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques.
  arXiv  Detail & Related papers  (2025-04-09T16:38:51Z)
• Learning to Deblur Polarized Images [59.33932533761383]
  A polarization camera can capture four linear polarized images with different polarizer angles in a single shot.<n>Since the on-chip micro-polarizers block part of the light so that the sensor often requires a longer exposure time, the captured polarized images are prone to motion blur.<n>We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
  On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images. We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image. We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
  arXiv  Detail & Related papers  (2021-05-12T17:35:10Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Tuning IR-cut Filter for Illumination-aware Spectral Reconstruction from RGB [84.1657998542458]
  It has been proven that the reconstruction accuracy relies heavily on the spectral response of the RGB camera in use. This paper explores the filter-array based color imaging mechanism of existing RGB cameras, and proposes to design the IR-cut filter properly for improved spectral recovery.
  arXiv  Detail & Related papers  (2021-03-26T19:42:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.