PIDSR: Complementary Polarized Image Demosaicing and Super-Resolution

• URL: http://arxiv.org/abs/2504.07758v2
• Date: Tue, 22 Apr 2025 13:13:39 GMT
• Title: PIDSR: Complementary Polarized Image Demosaicing and Super-Resolution
• Authors: Shuangfan Zhou, Chu Zhou, Youwei Lyu, Heng Guo, Zhanyu Ma, Boxin Shi, Imari Sato,
• Abstract summary: The resolution of a polarization camera is often much lower than that of a conventional RGB camera.<n>Existing polarized image demosaicing (PID) methods are limited in that they cannot enhance resolution.<n>We propose PIDSR, a joint framework that performs complementary Polarized Image Demosaicing and Super-Resolution.
• Score: 63.87900679891159
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Polarization cameras can capture multiple polarized images with different polarizer angles in a single shot, bringing convenience to polarization-based downstream tasks. However, their direct outputs are color-polarization filter array (CPFA) raw images, requiring demosaicing to reconstruct full-resolution, full-color polarized images; unfortunately, this necessary step introduces artifacts that make polarization-related parameters such as the degree of polarization (DoP) and angle of polarization (AoP) prone to error. Besides, limited by the hardware design, the resolution of a polarization camera is often much lower than that of a conventional RGB camera. Existing polarized image demosaicing (PID) methods are limited in that they cannot enhance resolution, while polarized image super-resolution (PISR) methods, though designed to obtain high-resolution (HR) polarized images from the demosaicing results, tend to retain or even amplify errors in the DoP and AoP introduced by demosaicing artifacts. In this paper, we propose PIDSR, a joint framework that performs complementary Polarized Image Demosaicing and Super-Resolution, showing the ability to robustly obtain high-quality HR polarized images with more accurate DoP and AoP from a CPFA raw image in a direct manner. Experiments show our PIDSR not only achieves state-of-the-art performance on both synthetic and real data, but also facilitates downstream tasks.

Related papers

• Glossy Object Reconstruction with Cost-effective Polarized Acquisition [41.96986483856648]
  This work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools.<n>The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields.<n>By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques.
  arXiv  Detail & Related papers  (2025-04-09T16:38:51Z)
• Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis [14.056265185258534]
  A polarization camera employs a double Bayer-Burst sensor to capture both color and polarization.<n>It demonstrates low light efficiency and low spatial resolution, resulting in increased noise and compromised polarization measurements.<n>Applying burst super-resolution to polarization imaging poses challenges due to the lack of tailored datasets and reliable ground truth noise statistics.<n>This work establishes a benchmark for polarization burst super-resolution and offers critical insights into noise propagation, thereby enhancing polarization image reconstruction.
  arXiv  Detail & Related papers  (2025-03-24T14:17:18Z)
• Learning to Deblur Polarized Images [15.415804124776846]
  A polarization camera can capture four polarized images with different polarizer angles in a single shot. The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images. We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
  We present PARTNER, a novel 3D object detector in the polar coordinate. Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
  arXiv  Detail & Related papers  (2023-08-08T01:59:20Z)
• An Adaptive Method for Camera Attribution under Complex Radial Distortion Corrections [77.34726150561087]
  In-camera or out-camera software/firmware alters the supporting grid of the image so as to hamper PRNU-based camera attribution. Existing solutions to deal with this problem try to invert/estimate the correction using radial transformations parameterized with few variables in order to restrain the computational load. We propose an adaptive algorithm that by dividing the image into concentric annuli is able to deal with sophisticated corrections like those applied out-camera by third party software like Adobe Lightroom, Photoshop, Gimp and PT-Lens.
  arXiv  Detail & Related papers  (2023-02-28T08:44:00Z)
• Polarized Color Image Denoising using Pocoformer [42.171036556122644]
  Polarized color photography provides both visual textures and object surficial information in one snapshot. The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
  arXiv  Detail & Related papers  (2022-07-01T05:52:14Z)
• Deep Polarimetric HDR Reconstruction [6.018211924071185]
  We propose a learning based high-dynamic-range ( HDR) reconstruction method using a polarization camera. Deep Polarimetric HDR Reconstruction (DPHR) is a feature masking mechanism that uses polarimetric cues available from the polarization camera. We demonstrate through both qualitative and quantitative evaluations that the proposed DPHR performs favorably than state-of-the-art HDR reconstruction algorithms.
  arXiv  Detail & Related papers  (2022-03-27T02:28:39Z)
• Human Pose and Shape Estimation from Single Polarization Images [45.24275141578927]
  We attempt to estimate human pose and shape from single polarization images by leveraging the polarization-induced geometric cues. A dedicated dataset (PHSPD) is constructed, consisting of over 500K frames with accurate pose and shape annotations. It suggests polarization camera as a promising alternative to the more conventional RGB camera for human pose and shape estimation.
  arXiv  Detail & Related papers  (2021-08-15T22:56:18Z)
• Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
  On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images. We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image. We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
  arXiv  Detail & Related papers  (2021-05-12T17:35:10Z)
• Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation [14.5106375775521]
  A microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array, the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. We propose a novel MPFA demosaicking method based on edge-aware residual (EARI) and also extend it to CPFA demosaicking.
  arXiv  Detail & Related papers  (2020-07-28T15:04:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.