Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis

• URL: http://arxiv.org/abs/2503.18705v1
• Date: Mon, 24 Mar 2025 14:17:18 GMT
• Title: Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis
• Authors: Inseung Hwang, Kiseok Choi, Hyunho Ha, Min H. Kim,
• Abstract summary: A polarization camera employs a double Bayer-Burst sensor to capture both color and polarization.<n>It demonstrates low light efficiency and low spatial resolution, resulting in increased noise and compromised polarization measurements.<n>Applying burst super-resolution to polarization imaging poses challenges due to the lack of tailored datasets and reliable ground truth noise statistics.<n>This work establishes a benchmark for polarization burst super-resolution and offers critical insights into noise propagation, thereby enhancing polarization image reconstruction.
• Score: 14.056265185258534
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Snapshot polarization imaging calculates polarization states from linearly polarized subimages. To achieve this, a polarization camera employs a double Bayer-patterned sensor to capture both color and polarization. It demonstrates low light efficiency and low spatial resolution, resulting in increased noise and compromised polarization measurements. Although burst super-resolution effectively reduces noise and enhances spatial resolution, applying it to polarization imaging poses challenges due to the lack of tailored datasets and reliable ground truth noise statistics. To address these issues, we introduce PolarNS and PolarBurstSR, two innovative datasets developed specifically for polarization imaging. PolarNS provides characterization of polarization noise statistics, facilitating thorough analysis, while PolarBurstSR functions as a benchmark for burst super-resolution in polarization images. These datasets, collected under various real-world conditions, enable comprehensive evaluation. Additionally, we present a model for analyzing polarization noise to quantify noise propagation, tested on a large dataset captured in a darkroom environment. As part of our application, we compare the latest burst super-resolution models, highlighting the advantages of training tailored to polarization compared to RGB-based methods. This work establishes a benchmark for polarization burst super-resolution and offers critical insights into noise propagation, thereby enhancing polarization image reconstruction.

Related papers

• PIDSR: Complementary Polarized Image Demosaicing and Super-Resolution [63.87900679891159]
  The resolution of a polarization camera is often much lower than that of a conventional RGB camera. Existing polarized image demosaicing (PID) methods are limited in that they cannot enhance resolution. We propose PIDSR, a joint framework that performs complementary Polarized Image Demosaicing and Super-Resolution.
  arXiv  Detail & Related papers  (2025-04-10T13:56:33Z)
• Glossy Object Reconstruction with Cost-effective Polarized Acquisition [41.96986483856648]
  This work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools. The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields. By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques.
  arXiv  Detail & Related papers  (2025-04-09T16:38:51Z)
• Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
  Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer. Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
  arXiv  Detail & Related papers  (2024-06-17T09:48:54Z)
• Learning to Deblur Polarized Images [15.415804124776846]
  A polarization camera can capture four polarized images with different polarizer angles in a single shot. The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images. We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• Towards High-quality HDR Deghosting with Conditional Diffusion Models [88.83729417524823]
  High Dynamic Range (LDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. DNNs still generate ghosting artifacts when LDR images have saturation and large motion. We formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition.
  arXiv  Detail & Related papers  (2023-11-02T01:53:55Z)
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
  We present PARTNER, a novel 3D object detector in the polar coordinate. Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
  arXiv  Detail & Related papers  (2023-08-08T01:59:20Z)
• Polarized Color Image Denoising using Pocoformer [42.171036556122644]
  Polarized color photography provides both visual textures and object surficial information in one snapshot. The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
  arXiv  Detail & Related papers  (2022-07-01T05:52:14Z)
• Deep Polarimetric HDR Reconstruction [6.018211924071185]
  We propose a learning based high-dynamic-range ( HDR) reconstruction method using a polarization camera. Deep Polarimetric HDR Reconstruction (DPHR) is a feature masking mechanism that uses polarimetric cues available from the polarization camera. We demonstrate through both qualitative and quantitative evaluations that the proposed DPHR performs favorably than state-of-the-art HDR reconstruction algorithms.
  arXiv  Detail & Related papers  (2022-03-27T02:28:39Z)
• Human Pose and Shape Estimation from Single Polarization Images [45.24275141578927]
  We attempt to estimate human pose and shape from single polarization images by leveraging the polarization-induced geometric cues. A dedicated dataset (PHSPD) is constructed, consisting of over 500K frames with accurate pose and shape annotations. It suggests polarization camera as a promising alternative to the more conventional RGB camera for human pose and shape estimation.
  arXiv  Detail & Related papers  (2021-08-15T22:56:18Z)
• Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
  On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images. We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image. We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
  arXiv  Detail & Related papers  (2021-05-12T17:35:10Z)
• Designing a Practical Degradation Model for Deep Blind Image Super-Resolution [134.9023380383406]
  Single image super-resolution (SISR) methods would not perform well if the assumed degradation model deviates from those in real images. This paper proposes to design a more complex but practical degradation model that consists of randomly shuffled blur, downsampling and noise degradations.
  arXiv  Detail & Related papers  (2021-03-25T17:40:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.