PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applications

• URL: http://arxiv.org/abs/2603.23071v1
• Date: Tue, 24 Mar 2026 11:07:17 GMT
• Title: PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applications
• Abstract summary: Polarimetric imaging enables advanced vision applications such as normal estimation and de-reflection.<n>Existing applications rely on datasets constructed by naively regrouping raw measurements from division-of-focal-plane sensors.<n>We propose PolarAPP, the first framework to jointly optimize demosaicking and its downstream tasks.
• Score: 43.48882461819429
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Polarimetric imaging enables advanced vision applications such as normal estimation and de-reflection by capturing unique surface-material interactions. However, existing applications (alternatively called downstream tasks) rely on datasets constructed by naively regrouping raw measurements from division-of-focal-plane sensors, where pixels of the same polarization angle are extracted and aligned into sparse images without proper demosaicking. This reconstruction strategy results in suboptimal, incomplete targets that limit downstream performance. Moreover, current demosaicking methods are task-agnostic, optimizing only for photometric fidelity rather than utility in downstream tasks. Towards this end, we propose PolarAPP, the first framework to jointly optimize demosaicking and its downstream tasks. PolarAPP introduces a feature alignment mechanism that semantically aligns the representations of demosaicking and downstream networks via meta-learning, guiding the reconstruction to be task-aware. It further employs an equivalent imaging constraint for demosaicking training, enabling direct regression to physically meaningful outputs without relying on rearranged data. Finally, a task-refinement stage fine-tunes the task network using the stable demosaicking front-end to further enhance accuracy. Extensive experimental results demonstrate that PolarAPP outperforms existing methods in both demosaicking quality and downstream performance. Code is available upon acceptance.

Related papers

• Differentiable Polarized Path Tracing [60.271569691679794]
  Physically based differentiable rendering has proven to be a powerful tool for inverse rendering problems.<n>We propose a robust, polarization-aware differentiable path tracing method.<n>This formulation enables efficient and stable optimization of material and lighting parameters in complex scenes.
  arXiv  Detail & Related papers  (2026-07-14T20:58:08Z)
• LCPNet: Latent Consistent Proximal Unfolding Network for Infrared Small Target Detection [50.3892176822492]
  Infrared small target detection (IRSTD) aims to identify long distance small targets from complex infrared backgrounds.<n>Deep learning methods have improved IRSTD by learning discriminative image-to-mask mappings.<n>Deep unfolding methods partially address this issue by embedding model-driven iterations into neural networks.<n>We propose Latent Consistent Proximal unfolding network (LCPNet) to address these limitations.
  arXiv  Detail & Related papers  (2026-07-06T02:15:09Z)
• Need We Teach Foundation Models What is a Generative Image? Gradient-Free Generative Artifact Detection via Analytic Spectral Adaptation [3.881211374324378]
  Adapting foundation models to detect generative artifacts via gradient-based updates compromises their intrinsic representations.<n>We propose a gradient-free methodology reframing detection from binary classification to an out-of-distribution (OOD) anomaly measurement problem.
  arXiv  Detail & Related papers  (2026-06-03T13:04:23Z)
• Self-Supervised Angular Deblurring in Photoacoustic Reconstruction via Noisier2Inverse [2.812291464467386]
  Photoacoustic tomography (PAT) is an emerging imaging modality that combines optical contrast and ultrasonic resolution.<n>We propose a self-supervised reconstruction method based on Noisier2Inverse that addresses finite-size detector effects without requiring ground-truth data.<n>Our approach operates directly on noisy measurements and learns to recover high-quality PAT images in a ground-truth-free manner.
  arXiv  Detail & Related papers  (2026-04-17T04:07:11Z)
• Score-Guided Proximal Projection: A Unified Geometric Framework for Rectified Flow Editing [1.0312968200748118]
  Rectified Flow models achieve state-of-the-art generation quality, yet controlling them for precise tasks remains a challenge.<n>Current approaches bifurcate into inversion-based guidance, which suffers from "geometric locking"<n>We propose Score-Guided Proximal Projection, a unified framework that bridges the gap between deterministic optimization and contraction sampling.
  arXiv  Detail & Related papers  (2026-03-05T23:44:45Z)
• Evaluation of Polarimetric Fusion for Semantic Segmentation in Aquatic Environments [0.764671395172401]
  Polarimetric imaging offers a single-sensor route to mitigate water-surface glare that disrupts semantic segmentation of floating objects.<n>We benchmark state-of-the-art fusion networks on PoTATO, a public dataset of polarimetric images of plastic bottles in inland waterways.
  arXiv  Detail & Related papers  (2025-09-29T12:57:20Z)
• Polarization Denoising and Demosaicking: Dataset and Baseline Method [18.70317918218011]
  A division-of-focal-plane (DoFP) polarimeter enables us to acquire images with multiple polarization orientations in one shot.<n>The image processing pipeline for a DoFP polarimeter entails two crucial tasks: denoising and demosaicking.<n>We propose a novel dataset and method for polarization denoising and demosaicking.
  arXiv  Detail & Related papers  (2025-09-12T09:40:42Z)
• Glossy Object Reconstruction with Cost-effective Polarized Acquisition [41.96986483856648]
  This work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools.<n>The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields.<n>By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques.
  arXiv  Detail & Related papers  (2025-04-09T16:38:51Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
  Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer. Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
  arXiv  Detail & Related papers  (2024-06-17T09:48:54Z)
• DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement [77.0360085530701]
  Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. Previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space.
  arXiv  Detail & Related papers  (2023-12-12T06:07:21Z)
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
  We present PARTNER, a novel 3D object detector in the polar coordinate. Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
  arXiv  Detail & Related papers  (2023-08-08T01:59:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.