Learning to Deblur Polarized Images
- URL: http://arxiv.org/abs/2402.18134v1
- Date: Wed, 28 Feb 2024 07:56:28 GMT
- Title: Learning to Deblur Polarized Images
- Authors: Chu Zhou, Minggui Teng, Xinyu Zhou, Chao Xu, Boxin Sh
- Abstract summary: A polarization camera can capture four polarized images with different polarizer angles in a single shot.
The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images.
We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
- Score: 15.415804124776846
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A polarization camera can capture four polarized images with different
polarizer angles in a single shot, which is useful in polarization-based vision
applications since the degree of polarization (DoP) and the angle of
polarization (AoP) can be directly computed from the captured polarized images.
However, since the on-chip micro-polarizers block part of the light so that the
sensor often requires a longer exposure time, the captured polarized images are
prone to motion blur caused by camera shakes, leading to noticeable degradation
in the computed DoP and AoP. Deblurring methods for conventional images often
show degenerated performance when handling the polarized images since they only
focus on deblurring without considering the polarization constrains. In this
paper, we propose a polarized image deblurring pipeline to solve the problem in
a polarization-aware manner by adopting a divide-and-conquer strategy to
explicitly decompose the problem into two less ill-posed sub-problems, and
design a two-stage neural network to handle the two sub-problems respectively.
Experimental results show that our method achieves state-of-the-art performance
on both synthetic and real-world images, and can improve the performance of
polarization-based vision applications such as image dehazing and reflection
removal.
Related papers
- Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored.
This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer.
Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
arXiv Detail & Related papers (2024-06-17T09:48:54Z) - Mitigating Framing Bias with Polarity Minimization Loss [56.24404488440295]
Framing bias plays a significant role in exacerbating political polarization by distorting the perception of actual events.
We propose a new loss function that encourages the model to minimize the polarity difference between the polarized input articles to reduce framing bias.
arXiv Detail & Related papers (2023-11-03T09:50:23Z) - PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
We present PARTNER, a novel 3D object detector in the polar coordinate.
Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
arXiv Detail & Related papers (2023-08-08T01:59:20Z) - Fooling Polarization-based Vision using Locally Controllable Polarizing Projection [55.40484331029597]
We warn the community of the vulnerability of polarization-based vision, which can be more serious than RGB-based vision.
By adapting a commercial LCD projector, we achieve locally controllable polarizing projection, which is successfully utilized to fool state-of-the-art polarization-based vision algorithms.
arXiv Detail & Related papers (2023-03-31T08:48:57Z) - Polarized Color Image Denoising using Pocoformer [42.171036556122644]
Polarized color photography provides both visual textures and object surficial information in one snapshot.
The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging.
We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
arXiv Detail & Related papers (2022-07-01T05:52:14Z) - Human Pose and Shape Estimation from Single Polarization Images [45.24275141578927]
We attempt to estimate human pose and shape from single polarization images by leveraging the polarization-induced geometric cues.
A dedicated dataset (PHSPD) is constructed, consisting of over 500K frames with accurate pose and shape annotations.
It suggests polarization camera as a promising alternative to the more conventional RGB camera for human pose and shape estimation.
arXiv Detail & Related papers (2021-08-15T22:56:18Z) - Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images.
We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image.
We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
arXiv Detail & Related papers (2021-05-12T17:35:10Z) - All-optical input-agnostic polarization transformer via experimental
Kraus-map control [0.0]
We experimentally demonstrate an all-optical input-agnostic polarization transformer (AI-APT)
It transforms all input states of polarization to a particular state that can be polarized or partially polarized.
The AI-APT is completely passive, and thus can be used as a polarization controller or stabilizer for single photons and ultrafast pulses.
arXiv Detail & Related papers (2021-03-09T12:39:47Z) - Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual
Interpolation [14.5106375775521]
A microgrid image polarimeter enables us to acquire a set of polarization images in one shot.
Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array, the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images.
We propose a novel MPFA demosaicking method based on edge-aware residual (EARI) and also extend it to CPFA demosaicking.
arXiv Detail & Related papers (2020-07-28T15:04:36Z) - From two rolling shutters to one global shutter [57.431998188805665]
We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion.
Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion.
We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions.
arXiv Detail & Related papers (2020-06-02T22:18:43Z) - Polarized Reflection Removal with Perfect Alignment in the Wild [66.48211204364142]
We present a novel formulation to removing reflection from polarized images in the wild.
We first identify the misalignment issues of existing reflection removal datasets.
We build a new dataset with more than 100 types of glass in which obtained transmission images are perfectly aligned with input mixed images.
arXiv Detail & Related papers (2020-03-28T13:29:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.