Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual
Interpolation
- URL: http://arxiv.org/abs/2007.14292v1
- Date: Tue, 28 Jul 2020 15:04:36 GMT
- Title: Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual
Interpolation
- Authors: Miki Morimatsu, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi
- Abstract summary: A microgrid image polarimeter enables us to acquire a set of polarization images in one shot.
Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array, the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images.
We propose a novel MPFA demosaicking method based on edge-aware residual (EARI) and also extend it to CPFA demosaicking.
- Score: 14.5106375775521
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A division-of-focal-plane or microgrid image polarimeter enables us to
acquire a set of polarization images in one shot. Since the polarimeter
consists of an image sensor equipped with a monochrome or color polarization
filter array (MPFA or CPFA), the demosaicking process to interpolate missing
pixel values plays a crucial role in obtaining high-quality polarization
images. In this paper, we propose a novel MPFA demosaicking method based on
edge-aware residual interpolation (EARI) and also extend it to CPFA
demosaicking. The key of EARI is a new edge detector for generating an
effective guide image used to interpolate the missing pixel values. We also
present a newly constructed full color-polarization image dataset captured
using a 3-CCD camera and a rotating polarizer. Using the dataset, we
experimentally demonstrate that our EARI-based method outperforms existing
methods in MPFA and CPFA demosaicking.
Related papers
- Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored.
This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer.
Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
arXiv Detail & Related papers (2024-06-17T09:48:54Z) - Robust Depth Enhancement via Polarization Prompt Fusion Tuning [112.88371907047396]
We present a framework that leverages polarization imaging to improve inaccurate depth measurements from various depth sensors.
Our method first adopts a learning-based strategy where a neural network is trained to estimate a dense and complete depth map from polarization data and a sensor depth map from different sensors.
To further improve the performance, we propose a Polarization Prompt Fusion Tuning (PPFT) strategy to effectively utilize RGB-based models pre-trained on large-scale datasets.
arXiv Detail & Related papers (2024-04-05T17:55:33Z) - Learning to Deblur Polarized Images [15.415804124776846]
A polarization camera can capture four polarized images with different polarizer angles in a single shot.
The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images.
We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
arXiv Detail & Related papers (2024-02-28T07:56:28Z) - PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
We present PARTNER, a novel 3D object detector in the polar coordinate.
Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
arXiv Detail & Related papers (2023-08-08T01:59:20Z) - Enhancing Low-Light Images Using Infrared-Encoded Images [81.8710581927427]
Previous arts mainly focus on the low-light images captured in the visible spectrum using pixel-wise loss.
We propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter.
arXiv Detail & Related papers (2023-07-09T08:29:19Z) - Deep Demosaicing for Polarimetric Filter Array Cameras [7.39819574829298]
We propose a novel CNN-based model which directly demosaics the raw camera image to a per-pixel Stokes vector.
We introduce a new method, employing a consumer LCD screen, to effectively acquire real-world data for training.
arXiv Detail & Related papers (2022-11-24T17:41:50Z) - Polarized Color Image Denoising using Pocoformer [42.171036556122644]
Polarized color photography provides both visual textures and object surficial information in one snapshot.
The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging.
We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
arXiv Detail & Related papers (2022-07-01T05:52:14Z) - Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images.
We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image.
We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
arXiv Detail & Related papers (2021-05-12T17:35:10Z) - A learning-based view extrapolation method for axial super-resolution [52.748944517480155]
Axial light field resolution refers to the ability to distinguish features at different depths by refocusing.
We propose a learning-based method to extrapolate novel views from axial volumes of sheared epipolar plane images.
arXiv Detail & Related papers (2021-03-11T07:22:13Z) - Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset
for Spatially Varying Isotropic Materials [65.95928593628128]
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique.
Our algorithm is suitable for perspective cameras and nearby point light sources.
arXiv Detail & Related papers (2020-01-18T12:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.