Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

• URL: http://arxiv.org/abs/2007.14292v1
• Date: Tue, 28 Jul 2020 15:04:36 GMT
• Title: Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation
• Authors: Miki Morimatsu, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi
• Abstract summary: A microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array, the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. We propose a novel MPFA demosaicking method based on edge-aware residual (EARI) and also extend it to CPFA demosaicking.
• Score: 14.5106375775521
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A division-of-focal-plane or microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array (MPFA or CPFA), the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images. In this paper, we propose a novel MPFA demosaicking method based on edge-aware residual interpolation (EARI) and also extend it to CPFA demosaicking. The key of EARI is a new edge detector for generating an effective guide image used to interpolate the missing pixel values. We also present a newly constructed full color-polarization image dataset captured using a 3-CCD camera and a rotating polarizer. Using the dataset, we experimentally demonstrate that our EARI-based method outperforms existing methods in MPFA and CPFA demosaicking.

Related papers

• Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement [71.13353154514418]
  Low-light image enhancement, particularly in cross-domain tasks such as mapping from the raw domain to the sRGB domain, remains a significant challenge. We present a novel Mamba scanning mechanism, called RAWMamba, to effectively handle raw images with different CFAs. We also present a Retinex Decomposition Module (RDM) grounded in Retinex prior, which decouples illumination from reflectance to facilitate more effective denoising and automatic non-linear exposure correction.
  arXiv  Detail & Related papers  (2024-09-11T06:12:03Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• Video Frame Interpolation for Polarization via Swin-Transformer [9.10220649654041]
  Video Frame Interpolation (VFI) has been extensively explored and demonstrated, yet its application to polarization remains largely unexplored. This study proposes a multi-stage and multi-scale network called Swin-VFI based on the Swin-Transformer. Experimental results demonstrate our approach's superior reconstruction accuracy across all tasks.
  arXiv  Detail & Related papers  (2024-06-17T09:48:54Z)
• Learning to Deblur Polarized Images [15.415804124776846]
  A polarization camera can capture four polarized images with different polarizer angles in a single shot. The degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images. We propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner.
  arXiv  Detail & Related papers  (2024-02-28T07:56:28Z)
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
  We present PARTNER, a novel 3D object detector in the polar coordinate. Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
  arXiv  Detail & Related papers  (2023-08-08T01:59:20Z)
• Enhancing Low-Light Images Using Infrared-Encoded Images [81.8710581927427]
  Previous arts mainly focus on the low-light images captured in the visible spectrum using pixel-wise loss. We propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter.
  arXiv  Detail & Related papers  (2023-07-09T08:29:19Z)
• Deep Demosaicing for Polarimetric Filter Array Cameras [7.39819574829298]
  We propose a novel CNN-based model which directly demosaics the raw camera image to a per-pixel Stokes vector. We introduce a new method, employing a consumer LCD screen, to effectively acquire real-world data for training.
  arXiv  Detail & Related papers  (2022-11-24T17:41:50Z)
• Polarized Color Image Denoising using Pocoformer [42.171036556122644]
  Polarized color photography provides both visual textures and object surficial information in one snapshot. The use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. We propose a learning-based approach to simultaneously restore clean signals and precise polarization information.
  arXiv  Detail & Related papers  (2022-07-01T05:52:14Z)
• Deep Snapshot HDR Reconstruction Based on the Polarization Camera [3.534261120716916]
  On-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images. We study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image. We propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images.
  arXiv  Detail & Related papers  (2021-05-12T17:35:10Z)
• Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials [65.95928593628128]
  We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique. Our algorithm is suitable for perspective cameras and nearby point light sources.
  arXiv  Detail & Related papers  (2020-01-18T12:26:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.