Exploration of Whether Skylight Polarization Patterns Contain
Three-dimensional Attitude Information
- URL: http://arxiv.org/abs/2012.09154v1
- Date: Mon, 30 Nov 2020 12:10:29 GMT
- Title: Exploration of Whether Skylight Polarization Patterns Contain
Three-dimensional Attitude Information
- Authors: Huaju Liang, Hongyang Bai and Tong Zhou
- Abstract summary: Social spider optimization (SSO) method is proposed to estimate three angles.
The results of simulation show that the algorithm can estimate 3D attitude and the established sky model contains 3D attitude information.
- Score: 2.6641834518599308
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Our previous work has demonstrated that Rayleigh model, which is widely used
in polarized skylight navigation to describe skylight polarization patterns,
does not contain three-dimensional (3D) attitude information [1]. However, it
is still necessary to further explore whether the skylight polarization
patterns contain 3D attitude information. So, in this paper, a social spider
optimization (SSO) method is proposed to estimate three Euler angles, which
considers the difference of each pixel among polarization images based on
template matching (TM) to make full use of the captured polarization
information. In addition, to explore this problem, we not only use angle of
polarization (AOP) and degree of polarization (DOP) information, but also the
light intensity (LI) information. So, a sky model is established, which
combines Berry model and Hosek model to fully describe AOP, DOP, and LI
information in the sky, and considers the influence of four neutral points,
ground albedo, atmospheric turbidity, and wavelength. The results of simulation
show that the SSO algorithm can estimate 3D attitude and the established sky
model contains 3D attitude information. However, when there are measurement
noise or model error, the accuracy of 3D attitude estimation drops
significantly. Especially in field experiment, it is very difficult to estimate
3D attitude. Finally, the results are discussed in detail.
Related papers
- Polarimetric Information for Multi-Modal 6D Pose Estimation of
Photometrically Challenging Objects with Limited Data [51.95347650131366]
6D pose estimation pipelines that rely on RGB-only or RGB-D data show limitations for photometrically challenging objects.
A supervised learning-based method utilising complementary polarisation information is proposed to overcome such limitations.
arXiv Detail & Related papers (2023-08-21T10:56:00Z) - Polarimetric Multi-View Inverse Rendering [13.391866136230165]
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) and the degree of polarization (DoP) of reflected light are related to an object's surface normal.
We propose a novel 3D reconstruction method called Polarimetric Multi-View Inverse Rendering (Polarimetric MVIR) that effectively exploits geometric, photometric, and polarimetric cues extracted from input multi-view color-polarization images.
arXiv Detail & Related papers (2022-12-24T12:12:12Z) - Perspective Phase Angle Model for Polarimetric 3D Reconstruction [9.314026710009122]
We present the perspective phase angle (PPA) model that is applicable to perspective cameras.
Compared with the orthographic model, the proposed PPA model accurately describes the relationship between polarization phase angle and surface normal under perspective projection.
Experiments on real data show that the PPA model is more accurate for surface normal estimation with a perspective camera than the orthographic model.
arXiv Detail & Related papers (2022-07-20T03:11:30Z) - PolarFormer: Multi-camera 3D Object Detection with Polar Transformers [93.49713023975727]
3D object detection in autonomous driving aims to reason "what" and "where" the objects of interest present in a 3D world.
Existing methods often adopt the canonical Cartesian coordinate system with perpendicular axis.
We propose a new Polar Transformer (PolarFormer) for more accurate 3D object detection in the bird's-eye-view (BEV) taking as input only multi-camera 2D images.
arXiv Detail & Related papers (2022-06-30T16:32:48Z) - 3D Magic Mirror: Clothing Reconstruction from a Single Image via a
Causal Perspective [96.65476492200648]
This research aims to study a self-supervised 3D clothing reconstruction method.
It recovers the geometry shape, and texture of human clothing from a single 2D image.
arXiv Detail & Related papers (2022-04-27T17:46:55Z) - Shape from Polarization for Complex Scenes in the Wild [93.65746187211958]
We present a new data-driven approach with physics-based priors to scene-level normal estimation from a single polarization image.
We contribute the first real-world scene-level SfP dataset with paired input polarization images and ground-truth normal maps.
Our trained model can be generalized to far-field outdoor scenes as the relationship between polarized light and surface normals is not affected by distance.
arXiv Detail & Related papers (2021-12-21T17:30:23Z) - A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware
Image Synthesis [163.96778522283967]
We propose a shading-guided generative implicit model that is able to learn a starkly improved shape representation.
An accurate 3D shape should also yield a realistic rendering under different lighting conditions.
Our experiments on multiple datasets show that the proposed approach achieves photorealistic 3D-aware image synthesis.
arXiv Detail & Related papers (2021-10-29T10:53:12Z) - Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo [103.08512487830669]
We present a modern solution to the multi-view photometric stereo problem (MVPS)
We procure the surface orientation using a photometric stereo (PS) image formation model and blend it with a multi-view neural radiance field representation to recover the object's surface geometry.
Our method performs neural rendering of multi-view images while utilizing surface normals estimated by a deep photometric stereo network.
arXiv Detail & Related papers (2021-10-11T20:20:03Z) - Deep Polarization Imaging for 3D shape and SVBRDF Acquisition [7.86578678811226]
We present a novel method for efficient acquisition of shape and spatially varying reflectance of 3D objects using polarization cues.
Unlike previous works that have exploited polarization to estimate material or object appearance under certain constraints, we lift such restrictions by coupling polarization imaging with deep learning.
We demonstrate our approach to achieve superior results compared to recent works employing deep learning in conjunction with flash illumination.
arXiv Detail & Related papers (2021-05-06T17:58:43Z) - Polarimetric Multi-View Inverse Rendering [13.391866136230165]
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal.
We propose a novel 3D reconstruction method called Polarimetric Multi-View Inverse Rendering (Polarimetric MVIR) that exploits geometric, photometric, and polarimetric cues extracted from input multi-view color polarization images.
arXiv Detail & Related papers (2020-07-17T09:00:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.