Minimal Solutions for Panoramic Stitching Given Gravity Prior

• URL: http://arxiv.org/abs/2012.00465v1
• Date: Tue, 1 Dec 2020 13:17:36 GMT
• Title: Minimal Solutions for Panoramic Stitching Given Gravity Prior
• Authors: Yaqing Ding, Daniel Barath, Zuzana Kukelova
• Abstract summary: We propose new minimal solutions to panoramic image stitching of images taken by cameras with coinciding optical centers. We consider four practical camera configurations, assuming unknown fixed or varying focal length with or without radial distortion. The solvers are tested both on synthetic scenes and on more than 500k real image pairs from the Sun360 dataset and from scenes captured by us using two smartphones equipped with IMUs.
• Score: 53.047330182598124
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: When capturing panoramas, people tend to align their cameras with the vertical axis, i.e., the direction of gravity. Moreover, modern devices, such as smartphones and tablets, are equipped with an IMU (Inertial Measurement Unit) that can measure the gravity vector accurately. Using this prior, the y-axes of the cameras can be aligned or assumed to be already aligned, reducing their relative orientation to 1-DOF (degree of freedom). Exploiting this assumption, we propose new minimal solutions to panoramic image stitching of images taken by cameras with coinciding optical centers, i.e., undergoing pure rotation. We consider four practical camera configurations, assuming unknown fixed or varying focal length with or without radial distortion. The solvers are tested both on synthetic scenes and on more than 500k real image pairs from the Sun360 dataset and from scenes captured by us using two smartphones equipped with IMUs. It is shown, that they outperform the state-of-the-art both in terms of accuracy and processing time.

Related papers

• Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction [82.72686460985297]
  We tackle the problem of estimating a Manhattan frame. We derive two new 2-line solvers, one of which does not suffer from singularities affecting existing solvers. We also design a new non-minimal method, running on an arbitrary number of lines, to boost the performance in local optimization.
  arXiv  Detail & Related papers  (2023-08-21T13:03:25Z)
• Balancing the Budget: Feature Selection and Tracking for Multi-Camera Visual-Inertial Odometry [3.441021278275805]
  We present a multi-camera visual-inertial odometry system based on factor graph optimization. We focus on motion tracking in challenging environments such as in narrow corridors and dark spaces with aggressive motions and abrupt lighting changes.
  arXiv  Detail & Related papers  (2021-09-13T13:53:09Z)
• Calibration Method of the Monocular Omnidirectional Stereo Camera [0.0]
  We develop an omnidirectional stereo camera exploiting two hyperbolic mirrors and a single set of a lens and sensor. We establish a new calibration method for this camera considering higher-order radial distortion, detailed tangential distortion, an image sensor tilt, and a lens-mirror offset. The random error of the distance measurement is 4.9% and the systematic error is 5.7% up to objects 14 meters apart, which is improved almost nine times compared to the conventional method.
  arXiv  Detail & Related papers  (2021-08-18T02:07:58Z)
• Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
  We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera. The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
  arXiv  Detail & Related papers  (2021-03-11T08:56:24Z)
• Globally Optimal Relative Pose Estimation with Gravity Prior [63.74377065002315]
  Smartphones, tablets and camera systems used, e.g., in cars and UAVs, are typically equipped with IMUs that can measure the gravity vector accurately. We propose a novel globally optimal solver, minimizing the algebraic error in the least-squares sense, to estimate the relative pose in the over-determined pose. The proposed solvers are compared with the state-of-the-art ones on four real-world datasets with approx. 50000 image pairs in total.
  arXiv  Detail & Related papers  (2020-12-01T13:09:59Z)
• From two rolling shutters to one global shutter [57.431998188805665]
  We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion. Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion. We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions.
  arXiv  Detail & Related papers  (2020-06-02T22:18:43Z)
• Minimal Rolling Shutter Absolute Pose with Unknown Focal Length and Radial Distortion [41.237097915374115]
  We present the first minimal solutions for the absolute pose of a rolling shutter camera with unknown rolling shutter parameters, focal length, and radial distortion. Our new solvers provide accurate estimates of the camera pose, rolling shutter parameters, focal length, and radial distortion parameters.
  arXiv  Detail & Related papers  (2020-04-29T10:03:03Z)
• Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials [65.95928593628128]
  We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique. Our algorithm is suitable for perspective cameras and nearby point light sources.
  arXiv  Detail & Related papers  (2020-01-18T12:26:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.