Affine Correspondences between Multi-Camera Systems for Relative Pose Estimation

• URL: http://arxiv.org/abs/2306.12996v1
• Date: Thu, 22 Jun 2023 15:52:48 GMT
• Title: Affine Correspondences between Multi-Camera Systems for Relative Pose Estimation
• Authors: Banglei Guan and Ji Zhao
• Abstract summary: We present a novel method to compute the relative pose of multi-camera systems using two affine correspondences (ACs) This paper shows that the 6DOF relative pose estimation problem using ACs permits a feasible minimal solution. Experiments on both virtual and real multi-camera systems prove that the proposed solvers are more efficient than the state-of-the-art algorithms.
• Score: 11.282703971318934
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a novel method to compute the relative pose of multi-camera systems using two affine correspondences (ACs). Existing solutions to the multi-camera relative pose estimation are either restricted to special cases of motion, have too high computational complexity, or require too many point correspondences (PCs). Thus, these solvers impede an efficient or accurate relative pose estimation when applying RANSAC as a robust estimator. This paper shows that the 6DOF relative pose estimation problem using ACs permits a feasible minimal solution, when exploiting the geometric constraints between ACs and multi-camera systems using a special parameterization. We present a problem formulation based on two ACs that encompass two common types of ACs across two views, i.e., inter-camera and intra-camera. Moreover, the framework for generating the minimal solvers can be extended to solve various relative pose estimation problems, e.g., 5DOF relative pose estimation with known rotation angle prior. Experiments on both virtual and real multi-camera systems prove that the proposed solvers are more efficient than the state-of-the-art algorithms, while resulting in a better relative pose accuracy. Source code is available at https://github.com/jizhaox/relpose-mcs-depth.

Related papers

• SRPose: Two-view Relative Pose Estimation with Sparse Keypoints [51.49105161103385]
  SRPose is a sparse keypoint-based framework for two-view relative pose estimation in camera-to-world and object-to-camera scenarios. It achieves competitive or superior performance compared to state-of-the-art methods in terms of accuracy and speed. It is robust to different image sizes and camera intrinsics, and can be deployed with low computing resources.
  arXiv  Detail & Related papers  (2024-07-11T05:46:35Z)
• DVMNet: Computing Relative Pose for Unseen Objects Beyond Hypotheses [59.51874686414509]
  Current approaches approximate the continuous pose representation with a large number of discrete pose hypotheses. We present a Deep Voxel Matching Network (DVMNet) that eliminates the need for pose hypotheses and computes the relative object pose in a single pass. Our method delivers more accurate relative pose estimates for novel objects at a lower computational cost compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-03-20T15:41:32Z)
• Six-Point Method for Multi-Camera Systems with Reduced Solution Space [27.08230698158933]
  We present several minimal solvers that use six PCs to compute the 6DOF relative pose of multi-camera systems. Ray bundle constraints are found and proven when a subset of PCs relate the same cameras across two views. Tests demonstrate the superior accuracy and efficiency of our solvers compared to state-of-the-art six-point methods.
  arXiv  Detail & Related papers  (2024-02-28T05:52:25Z)
• DeepI2P: Image-to-Point Cloud Registration via Deep Classification [71.3121124994105]
  DeepI2P is a novel approach for cross-modality registration between an image and a point cloud. Our method estimates the relative rigid transformation between the coordinate frames of the camera and Lidar. We circumvent the difficulty by converting the registration problem into a classification and inverse camera projection optimization problem.
  arXiv  Detail & Related papers  (2021-04-08T04:27:32Z)
• Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
  We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera. The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
  arXiv  Detail & Related papers  (2021-03-11T08:56:24Z)
• On Relative Pose Recovery for Multi-Camera Systems [7.494426244735998]
  We propose a complete solution to relative pose estimation from two ACs for multi-camera systems. The solver generation is based on Cayley or quaternion parameterization for rotation and hidden variable technique to eliminate translation. The proposed AC-based solvers and PC-based solvers are effective and efficient on synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2021-02-24T00:39:57Z)
• Minimal Cases for Computing the Generalized Relative Pose using Affine Correspondences [41.35179046936236]
  We propose three novel solvers for estimating the relative pose of a multi-camera system from affine correspondences (ACs) It is shown that the accuracy of the estimated poses is superior to the state-of-the-art techniques.
  arXiv  Detail & Related papers  (2020-07-21T10:34:45Z)
• Relative Pose from Deep Learned Depth and a Single Affine Correspondence [37.04516812025321]
  We propose a new approach for combining deep-learned non-metric monocular depth with affine correspondences. Considering the depth information and affine features, two new constraints on the camera pose are derived. The proposed solver is usable within 1-point RANSAC approaches.
  arXiv  Detail & Related papers  (2020-07-20T13:24:28Z)
• Relative Pose Estimation of Calibrated Cameras with Known $\mathrm{SE}(3)$ Invariants [65.2314683780204]
  We present a complete study of the relative pose estimation problem for a camera constrained by known $mathrmSE(3)$ invariants. These problems reduces the minimal number of point pairs for relative pose estimation. Experiments on synthetic and real data shows performance improvement compared to conventional relative pose estimation methods.
  arXiv  Detail & Related papers  (2020-07-15T13:55:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.