Alignment Scores: Robust Metrics for Multiview Pose Accuracy Evaluation

• URL: http://arxiv.org/abs/2407.20391v2
• Date: Fri, 2 Aug 2024 21:31:14 GMT
• Title: Alignment Scores: Robust Metrics for Multiview Pose Accuracy Evaluation
• Authors: Seong Hun Lee, Javier Civera,
• Abstract summary: We propose three novel metrics for evaluating the accuracy of a set of estimated camera poses. The Translation Alignment Score (TAS) evaluates the translation accuracy independently of the rotations. The Rotation Alignment Score (RAS) evaluates the rotation accuracy independently of the translations. The Pose Alignment Score (PAS) is the average of the two scores.
• Score: 14.533304890042361
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose three novel metrics for evaluating the accuracy of a set of estimated camera poses given the ground truth: Translation Alignment Score (TAS), Rotation Alignment Score (RAS), and Pose Alignment Score (PAS). The TAS evaluates the translation accuracy independently of the rotations, and the RAS evaluates the rotation accuracy independently of the translations. The PAS is the average of the two scores, evaluating the combined accuracy of both translations and rotations. The TAS is computed in four steps: (1) Find the upper quartile of the closest-pair-distances, $d$. (2) Align the estimated trajectory to the ground truth using a robust registration method. (3) Collect all distance errors and obtain the cumulative frequencies for multiple thresholds ranging from $0.01d$ to $d$ with a resolution $0.01d$. (4) Add up these cumulative frequencies and normalize them such that the theoretical maximum is 1. The TAS has practical advantages over the existing metrics in that (1) it is robust to outliers and collinear motion, and (2) there is no need to adjust parameters on different datasets. The RAS is computed in a similar manner to the TAS and is also shown to be more robust against outliers than the existing rotation metrics. We verify our claims through extensive simulations and provide in-depth discussion of the strengths and weaknesses of the proposed metrics.

Related papers

• An Accurate and Real-time Relative Pose Estimation from Triple Point-line Images by Decoupling Rotation and Translation [10.05584976985694]
  3D-2D constraints provided by line features have been widely used in Visual Odometry (VO) and Structure-from-Motion (SfM) systems. We propose a novel three-view pose solver based on rotation-translation decoupled estimation.
  arXiv  Detail & Related papers  (2024-03-18T10:21:05Z)
• Incremental Rotation Averaging Revisited and More: A New Rotation Averaging Benchmark [19.315026204511973]
  A new member of the Incremental Rotation Averaging family is introduced, which is termed as IRAv4. A task-specific connected dominating set is extracted to serve as a more reliable and accurate reference for rotation global alignment. This paper presents a new COLMAP-based rotation averaging benchmark that incorporates a cross check between COLMAP and Bundler.
  arXiv  Detail & Related papers  (2023-09-29T01:51:04Z)
• CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame [60.24797081117877]
  We propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates of points as input and transforms local points into rotation-invariant representations. A continuous distribution for 3D rotations based on points is introduced.
  arXiv  Detail & Related papers  (2023-03-06T13:14:10Z)
• End-to-End Page-Level Assessment of Handwritten Text Recognition [69.55992406968495]
  HTR systems increasingly face the end-to-end page-level transcription of a document. Standard metrics do not take into account the inconsistencies that might appear. We propose a two-fold evaluation, where the transcription accuracy and the RO goodness are considered separately.
  arXiv  Detail & Related papers  (2023-01-14T15:43:07Z)
• What's Wrong with the Absolute Trajectory Error? [14.533304890042361]
  In this work, we propose an alternative error metric for evaluating the accuracy of the reconstructed camera trajectory. Our metric, named Discernible Trajectory Error (DTE), is computed in five steps. We also propose a novel rotation error metric, named Discernible Rotation Error (DRE), which has similar advantages to the DTE.
  arXiv  Detail & Related papers  (2022-12-10T23:48:27Z)
• Rapid Person Re-Identification via Sub-space Consistency Regularization [51.76876061721556]
  Person Re-Identification (ReID) matches pedestrians across disjoint cameras. Existing ReID methods adopting real-value feature descriptors have achieved high accuracy, but they are low in efficiency due to the slow Euclidean distance computation. We propose a novel Sub-space Consistency Regularization (SCR) algorithm that can speed up the ReID procedure by 0.25$ times.
  arXiv  Detail & Related papers  (2022-07-13T02:44:05Z)
• Globally Optimal Multi-Scale Monocular Hand-Eye Calibration Using Dual Quaternions [9.287964414592826]
  We present an approach for monocular hand-eye calibration from per-sensor ego-motion based on dual quaternions. Our algorithms are evaluated and compared to state-of-the-art approaches on simulated and real-world data.
  arXiv  Detail & Related papers  (2022-01-12T13:48:04Z)
• Uncertainty-Aware Camera Pose Estimation from Points and Lines [101.03675842534415]
  Perspective-n-Point-and-Line (Pn$PL) aims at fast, accurate and robust camera localizations with respect to a 3D model from 2D-3D feature coordinates.
  arXiv  Detail & Related papers  (2021-07-08T15:19:36Z)
• VSAC: Efficient and Accurate Estimator for H and F [68.65610177368617]
  VSAC is a RANSAC-type robust estimator with a number of novelties. It is significantly faster than all its predecessors and runs on average in 1-2 ms, on a CPU. It is two orders of magnitude faster and yet as precise as MAGSAC++, the currently most accurate estimator of two-view geometry.
  arXiv  Detail & Related papers  (2021-06-18T17:04:57Z)
• Rotation-Only Bundle Adjustment [20.02647320786556]
  We propose a novel method for estimating the global rotations of the cameras independently of their positions and the scene structure. We extend this idea to multiple views, thereby decoupling the rotation estimation from the translation and structure estimation. We perform extensive evaluations on both synthetic and real datasets, demonstrating consistent and significant gains in accuracy when used with the state-of-the-art rotation averaging method.
  arXiv  Detail & Related papers  (2020-11-23T20:57:11Z)
• Robust 6D Object Pose Estimation by Learning RGB-D Features [59.580366107770764]
  We propose a novel discrete-continuous formulation for rotation regression to resolve this local-optimum problem. We uniformly sample rotation anchors in SO(3), and predict a constrained deviation from each anchor to the target, as well as uncertainty scores for selecting the best prediction. Experiments on two benchmarks: LINEMOD and YCB-Video, show that the proposed method outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-02-29T06:24:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.