What's Wrong with the Absolute Trajectory Error?

• URL: http://arxiv.org/abs/2212.05376v5
• Date: Mon, 9 Sep 2024 19:28:16 GMT
• Title: What's Wrong with the Absolute Trajectory Error?
• Authors: Seong Hun Lee, Javier Civera,
• Abstract summary: In this work, we propose an alternative error metric for evaluating the accuracy of the reconstructed camera trajectory. Our metric, named Discernible Trajectory Error (DTE), is computed in five steps. We also propose a novel rotation error metric, named Discernible Rotation Error (DRE), which has similar advantages to the DTE.
• Score: 14.533304890042361
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: One of the limitations of the commonly used Absolute Trajectory Error (ATE) is that it is highly sensitive to outliers. As a result, in the presence of just a few outliers, it often fails to reflect the varying accuracy as the inlier trajectory error or the number of outliers varies. In this work, we propose an alternative error metric for evaluating the accuracy of the reconstructed camera trajectory. Our metric, named Discernible Trajectory Error (DTE), is computed in five steps: (1) Shift the ground-truth and estimated trajectories such that both of their geometric medians are located at the origin. (2) Rotate the estimated trajectory such that it minimizes the sum of geodesic distances between the corresponding camera orientations. (3) Scale the estimated trajectory such that the median distance of the cameras to their geometric median is the same as that of the ground truth. (4) Compute, winsorize and normalize the distances between the corresponding cameras. (5) Obtain the DTE by taking the average of the mean and the root-mean-square (RMS) of the resulting distances. This metric is an attractive alternative to the ATE, in that it is capable of discerning the varying trajectory accuracy as the inlier trajectory error or the number of outliers varies. Using the similar idea, we also propose a novel rotation error metric, named Discernible Rotation Error (DRE), which has similar advantages to the DTE. Furthermore, we propose a simple yet effective method for calibrating the camera-to-marker rotation, which is needed for the computation of our metrics. Our methods are verified through extensive simulations.

Related papers

• Alignment Scores: Robust Metrics for Multiview Pose Accuracy Evaluation [14.533304890042361]
  We propose three novel metrics for evaluating the accuracy of a set of estimated camera poses. The Translation Alignment Score (TAS) evaluates the translation accuracy independently of the rotations. The Rotation Alignment Score (RAS) evaluates the rotation accuracy independently of the translations. The Pose Alignment Score (PAS) is the average of the two scores.
  arXiv  Detail & Related papers  (2024-07-29T19:34:23Z)
• Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction [82.72686460985297]
  We tackle the problem of estimating a Manhattan frame. We derive two new 2-line solvers, one of which does not suffer from singularities affecting existing solvers. We also design a new non-minimal method, running on an arbitrary number of lines, to boost the performance in local optimization.
  arXiv  Detail & Related papers  (2023-08-21T13:03:25Z)
• A Probabilistic Transformation of Distance-Based Outliers [2.1055643409860743]
  We describe a generic transformation of distance-based outlier scores into interpretable, probabilistic estimates. The transformation is ranking-stable and increases the contrast between normal and outlier data points. Our work generalizes to a wide range of distance-based outlier detection methods.
  arXiv  Detail & Related papers  (2023-05-16T14:05:30Z)
• LMR: Lane Distance-Based Metric for Trajectory Prediction [10.83642398981694]
  Currently established metrics are based on Euclidean distance, which means that errors are weighted equally in all directions. We propose a new metric that is lane distance-based: Lane Miss Rate (LMR) LMR is defined as the ratio of sequences that yield a miss.
  arXiv  Detail & Related papers  (2023-04-12T13:59:04Z)
• Detecting Rotated Objects as Gaussian Distributions and Its 3-D Generalization [81.29406957201458]
  Existing detection methods commonly use a parameterized bounding box (BBox) to model and detect (horizontal) objects. We argue that such a mechanism has fundamental limitations in building an effective regression loss for rotation detection. We propose to model the rotated objects as Gaussian distributions. We extend our approach from 2-D to 3-D with a tailored algorithm design to handle the heading estimation.
  arXiv  Detail & Related papers  (2022-09-22T07:50:48Z)
• TomoSLAM: factor graph optimization for rotation angle refinement in microtomography [0.0]
  Relative trajectories of a sample, a detector, and a signal source are traditionally considered to be known. Due to mechanical backlashes, rotation sensor measurement errors, thermal deformations real trajectory differs from desired ones. The scientific novelty of this work is to consider the problem of trajectory refinement in microtomography as a SLAM problem.
  arXiv  Detail & Related papers  (2021-11-10T08:00:46Z)
• Feature Space Targeted Attacks by Statistic Alignment [74.40447383387574]
  Feature space targeted attacks perturb images by modulating their intermediate feature maps. The current choice of pixel-wise Euclidean Distance to measure the discrepancy is questionable because it unreasonably imposes a spatial-consistency constraint on the source and target features. We propose two novel approaches called Pair-wise Alignment Attack and Global-wise Alignment Attack, which attempt to measure similarities between feature maps by high-order statistics.
  arXiv  Detail & Related papers  (2021-05-25T03:46:39Z)
• Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss [111.8807588392563]
  Boundary discontinuity and its inconsistency to the final detection metric have been the bottleneck for rotating detection regression loss design. We propose a novel regression loss based on Gaussian Wasserstein distance as a fundamental approach to solve the problem.
  arXiv  Detail & Related papers  (2021-01-28T12:04:35Z)
• Globally Optimal Relative Pose Estimation with Gravity Prior [63.74377065002315]
  Smartphones, tablets and camera systems used, e.g., in cars and UAVs, are typically equipped with IMUs that can measure the gravity vector accurately. We propose a novel globally optimal solver, minimizing the algebraic error in the least-squares sense, to estimate the relative pose in the over-determined pose. The proposed solvers are compared with the state-of-the-art ones on four real-world datasets with approx. 50000 image pairs in total.
  arXiv  Detail & Related papers  (2020-12-01T13:09:59Z)
• Robust 6D Object Pose Estimation by Learning RGB-D Features [59.580366107770764]
  We propose a novel discrete-continuous formulation for rotation regression to resolve this local-optimum problem. We uniformly sample rotation anchors in SO(3), and predict a constrained deviation from each anchor to the target, as well as uncertainty scores for selecting the best prediction. Experiments on two benchmarks: LINEMOD and YCB-Video, show that the proposed method outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-02-29T06:24:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.