HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging

• URL: http://arxiv.org/abs/2607.15912v1
• Date: Fri, 17 Jul 2026 12:40:01 GMT
• Title: HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging
• Abstract summary: Global Structure-from-Motion (SfM) offers advantages over incremental methods in terms of efficiency and error distribution.<n>Many existing methods rely solely on relative translations or feature tracks, which either degrade under collinear camera motion or are susceptible to outliers.<n>We propose a novel hybrid explicit translation averaging framework that incorporates both relative translations and feature tracks.
• Score: 26.8990038810354
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Global Structure-from-Motion (SfM) offers advantages over incremental methods in terms of efficiency and error distribution. However, the task of translation averaging remains challenging. Many existing methods rely solely on relative translations or feature tracks, which either degrade under collinear camera motion or are susceptible to outliers. In this paper, we propose a novel hybrid explicit translation averaging framework that incorporates both relative translations and feature tracks. Specifically, we first refine the relative translations using global camera rotations and remove globally inconsistent relative translations. Next, we employ convex distance-based objective functions to estimate the initial camera positions and 3D points, followed by refinement using a non-bilinear angle-based objective function. Furthermore, since camera rotations are fixed during translation averaging, inaccurate camera rotations can severely limit the accuracy of camera positions. To address this issue, we then robustly refine both camera rotations and camera positions with selected feature tracks through bounded angle-based refinement and subsequent reprojection-based bundle adjustment. In this step, feature tracks are selected to maintain a balanced spatial distribution and improve optimization efficiency. Finally, we perform a complete bundle adjustment using all reliable feature tracks to refine the camera parameters and 3D points. Extensive experiments on various sequential and unordered real-world datasets demonstrate the superior accuracy, robustness, and scalability of our approach, outperforming state-of-the-art methods in both accuracy and computational efficiency.

Related papers

• Geo-Align: Video Generation Alignment via Metric Geometry Reward [53.65904111864641]
  Geo-Align is the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering.<n>Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism.<n>Experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity.
  arXiv  Detail & Related papers  (2026-05-22T17:59:43Z)
• TriDE: Triangle-Consistent Translation Directions for Global Camera Pose Estimation [6.2145524307257665]
  We propose TriDE, which exploits camera-triangle consistency as an efficient higher-order verification signal.<n>Experiments on real image graphs show that TriDE improves direction accuracy by a large margin and yields better downstream camera locations.
  arXiv  Detail & Related papers  (2026-05-07T19:43:15Z)
• MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons [56.68975315643491]
  We present the first fully end-to-end framework in which Videoto-Pose and Pose-to-Rotation are learnable and optimized jointly.<n>We show that our method reduces rotation error from 17 degrees to 10 degrees, and to 6.54 degrees on unseen skeletons, while achieving 20x faster inference than mesh-based pipelines.
  arXiv  Detail & Related papers  (2026-04-30T17:16:38Z)
• Two-Stage Camera Calibration Method for Multi-Camera Systems Using Scene Geometry [52.27010615715154]
  This paper presents a novel two-stage calibration method for multi-camera tracking systems.<n>In the first stage, partial calibration of individual cameras is performed based on an operator's annotation of natural geometric primitives.<n>In the second stage, precise system calibration is achieved through interactive manipulation of the projected Effective Field of View.
  arXiv  Detail & Related papers  (2025-12-04T16:47:39Z)
• MGSfM: Multi-Camera Geometry Driven Global Structure-from-Motion [13.24058110580706]
  We propose a novel global motion averaging framework for multi-camera systems.<n>Our system matches or exceeds incremental SfM accuracy while significantly improving efficiency.
  arXiv  Detail & Related papers  (2025-07-04T05:25:00Z)
• Multiway Point Cloud Mosaicking with Diffusion and Global Optimization [74.3802812773891]
  We introduce a novel framework for multiway point cloud mosaicking (named Wednesday) At the core of our approach is ODIN, a learned pairwise registration algorithm that identifies overlaps and refines attention scores. Tested on four diverse, large-scale datasets, our method state-of-the-art pairwise and rotation registration results by a large margin on all benchmarks.
  arXiv  Detail & Related papers  (2024-03-30T17:29:13Z)
• Cameras as Rays: Pose Estimation via Ray Diffusion [54.098613859015856]
  Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views. We propose a distributed representation of camera pose that treats a camera as a bundle of rays. Our proposed methods, both regression- and diffusion-based, demonstrate state-of-the-art performance on camera pose estimation on CO3D.
  arXiv  Detail & Related papers  (2024-02-22T18:59:56Z)
• Pointless Global Bundle Adjustment With Relative Motions Hessians [0.0]
  We propose a new bundle adjustment objective which does not rely on image features' reprojection errors. Our method averages over relative motions while implicitly incorporating the contribution of the structure in the adjustment. We argue that this approach is an upgraded version of the motion averaging approach and demonstrate its effectiveness on both photogrammetric datasets and computer vision benchmarks.
  arXiv  Detail & Related papers  (2023-04-11T10:20:32Z)
• ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wild [57.37891682117178]
  We present a robust dense indirect structure-from-motion method for videos that is based on dense correspondence from pairwise optical flow. A novel neural network architecture is proposed for processing irregular point trajectory data. Experiments on MPI Sintel dataset show that our system produces significantly more accurate camera trajectories.
  arXiv  Detail & Related papers  (2022-07-19T09:19:45Z)
• TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors [7.565581566766422]
  We present TransPose, a DNN-based approach to perform full motion capture from only 6 Inertial Measurement Units (IMUs) at over 90 fps. For body pose estimation, we propose a multi-stage network that estimates leaf-to-full joint positions as intermediate results. For global translation estimation, we propose a supporting-foot-based method and an RNN-based method to robustly solve for the global translations.
  arXiv  Detail & Related papers  (2021-05-10T18:41:42Z)
• Efficient Global Optimization of Non-differentiable, Symmetric Objectives for Multi Camera Placement [0.0]
  We propose a novel iterative method for optimally placing and orienting multiple cameras in a 3D scene. Sample applications include improving the accuracy of 3D reconstruction, maximizing the covered area for surveillance, or improving the coverage in multi-viewpoint pedestrian tracking.
  arXiv  Detail & Related papers  (2021-03-20T17:01:15Z)
• Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild [49.672487902268706]
  We present a framework that jointly estimates camera temporal alignment and 3D point triangulation. We reconstruct 3D motion trajectories of human bodies in events captured by multiple unsynchronized and unsynchronized video cameras.
  arXiv  Detail & Related papers  (2020-07-24T23:50:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.