Pointless Global Bundle Adjustment With Relative Motions Hessians

• URL: http://arxiv.org/abs/2304.05118v1
• Date: Tue, 11 Apr 2023 10:20:32 GMT
• Title: Pointless Global Bundle Adjustment With Relative Motions Hessians
• Abstract summary: We propose a new bundle adjustment objective which does not rely on image features' reprojection errors. Our method averages over relative motions while implicitly incorporating the contribution of the structure in the adjustment. We argue that this approach is an upgraded version of the motion averaging approach and demonstrate its effectiveness on both photogrammetric datasets and computer vision benchmarks.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Bundle adjustment (BA) is the standard way to optimise camera poses and to produce sparse representations of a scene. However, as the number of camera poses and features grows, refinement through bundle adjustment becomes inefficient. Inspired by global motion averaging methods, we propose a new bundle adjustment objective which does not rely on image features' reprojection errors yet maintains precision on par with classical BA. Our method averages over relative motions while implicitly incorporating the contribution of the structure in the adjustment. To that end, we weight the objective function by local hessian matrices - a by-product of local bundle adjustments performed on relative motions (e.g., pairs or triplets) during the pose initialisation step. Such hessians are extremely rich as they encapsulate both the features' random errors and the geometric configuration between the cameras. These pieces of information propagated to the global frame help to guide the final optimisation in a more rigorous way. We argue that this approach is an upgraded version of the motion averaging approach and demonstrate its effectiveness on both photogrammetric datasets and computer vision benchmarks.

Related papers

• Stable and Scalable Bundle Adjustment of Holistic 3D Structures [99.03818732955783]
  We present a new version of Bundle Adjustment (BA) for 3D computer vision.<n>BA is developed to jointly optimize cameras, poses and 3D points.<n>By group-induced measurements and cross-feature reprojection, we preserve the sparsity of classical point-only 3D regularization.
  arXiv  Detail & Related papers  (2026-09-03T16:08:03Z)
• HETA++: Global Structure-from-Motion with Hybrid Explicit Translation Averaging [26.8990038810354]
  Global Structure-from-Motion (SfM) offers advantages over incremental methods in terms of efficiency and error distribution.<n>Many existing methods rely solely on relative translations or feature tracks, which either degrade under collinear camera motion or are susceptible to outliers.<n>We propose a novel hybrid explicit translation averaging framework that incorporates both relative translations and feature tracks.
  arXiv  Detail & Related papers  (2026-07-17T12:40:01Z)
• Calousel: Extrinsic Calibration of Non-overlapping Multi-camera Systems from Pure Rotation [7.816762304840921]
  Conventional target-based methods impose substantial target setup overhead.<n> Motion-based approaches instead suffer from drift error, scale ambiguity, and motion degeneracy.<n>We propose a novel calibration method that leverages pure rotational motion, requiring only a single static calibration board.
  arXiv  Detail & Related papers  (2026-06-24T09:54:20Z)
• MoCapAnything V2: End-to-End Motion Capture for Arbitrary Skeletons [56.68975315643491]
  We present the first fully end-to-end framework in which Videoto-Pose and Pose-to-Rotation are learnable and optimized jointly.<n>We show that our method reduces rotation error from 17 degrees to 10 degrees, and to 6.54 degrees on unseen skeletons, while achieving 20x faster inference than mesh-based pipelines.
  arXiv  Detail & Related papers  (2026-04-30T17:16:38Z)
• A Pose-only Geometric Constraint for Multi-Camera Pose Adjustment [17.926124307402734]
  Multi-camera systems offer rich observation capabilities for visual navigation and 3D scene reconstruction.<n>The resulting feature redundancy often compromises computational efficiency.<n>This paper introduces a pose-only geometric constraint for multi-camera systems and proposes a corresponding pose adjustment algorithm.
  arXiv  Detail & Related papers  (2026-04-26T13:36:46Z)
• FLIGHT: Fibonacci Lattice-based Inference for Geometric Heading in real-Time [7.517221623631364]
  Estimating camera motion from monocular video is a fundamental problem in computer vision.<n>Existing methods that recover the camera's heading under known rotation tend to perform well in low-noise, low-outlier conditions.<n>We propose a novel generalization of the Hough transform on the unit sphere to estimate the camera's heading.
  arXiv  Detail & Related papers  (2026-02-26T15:27:49Z)
• JOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting [10.35563602148445]
  We propose a unified framework that jointly optimize 3D Gaussian points and camera poses without requiring pre-calibrated inputs.<n>Our approach iteratively refines 3D Gaussian parameters and updates camera poses through a novel co-optimization strategy.<n>Our approach significantly outperforms existing COLMAP-free techniques in reconstruction quality, and also surpasses the standard COLMAP-based baseline in general.
  arXiv  Detail & Related papers  (2025-10-30T04:00:07Z)
• MGSfM: Multi-Camera Geometry Driven Global Structure-from-Motion [13.24058110580706]
  We propose a novel global motion averaging framework for multi-camera systems.<n>Our system matches or exceeds incremental SfM accuracy while significantly improving efficiency.
  arXiv  Detail & Related papers  (2025-07-04T05:25:00Z)
• Towards Initialization-free Calibrated Bundle Adjustment [8.698137120086065]
  We present a method that is able to use the known camera calibration thereby producing near metric solutions.<n>Our method can be seen as integrating rotation averaging into the pOSE framework.
  arXiv  Detail & Related papers  (2025-06-30T12:55:44Z)
• Back on Track: Bundle Adjustment for Dynamic Scene Reconstruction [78.27956235915622]
  Traditional SLAM systems struggle with highly dynamic scenes commonly found in casual videos. This work leverages a 3D point tracker to separate the camera-induced motion from the observed motion of dynamic objects. Our framework combines the core of traditional SLAM -- bundle adjustment -- with a robust learning-based 3D tracker front-end.
  arXiv  Detail & Related papers  (2025-04-20T07:29:42Z)
• A Constrained Optimization Approach for Gaussian Splatting from Coarsely-posed Images and Noisy Lidar Point Clouds [37.043012716944496]
  We introduce a constrained optimization method for simultaneous camera pose estimation and 3D reconstruction. Experiments demonstrate that the proposed method significantly outperforms the existing (multi-modal) 3DGS baseline.
  arXiv  Detail & Related papers  (2025-04-12T08:34:43Z)
• VICAN: Very Efficient Calibration Algorithm for Large Camera Networks [49.17165360280794]
  We introduce a novel methodology that extends Pose Graph Optimization techniques. We consider the bipartite graph encompassing cameras, object poses evolving dynamically, and camera-object relative transformations at each time step. Our framework retains compatibility with traditional PGO solvers, but its efficacy benefits from a custom-tailored optimization scheme.
  arXiv  Detail & Related papers  (2024-03-25T17:47:03Z)
• Cameras as Rays: Pose Estimation via Ray Diffusion [54.098613859015856]
  Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views. We propose a distributed representation of camera pose that treats a camera as a bundle of rays. Our proposed methods, both regression- and diffusion-based, demonstrate state-of-the-art performance on camera pose estimation on CO3D.
  arXiv  Detail & Related papers  (2024-02-22T18:59:56Z)
• Revisiting Rolling Shutter Bundle Adjustment: Toward Accurate and Fast Solution [6.317266060165099]
  We propose a robust and fast bundle adjustment solution that estimates the 6-DoF pose of the camera and the geometry of the environment based on measurements from a rolling shutter (RS) camera. This tackles the challenges in the existing works, namely relying on additional sensors, high frame rate video as input, restrictive assumptions on camera motion, readout direction, and poor efficiency.
  arXiv  Detail & Related papers  (2022-09-18T08:21:07Z)
• ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wild [57.37891682117178]
  We present a robust dense indirect structure-from-motion method for videos that is based on dense correspondence from pairwise optical flow. A novel neural network architecture is proposed for processing irregular point trajectory data. Experiments on MPI Sintel dataset show that our system produces significantly more accurate camera trajectories.
  arXiv  Detail & Related papers  (2022-07-19T09:19:45Z)
• Pyramid Feature Alignment Network for Video Deblurring [63.26197177542422]
  Video deblurring is a challenging task due to various causes of blurring. Traditional methods have considered how to utilize neighboring frames by the single-scale alignment for restoration. We propose a Pyramid Feature Alignment Network (PFAN) for video deblurring.
  arXiv  Detail & Related papers  (2022-03-28T07:54:21Z)
• Efficient Global Optimization of Non-differentiable, Symmetric Objectives for Multi Camera Placement [0.0]
  We propose a novel iterative method for optimally placing and orienting multiple cameras in a 3D scene. Sample applications include improving the accuracy of 3D reconstruction, maximizing the covered area for surveillance, or improving the coverage in multi-viewpoint pedestrian tracking.
  arXiv  Detail & Related papers  (2021-03-20T17:01:15Z)
• Pushing the Envelope of Rotation Averaging for Visual SLAM [69.7375052440794]
  We propose a novel optimization backbone for visual SLAM systems. We leverage averaging to improve the accuracy, efficiency and robustness of conventional monocular SLAM systems. Our approach can exhibit up to 10x faster with comparable accuracy against the state-art on public benchmarks.
  arXiv  Detail & Related papers  (2020-11-02T18:02:26Z)
• Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild [49.672487902268706]
  We present a framework that jointly estimates camera temporal alignment and 3D point triangulation. We reconstruct 3D motion trajectories of human bodies in events captured by multiple unsynchronized and unsynchronized video cameras.
  arXiv  Detail & Related papers  (2020-07-24T23:50:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.