ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment

• URL: http://arxiv.org/abs/2608.02006v2
• Date: Thu, 06 Aug 2026 02:18:15 GMT
• Title: ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment
• Abstract summary: We propose ASTRA, a framework that introduces 2D motion trajectories as explicit, texture-agnostic supervision for asynchronous dynamic reconstruction.<n>ASTRA preserves high-frequency spatial details and sustains strong robustness even under severe asynchrony with up to 25-frame offsets, achieving approximately 1.4 dB PSNR improvement, reducing temporal-offset MAE by 54.0%, and nearly quadrupling the synchronization success rate.
• Score: 86.35109211408489
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Dynamic 3D scene reconstruction has achieved remarkable success under the assumption of strictly synchronized multi-camera inputs. However, in real-world scenarios, temporal asynchrony among capturing devices remains a critical challenge, leading to severe motion blur and geometric artifacts. Existing asynchronous reconstruction methods typically estimate temporal offsets through photometric supervision, but appearance matching provides weak temporal cues under large offsets and complex motions. We attribute this limitation to two major bottlenecks: texture-induced collapse, where low-texture regions provide nearly vanishing alignment signals, and deformation-induced coupling, where temporal errors are absorbed into distorted geometry or motion rather than being explicitly corrected. To address these issues, we propose ASTRA (Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment), a framework that introduces 2D motion trajectories as explicit, texture-agnostic supervision for asynchronous dynamic reconstruction. Instead of synchronizing cameras solely through rendered color residuals, ASTRA jointly optimizes temporal offsets and dynamic 3D representations by aligning the projected motion of reconstructed 3D points with observed 2D trajectories, while using dynamic and certainty masking to suppress unreliable trajectory constraints. Extensive experiments on different dynamic Gaussian Splatting backbones show that ASTRA preserves high-frequency spatial details and sustains strong robustness even under severe asynchrony with up to 25-frame offsets, achieving approximately 1.4 dB PSNR improvement, reducing temporal-offset MAE by 54.0\%, and nearly quadrupling the synchronization success rate.

Related papers

• NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstruction [25.145305440192875]
  Pose-Free Feed-forward 3D Gaussian Splatting has recently emerged as a powerful paradigm for fast scene reconstruction.<n>However, its performance degrades significantly in long image sequences due to cumulative camera pose estimation drift.<n>We propose a synergistic pose-free framework that explicitly couples geometry and appearance via a Raymap-Guided Coupling Module.
  arXiv  Detail & Related papers  (2026-07-08T09:02:18Z)
• Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories [93.39170866007431]
  4D generation aims to animate 3D objects with realistic motion, holding great promise for applications.<n>Existing methods typically decouple 3D asset generation from motion synthesis.<n>We present textttACT, a trajectory-conditioned framework for topology-general skeletal animation.
  arXiv  Detail & Related papers  (2026-06-24T03:18:10Z)
• Moment-Reenacting: Inverse Motion Degradation with Cross-shutter Guidance [38.2932325938093]
  We propose a unified framework to invert motion degradation and reenact imaging moment.<n>We introduce a novel dual-shutter setup that captures synchronized blur-RS image pairs.<n>For allowing flexible performance-cost trade-offs, we extend this dual-shutter setup to a stereo Blur-RS configuration.
  arXiv  Detail & Related papers  (2026-05-21T12:43:02Z)
• One World, Dual Timeline: Decoupled Spatio-Temporal Gaussian Scene Graph for 4D Cooperative Driving Reconstruction [24.030187603322076]
  We propose Dust (DecoUpled Spatio-Temporal) Gaussian Scene Graph for 4D Cooperative Driving Reconstruction.<n>DUST achieves state-of-the-art performance, improving dynamic-area PSNR by 3.2 dB over the strongest baseline.<n>We show that DUST reduces Fréchet Video Distance by 37.7%, with keeping under larger temporal asynchrony.
  arXiv  Detail & Related papers  (2026-05-08T15:48:57Z)
• AsyncEvGS: Asynchronous Event-Assisted Gaussian Splatting for Handheld Motion-Blurred Scenes [30.960288956042163]
  We introduce a flexible, high-resolution asynchronous RGB-Event dual-camera system and a corresponding reconstruction framework.<n>We employ a structure-driven event loss and view-specific consistency regularizers to mitigate the ill-posed behavior of traditional event losses.<n> Experiments demonstrate that our method achieves state-of-the-art performance on both our challenging dataset and existing benchmarks.
  arXiv  Detail & Related papers  (2026-05-08T03:39:45Z)
• Hypergraph-State Collaborative Reasoning for Multi-Object Tracking [63.32950991964095]
  We propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects.<n>By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded.
  arXiv  Detail & Related papers  (2026-04-14T12:37:39Z)
• RetimeGS: Continuous-Time Reconstruction of 4D Gaussian Splatting [9.254380348086135]
  temporal retiming is crucial for applications such as slow-motion playback, temporal editing, and post-production.<n>Most existing 4D Gaussian Splatting (4DGS) methods overfit at discrete frame indices but struggle to represent continuous-time frames, leading to ghosting artifacts when interpolating between timestamps.<n>We propose RetimeGS, a simple yet effective 4DGS representation that explicitly defines the temporal behavior of the 3D Gaussian and achieves temporal aliasing.
  arXiv  Detail & Related papers  (2026-03-14T06:26:27Z)
• ReCoM: Realistic Co-Speech Motion Generation with Recurrent Embedded Transformer [58.49950218437718]
  We present ReCoM, an efficient framework for generating high-fidelity and generalizable human body motions synchronized with speech.<n>The core innovation lies in the Recurrent Embedded Transformer (RET), which integrates Dynamic Embedding Regularization (DER) into a Vision Transformer (ViT) core architecture.<n>To enhance model robustness, we incorporate the proposed DER strategy, which equips the model with dual capabilities of noise resistance and cross-domain generalization.
  arXiv  Detail & Related papers  (2025-03-27T16:39:40Z)
• T-3DGS: Removing Transient Objects for 3D Scene Reconstruction [83.05271859398779]
  Transient objects in video sequences can significantly degrade the quality of 3D scene reconstructions.<n>We propose T-3DGS, a novel framework that robustly filters out transient distractors during 3D reconstruction using Gaussian Splatting.
  arXiv  Detail & Related papers  (2024-11-29T07:45:24Z)
• Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild [49.672487902268706]
  We present a framework that jointly estimates camera temporal alignment and 3D point triangulation. We reconstruct 3D motion trajectories of human bodies in events captured by multiple unsynchronized and unsynchronized video cameras.
  arXiv  Detail & Related papers  (2020-07-24T23:50:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.