PAS3R: Pose-Adaptive Streaming 3D Reconstruction for Long Video Sequences

• URL: http://arxiv.org/abs/2603.21436v1
• Date: Sun, 22 Mar 2026 22:57:30 GMT
• Title: PAS3R: Pose-Adaptive Streaming 3D Reconstruction for Long Video Sequences
• Abstract summary: PAS3R is a pose-adaptive streaming reconstruction framework that dynamically modulates state updates according to camera motion and scene structure.<n>We show that PAS3R significantly improves trajectory accuracy, depth estimation, and point cloud reconstruction quality in long video sequences.
• Score: 6.455635287305678
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online monocular 3D reconstruction enables dense scene recovery from streaming video but remains fundamentally limited by the stability-adaptation dilemma: the reconstruction model must rapidly incorporate novel viewpoints while preserving previously accumulated scene structure. Existing streaming approaches rely on uniform or attention-based update mechanisms that often fail to account for abrupt viewpoint transitions, leading to trajectory drift and geometric inconsistencies over long sequences. We introduce PAS3R, a pose-adaptive streaming reconstruction framework that dynamically modulates state updates according to camera motion and scene structure. Our key insight is that frames contributing significant geometric novelty should exert stronger influence on the reconstruction state, while frames with minor viewpoint variation should prioritize preserving historical context. PAS3R operationalizes this principle through a motion-aware update mechanism that jointly leverages inter-frame pose variation and image frequency cues to estimate frame importance. To further stabilize long-horizon reconstruction, we introduce trajectory-consistent training objectives that incorporate relative pose constraints and acceleration regularization. A lightweight online stabilization module further suppresses high-frequency trajectory jitter and geometric artifacts without increasing memory consumption. Extensive experiments across multiple benchmarks demonstrate that PAS3R significantly improves trajectory accuracy, depth estimation, and point cloud reconstruction quality in long video sequences while maintaining competitive performance on shorter sequences.

Related papers

• Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction [10.383154504465232]
  ABot-Recon is a simple streaming model that caches KV features from only the preceding 11 frames.<n>It predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose.<n>To reduce accumulated drift, a lightweight temporal refiner improves relative rotations using recent visual and motion context.
  arXiv  Detail & Related papers  (2026-08-27T15:07:38Z)
• NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstruction [25.145305440192875]
  Pose-Free Feed-forward 3D Gaussian Splatting has recently emerged as a powerful paradigm for fast scene reconstruction.<n>However, its performance degrades significantly in long image sequences due to cumulative camera pose estimation drift.<n>We propose a synergistic pose-free framework that explicitly couples geometry and appearance via a Raymap-Guided Coupling Module.
  arXiv  Detail & Related papers  (2026-07-08T09:02:18Z)
• Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping [28.6268034980389]
  Long-horizon online visual mapping is a core capability for robot perception.<n>Recent feed-forward 3D reconstruction models predict poses in a fixed coordinate system tied to the first frame or a persistent scene memory.<n>We propose emphAnchor3R, a streaming 3D reconstruction framework that treats feed-forward reconstruction as current-centric local measurement prediction.
  arXiv  Detail & Related papers  (2026-06-03T16:00:13Z)
• SoLAR: Error-Resilient Streamable Long-Horizon Free-Viewpoint Video Reconstruction with Anchor Activation and Latent Recalibration [57.159190580279585]
  Motivated by bit allocation theory, we analyze dynamic-anchor-based volumetric video representation within a rate-distortion optimization framework.<n>We propose textbfSoLAR, which is the first error-resilient streamable FVV framework that maintains stable reconstruction quality on long sequences.
  arXiv  Detail & Related papers  (2026-05-08T06:48:59Z)
• AnyRecon: Arbitrary-View 3D Reconstruction with Video Diffusion Model [29.087865646035695]
  Sparse-view 3D reconstruction is essential for modeling scenes from casual captures, but remain challenging for non-generative reconstruction.<n>We propose AnyRecon, a scalable framework for reconstruction from arbitrary and unordered sparse inputs.<n>Experiments demonstrate robust and scalable reconstruction across irregular inputs, large viewpoint gaps, and long trajectories.
  arXiv  Detail & Related papers  (2026-04-21T17:59:47Z)
• SSR: A Training-Free Approach for Streaming 3D Reconstruction [53.19807901585702]
  Self-expressive Sequence Regularization (SSR) is a plug-and-play operator that enforces Grassmannian sequence regularity during inference.<n>We show that SSR consistently reduces drift and improves reconstruction quality across multiple streaming 3D reconstruction tasks.
  arXiv  Detail & Related papers  (2026-03-16T02:55:14Z)
• OnlineX: Unified Online 3D Reconstruction and Understanding with Active-to-Stable State Evolution [34.8105632078785]
  We introduce OnlineX, a feed-forward framework that reconstructs both 3D visual appearance and language fields in an online manner using only streaming images.<n>Our framework decouples the memory state into a dedicated active state and a persistent stable state, and then cohesively fuses the information from the former into the latter to achieve both fidelity and stability.
  arXiv  Detail & Related papers  (2026-03-02T17:52:02Z)
• Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery [60.51998732898099]
  We introduce HMRMamba, a new paradigm for 3D Human Mesh Recovery.<n>It pioneers the use of Structured State Space Models for their efficiency and long-range modeling prowess.<n>Our framework is distinguished by two core contributions. First, the Geometry-Aware Lifting Module, featuring a novel dual-scan Mamba architecture.
  arXiv  Detail & Related papers  (2026-01-29T08:05:02Z)
• STCDiT: Spatio-Temporally Consistent Diffusion Transformer for High-Quality Video Super-Resolution [60.06664986365803]
  We present STCDiT, a video super-resolution framework built upon a pre-trained video diffusion model.<n>It aims to restore structurally faithful and temporally stable videos from degraded inputs, even under complex camera motions.
  arXiv  Detail & Related papers  (2025-11-24T05:37:23Z)
• ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenes [41.108974064267436]
  ReCon-GS is a storage-aware framework that enables high fidelity online dynamic scene reconstruction and real-time rendering.<n>We show that ReCon-GS improves training efficiency by approximately 15% and achieves superior FVV synthesis quality.<n>At equivalent rendering quality, ReCon-GS slashes memory requirements by over 50% compared to leading state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-09-29T06:23:47Z)
• DiTVR: Zero-Shot Diffusion Transformer for Video Restoration [48.97196894658511]
  DiTVR is a zero shot video restoration framework that couples a diffusion transformer with trajectory aware attention and a flow consistent sampler.<n>Our attention mechanism aligns tokens along optical flow trajectories, with particular emphasis on vital layers that exhibit the highest sensitivity to temporal dynamics.<n>The flow guided sampler injects data consistency only into low-frequency bands, preserving high frequency priors while accelerating cache.
  arXiv  Detail & Related papers  (2025-08-11T09:54:45Z)
• GaVS: 3D-Grounded Video Stabilization via Temporally-Consistent Local Reconstruction and Rendering [54.489285024494855]
  Video stabilization is pivotal for video processing, as it removes unwanted shakiness while preserving the original user motion intent.<n>Existing approaches, depending on the domain they operate, suffer from several issues that degrade the user experience.<n>We introduce textbfGaVS, a novel 3D-grounded approach that reformulates video stabilization as a temporally-consistent local reconstruction and rendering' paradigm.
  arXiv  Detail & Related papers  (2025-06-30T15:24:27Z)
• VEIGAR: View-consistent Explicit Inpainting and Geometry Alignment for 3D object Removal [2.8954284913103367]
  Novel View Synthesis (NVS) and 3D generation have significantly improved editing tasks.<n>To maintain cross-view consistency throughout the generative process, methods typically address this challenge using a dual-strategy framework.<n>We present VEIGAR, a computationally efficient framework that outperforms existing methods without relying on an initial reconstruction phase.
  arXiv  Detail & Related papers  (2025-06-13T11:31:44Z)
• Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild [49.672487902268706]
  We present a framework that jointly estimates camera temporal alignment and 3D point triangulation. We reconstruct 3D motion trajectories of human bodies in events captured by multiple unsynchronized and unsynchronized video cameras.
  arXiv  Detail & Related papers  (2020-07-24T23:50:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.