GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction

• URL: http://arxiv.org/abs/2608.09493v1
• Date: Mon, 10 Aug 2026 12:01:18 GMT
• Title: GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction
• Abstract summary: Long-horizon future-frame prediction is important for autonomous driving, traffic surveillance, and intelligent transportation systems.<n>Recent latent video diffusion models have achieved impressive visual quality, but directly applying them to structured traffic scenes often leads to unstable geometry.<n>We present a training-free inference framework that stabilizes reliable static structure in pretrained video predictions.
• Score: 0.8091286187898472
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Long-horizon future-frame prediction is important for autonomous driving, traffic surveillance, and intelligent transportation systems, yet remains challenging due to temporal ghosting, geometry drift, and inconsistent object motion. Recent latent video diffusion models have achieved impressive visual quality, but directly applying them to structured traffic scenes often leads to unstable geometry and degraded temporal coherence over extended horizons. We present a training-free inference framework that stabilizes reliable static structure in pretrained video predictions through multi-frame temporal context and view-conditioned routing. For front-camera videos, our method refines generated futures with a multi-frame depth-layered renderer that projects static geometry from observed history frames while preserving dynamic regions from the generative base model. For heterogeneous traffic views, a frozen vision-language model infers a coarse camera group from the observed clip and selects a specialized motion-based predictor. The framework requires neither retraining nor fine-tuning of the underlying video model and can be applied directly to pretrained generators. We validate the proposed framework on the AI City Challenge Track 5 benchmark, where our final system achieves competitive performance among the top-ranked teams. These results demonstrate that geometry-aware inference-time refinement and view-conditioned hybrid inference can improve static-geometry stability and low-level structural fidelity without changing the original model architecture.

Related papers

• SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation [54.26896703895789]
  We propose a training-free framework for motion-controllable generative video frames with pre-trained optical flow and video diffusion models.<n>SNM-VFI achieves strong perceptual quality, competitive reconstruction accuracy, and robust temporal coherence across diverse motion scenarios.
  arXiv  Detail & Related papers  (2026-08-13T16:43:49Z)
• InfiniVerse: Occupancy Guided Unbounded Scene Generation for Autonomous Driving [70.7737035270887]
  We introduce InfiniVerse, a unified pipeline for synthesis of dynamic urban scenes from a single frame.<n>InfiniVerse achieves state-of-the-art performance with a FID of 6.4 and FVD of 67.97, significantly outperforming existing benchmarks in both duration and stability.
  arXiv  Detail & Related papers  (2026-06-30T04:08:22Z)
• GeoStream: Toward Precise Camera Controlled Streaming Video Generation [85.01823220801256]
  Existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories.<n>Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive.<n>We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation.
  arXiv  Detail & Related papers  (2026-06-13T07:18:04Z)
• Drift-Resistant Navigation World Model with Anchored Epipolar Guidance [81.52175010905665]
  We propose Drift-Resistant Navigation World Model, a generative model that mitigates both perceptual drift and geometric drift in conventional rollout-based navigation world models.<n>We first predict sparse future anchors that serve as stable long-range targets, and then generate intermediate frames within each chunk conditioned on both past context and future anchors.<n>Experiments on four benchmarks demonstrate consistent improvements over strong baselines in long-horizon visual quality, geometric consistency, and multi-view coherence.
  arXiv  Detail & Related papers  (2026-05-23T22:47:33Z)
• Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation [25.677744104220853]
  Video frame aims to synthesize realistic intermediate frames between given endpoints while adhering to specific motion semantics.<n>We propose a novel bidirectional framework that enforces symmetry between forward and backward generation trajectories.<n>Our method achieves state-of-the-art performance in imaging quality, motion smoothness, and dynamic control on both 37-frame and 73-frame tasks.
  arXiv  Detail & Related papers  (2026-04-02T06:58:46Z)
• TrajLoom: Dense Future Trajectory Generation from Video [17.78215938363174]
  We propose a framework that predicts future trajectories and trajectories from past video context.<n>Compared with state-of-the-art methods our approach extends the prediction horizon from 24 to 81 frames.<n>The predicted trajectories directly support downstream video generation and editing.
  arXiv  Detail & Related papers  (2026-03-23T22:10:58Z)
• Geometry-Aware Rotary Position Embedding for Consistent Video World Model [48.914346802616414]
  ViewRope is a geometry-aware encoding that injects camera-ray directions directly into video transformer self-attention layers.<n>Geometry-Aware Frame-Sparse Attention exploits these geometric cues to selectively attend to relevant historical frames.<n>Our results demonstrate that ViewRope substantially improves long-term consistency while reducing computational costs.
  arXiv  Detail & Related papers  (2026-02-08T08:01:16Z)
• Online Long-term Point Tracking in the Foundation Model Era [0.0]
  Point tracking aims to identify the same physical point across video frames and serves as a geometry-aware representation of motion.<n>This thesis addresses the problem of long-term point tracking in an online setting, where frames are processed sequentially without access to future information.<n>We introduce Track-On, a transformer-based model that treats each tracked point as a query and processes video frames one at a time.
  arXiv  Detail & Related papers  (2025-07-12T09:24:28Z)
• Tracktention: Leveraging Point Tracking to Attend Videos Faster and Better [61.381599921020175]
  Temporal consistency is critical in video prediction to ensure that outputs are coherent and free of artifacts.<n>Traditional methods, such as temporal attention and 3D convolution, may struggle with significant object motion.<n>We propose the Tracktention Layer, a novel architectural component that explicitly integrates motion information using point tracks.
  arXiv  Detail & Related papers  (2025-03-25T17:58:48Z)
• STDepthFormer: Predicting Spatio-temporal Depth from Video with a Self-supervised Transformer Model [0.0]
  Self-supervised model simultaneously predicts a sequence of future frames from video-input with a spatial-temporal attention network is proposed. The proposed model leverages prior scene knowledge such as object shape and texture similar to single-image depth inference methods. It is implicitly capable of forecasting the motion of objects in the scene, rather than requiring complex models involving multi-object detection, segmentation and tracking.
  arXiv  Detail & Related papers  (2023-03-02T12:22:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.