SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

• URL: http://arxiv.org/abs/2605.18209v1
• Date: Mon, 18 May 2026 10:54:55 GMT
• Title: SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning
• Abstract summary: We introduce SpatioRoute, a dynamic prompt generation approach that routes each incoming question to a semantically tailored prompt template.<n>SpatioRoute achieves consistent overall accuracy gains up to 5% over fixed prompt baselines, establishing a new state-of-the-art for zero-shot video-only spatial VQA.
• Score: 20.773619604028283
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spatial question answering over egocentric video is a challenging task that requires Vision-Language Models (VLMs) to reason about 3D object positions, scene affordances, and directional relationships, particularly in the zero-shot setting where no task-specific fine-tuning is available. We introduce SpatioRoute, a dynamic prompt generation approach that routes each incoming question to a semantically tailored prompt template -- without any additional training, fine-tuning, or 3D sensor input. SpatioRoute operates in two complementary modes: SpatioRoute-R, a rule-based router that deterministically maps question typologies (e.g., What, Is, How, Can, Which) to specialized prompt templates; and SpatioRoute-L, an LLM-driven approach that generates task-specific prompts from the question and situational context alone, with no video input at routing time. We evaluate SpatioRoute on the SQA3D benchmark across VLMs spanning model families. SpatioRoute achieves consistent overall accuracy gains up to 5% over fixed prompt baselines, establishing a new state-of-the-art for zero-shot video-only spatial VQA without requiring 3D point-cloud inputs. As an additional finding, we observe that Chain-of-Thought (CoT) prompting, implemented via the Think it Twice architecture, consistently degrades performance in this setting on Qwen series models, confirming that question-aware routing is more effective than uniform reasoning instructions for spatial video understanding.

Related papers

• Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering [2.018732483255139]
  We introduce Inter-3D VQA, a large-scale multimodal benchmark for 3D interactions at intersections.<n>Inter-3D VQA contains 407K QA pairs covering lane-level positions, object relationships, motion patterns, and near-miss-oriented interaction reasoning.
  arXiv  Detail & Related papers  (2026-08-28T18:05:58Z)
• DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding [41.985888701957826]
  Zero-shot video temporal grounding (VTG) localizes events in untrimmed videos from natural language queries without task-specific training.<n>We propose DART, which bridges the gap by coupling difficulty-aware routing with structured reasoning in large vision models.<n>On Charades-STA and ActivityNet Captions, DART achieves state-of-the-art zero-shot performance across both identically distributed and multiple out-of-distribution settings.
  arXiv  Detail & Related papers  (2026-07-01T09:18:59Z)
• PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generation [41.730631759393525]
  Agentic GraphRAG trains language-model agents to iteratively retrieve and reason over graph-structured evidence.<n>We present Path, a path-aware training framework for agentic GraphRAG.
  arXiv  Detail & Related papers  (2026-06-15T08:48:04Z)
• LatentRouter: Can We Choose the Right Multimodal Model Before Seeing Its Answer? [69.71754384259167]
  Multimodal large language models (MLLMs) have heterogeneous strengths across OCR, chart understanding, spatial reasoning, visual question answering, cost, and latency.<n>We propose Latent, a router that formulates MLLM routing as counterfactual multimodal utility prediction.<n> Experiments on MMR-Bench and VL-Bench show that Latent outperforms fixed-model, feature-level, and learned-router baselines.
  arXiv  Detail & Related papers  (2026-05-11T22:42:12Z)
• DiffusionAnything: End-to-End In-context Diffusion Learning for Unified Navigation and Pre-Grasp Motion [2.061143628317803]
  Recent vision-language-action (VLA) models infer actions directly from visual input but demand massive computational resources.<n>We present a unified image-space diffusion policy handling both meter-scale navigation and centimeter-scale manipulation.<n>The model achieves robust zero-shot generalization to novel scenes while remaining suitable for onboard deployment.
  arXiv  Detail & Related papers  (2026-03-27T11:40:13Z)
• The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project [30.96691028676722]
  vLLM Semantic Router project has released a series of work spanning signal-driven routing, context-length pool routing, router performance engineering, policy conflict detection, low-latency embedding models, category-aware semantic caching, user-feedback-driven routing adaptation, hallucination detection, and hierarchical content-safety classification for privacy and jailbreak protection.<n>This paper distills those results into the Workload-Pool-Pool architecture, a three-dimensional framework for LLM inference optimization.
  arXiv  Detail & Related papers  (2026-03-22T18:30:11Z)
• CoV: Chain-of-View Prompting for Spatial Reasoning [64.77921266428824]
  Chain-of-View (CoV) prompting transforms a vision--language model into an active viewpoint reasoner.<n>We evaluate CoV on OpenEQA and obtain an average +11.56% improvement in LLM-Match, with a maximum gain of +13.62% on Qwen3-VL-Flash.
  arXiv  Detail & Related papers  (2026-01-08T17:59:42Z)
• iFinder: Structured Zero-Shot Vision-Based LLM Grounding for Dash-Cam Video Reasoning [51.15353027471834]
  iFinder is a semantic grounding framework that translates dash-cam videos into a hierarchical, interpretable data structure for large language models.<n>iFinder operates as a training-free pipeline that employs pretrained vision models to extract critical cues.<n>It significantly outperforms end-to-end V-VLMs on four zero-shot driving benchmarks.
  arXiv  Detail & Related papers  (2025-09-23T20:25:53Z)
• SQS: Enhancing Sparse Perception Models via Query-based Splatting in Autonomous Driving [56.198745862311824]
  We introduce SQS, a novel query-based splatting pre-training for sparse Perception Models (SPMs)<n> SQS predicts 3D Gaussian representations from sparse queries during pre-training, leveraging self-supervised splatting to learn fine-grained contextual features.<n>Experiments on autonomous driving benchmarks demonstrate that SQS delivers considerable performance gains across multiple query-based 3D perception tasks.
  arXiv  Detail & Related papers  (2025-09-20T09:25:19Z)
• Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstruction [56.32589034046427]
  We introduce Dynamic Point Maps (DPM), extending standard point maps to support 4D tasks such as motion segmentation, scene flow estimation, 3D object tracking, and 2D correspondence.<n>We train a DPM predictor on a mixture of synthetic and real data and evaluate it across diverse benchmarks for video depth prediction, dynamic point cloud reconstruction, 3D scene flow and object pose tracking, achieving state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-03-20T16:41:50Z)
• Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model [51.83436609094658]
  We introduce Coarse Correspondences, a simple lightweight method that enhances MLLMs' spatial-temporal reasoning with 2D images as input. Our method uses a lightweight tracking model to identify primary object correspondences between frames in a video or across different image viewpoints. We demonstrate that this simple training-free approach brings substantial gains to GPT4-V/O consistently on four benchmarks.
  arXiv  Detail & Related papers  (2024-08-01T17:57:12Z)
• Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Grounding [61.57847727651068]
  Temporal sentence grounding aims to localize a target segment in an untrimmed video semantically according to a given sentence query. Most previous works focus on learning frame-level features of each whole frame in the entire video, and directly match them with the textual information. We propose a novel Motion- and Appearance-guided 3D Semantic Reasoning Network (MA3SRN), which incorporates optical-flow-guided motion-aware, detection-based appearance-aware, and 3D-aware object-level features.
  arXiv  Detail & Related papers  (2022-03-06T13:57:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.