Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA
- URL: http://arxiv.org/abs/2604.09019v1
- Date: Fri, 10 Apr 2026 06:31:51 GMT
- Title: Regime-Conditional Retrieval: Theory and a Transferable Router for Two-Hop QA
- Abstract summary: Two-hop QA retrieval queries splits into two regimes determined by whether the hop-2 entity is explicitly named in the question (Q-dominant) or only in the bridge passage (B-dominant)<n>We formalize this split with three theorems.<n>Building on this theory, we propose a lightweight binary router that selects between question-only and question-plusrelation-sentence retrieval.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Two-hop QA retrieval splits queries into two regimes determined by whether the hop-2 entity is explicitly named in the question (Q-dominant) or only in the bridge passage (B-dominant). We formalize this split with three theorems: (T1) per-query AUC is a monotone function of the cosine separation margin, with R^2 >= 0.90 for six of eight type-encoder pairs; (T2) regime is characterized by two surface-text predicates, with P1 decisive for routing and P2 qualifying the B-dominant case, holding across three encoders and three datasets; and (T3) bridge advantage requires the relation-bearing sentence, not entity name alone, with removal causing an 8.6-14.1 pp performance drop (p < 0.001). Building on this theory, we propose RegimeRouter, a lightweight binary router that selects between question-only and question-plus-relation-sentence retrieval using five text features derived directly from the predicate definitions. Trained on 2WikiMultiHopQA (n = 881, 5-fold cross-fitted) and applied zero-shot to MuSiQue and HotpotQA, RegimeRouter achieves +5.6 pp (p < 0.001), +5.3 pp (p = 0.002), and +1.1 pp (non-significant, no-regret) R@5 improvement, respectively, with artifact-driven.
Related papers
- SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation [51.46828526392219]
Reasoning segmentation converts an implicit linguistic conclusion into a precise mask.<n>Existing MLLM-segmenter interfaces either use a special trigger or compress both signals into one context.<n>We present SeGDeP, an explicit what-where interface.
arXiv Detail & Related papers (2026-09-08T15:11:32Z) - Architecture-Dependent Causal Transfer of Activation States Across Large Language Models [51.56484100374058]
Internal language activation states can be transferred causally between different large language models.<n>Injecting projected activations into a target model during generation produces a statistically significant, preregistered causal effect.<n>We conclude that end-to-end activation-state transfer between LLMs, as currently implemented, is architecture-dependent rather than universal.
arXiv Detail & Related papers (2026-08-17T09:53:27Z) - Query-Aware Spreading Activation for Multi-Hop Retrieval over Knowledge Graphs [0.0]
In most existing systems, the question only sets the seed nodes.<n>This architecture requires loading the full graph into Python memory and an iterative solver with a variable number of iterations.<n>We propose a spreading-activation method that achieves the same query-aware.<n>retrieval with a single per-step semantic gate.
arXiv Detail & Related papers (2026-06-29T11:10:19Z) - Dissecting Agentic RAG: A Component Ablation for Multi-Hop QA with a Local 7B Model [0.0]
We run a controlled ablation study of a full agentic RAG pipeline evaluated on 5,000 questions.<n>We find that fixed hybrid retrieval via reciprocal rank fusion consistently outperforms rule-based adaptive routing.
arXiv Detail & Related papers (2026-06-19T15:50:35Z) - Convergence Theory for Iterative LLM-Based Neural Architecture Search: A Parametric Cross-Entropy Framework with Closed-Form Proxy Reliability [48.83701310501069]
Large language models (LLMs) are increasingly used as generators in iterative neural architecture search (NAS)<n>We model iterative LLM-NAS as a parametric Cross-Entropy (CE) method over executable programs.<n>We prove six results: (1) iterative LLM fine-tuning on elite architectures is equivalent to the CE update restricted to the LLM family; (2) expected architecture quality is monotonically non-decreasing across cycles; and (3) elite-set probability converges to a fixed point at a geometric rate.
arXiv Detail & Related papers (2026-05-28T15:45:19Z) - Every Component is a Lookup: Token Attribution and Composition from a Single Decomposition [1.3290717106567922]
We exploit a shared key-value template $(S)U$ to develop Unpack, a backward recursion that decomposes credit through both sublayers.<n>On GPT-2 small, the method recovers all three composition connections described by Wang et al. (2023), including the mode-specific routing of each connection.<n>Across the Pythia family from 160M to 6.9B parameters, this suppression pattern is consistently recovered at every scale.
arXiv Detail & Related papers (2026-05-22T09:03:01Z) - Pairwise matrices for sparse autoencoders: single-feature inspection mislabels causal axes [2.741152471987327]
Standard sparse-autoencoder protocol labels each feature from its top-activating contexts and validates by single-feature steering.<n>We propose the pairwise matrix protocol, co-varying steering coefficient with joint condition, and report three findings the standard one-corner protocol misses on Qwen3-1.7B-Instruct, replicated on Gemma-2-2B-it.<n>All three findings reproduce on Gemma with model-specific damage signatures; the matched-geometry control is CI-separated by 10x.
arXiv Detail & Related papers (2026-05-04T21:11:21Z) - Equifinality in Mixture of Experts: Routing Topology Does Not Determine Language Modeling Quality [0.0]
We build a sparse Mixture-of-Experts (MoE) architecture using cosine-similarity routing against learned centroids.<n>We find that routing topology does not determine perplexity (PPL)<n>Expert-level and causal controllability -- which coexist with topology-level equifinality -- are explored in a companion paper.
arXiv Detail & Related papers (2026-04-15T21:02:02Z) - BridgeRAG: Training-Free Bridge-Conditioned Retrieval for Multi-Hop Question Answering [0.0]
We present BridgeRAG, a training-free, graph-free retrieval method for retrieval-augmented generation.<n>BridgeRAG separates coverage from scoring: dual-entity ANN broadens the second-hop candidate pool.<n>We show that bridge conditioning causes productive re-rankings (18.7% flip-win rate on parallel-chain vs. 0.6% on single-chain)
arXiv Detail & Related papers (2026-04-03T18:27:51Z) - Evaluating Small Language Models for Front-Door Routing: A Harmonized Benchmark and Synthetic-Traffic Experiment [0.05586191108738562]
Small language models (SLMs) have sufficient reasoning capability for sub-second, zero-marginal-cost, self-hosted task classification.<n>Study 1 is a harmonized offline benchmark of Phi-3.5-mini, Qwen2.5-1.5B, and Qwen-2.5-3B on identical Azure T4 hardware, serving stack, quantization, and a fixed 60-case corpus.<n>Study 2 is a pre-registered four-arm randomized experiment under synthetic traffic with an effective sample size of 60 unique cases per arm.
arXiv Detail & Related papers (2026-03-26T15:57:46Z) - Reinforcement Learning for Parameterized Quantum State Preparation: A Comparative Study [2.4542351340244264]
We extend directed quantum circuit synthesis (DQCS) with reinforcement learning from purely discrete gate selection to parameterized quantum state preparation.<n>We compare two training regimes: a one-stage agent that jointly selects the gate type, the affected qubit(s), and the rotation angle.<n>We evaluate Proximal Policy Optimization (PPO) and Advantage Actor--Critic (A2C) on systems comprising two to ten qubits and on targets of increasing complexity.
arXiv Detail & Related papers (2026-02-18T15:10:43Z) - ACAR: Adaptive Complexity Routing for Multi-Model Ensembles with Auditable Decision Traces [3.151184728006369]
We present ACAR, a measurement framework for studying multi-model orchestration under auditable conditions.<n>ACAR uses self-consistency variance (sigma) computed from N=3 probe samples to route tasks across single-model, two-model, and three-model execution modes.<n>We evaluate ACAR on 1,510 tasks spanning four benchmarks, producing more than 7,550 auditable runs.
arXiv Detail & Related papers (2026-02-06T23:27:17Z) - BRIDGE: Building Representations In Domain Guided Program Verification [67.36686119518441]
BRIDGE decomposes verification into three interconnected domains: Code, Specifications, and Proofs.<n>We show that this approach substantially improves both accuracy and efficiency beyond standard error feedback methods.
arXiv Detail & Related papers (2025-11-26T06:39:19Z) - Faithful Chain-of-Thought Reasoning [51.21714389639417]
Chain-of-Thought (CoT) prompting boosts Language Models' (LM) performance on a gamut of reasoning tasks.
We propose Faithful CoT, a reasoning framework involving two stages: Translation and Problem Solving.
This guarantees that the reasoning chain provides a faithful explanation of the final answer.
arXiv Detail & Related papers (2023-01-31T03:04:26Z) - Regret Bounds for Noise-Free Cascaded Kernelized Bandits [45.551266812295005]
We consider optimizing a function network in the noise-free grey-box setting with RKHS function classes.
We study three types of structures: (1) chain: a cascade of scalar-valued functions, (2) multi-output chain: a cascade of vector-valued functions, and (3) feed-forward network: a fully connected feed-forward network of scalar-valued functions.
arXiv Detail & Related papers (2022-11-10T09:12:55Z) - Disentangled Representation Learning for Text-Video Retrieval [51.861423831566626]
Cross-modality interaction is a critical component in Text-Video Retrieval (TVR)
We study the interaction paradigm in depth, where we find that its computation can be split into two terms.
We propose a disentangled framework to capture a sequential and hierarchical representation.
arXiv Detail & Related papers (2022-03-14T13:55:33Z) - R2-D2: A Modular Baseline for Open-Domain Question Answering [0.1529342790344802]
This work presents a novel four-stage open-domain QA pipeline R2-D2 (Rank twice, reaD twice).
The pipeline is composed of a retriever, passage reranker, extractive reader, generative reader and a mechanism that aggregates the final prediction from all system's components.
arXiv Detail & Related papers (2021-09-08T08:51:27Z) - PlueckerNet: Learn to Register 3D Line Reconstructions [57.20244406275875]
This paper proposes a neural network based method to solve the problem of Aligning two partially-overlapped 3D line reconstructions in Euclidean space.
Experiments on both indoor and outdoor datasets show that the registration (rotation and translation) precision of our method outperforms baselines significantly.
arXiv Detail & Related papers (2020-12-02T11:31:56Z) - FastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire [74.04394069262108]
We propose FastLR, a non-autoregressive (NAR) lipreading model which generates all target tokens simultaneously.
FastLR achieves the speedup up to 10.97$times$ compared with state-of-the-art lipreading model.
arXiv Detail & Related papers (2020-08-06T08:28:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.