ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning

• URL: http://arxiv.org/abs/2607.02509v1
• Date: Thu, 02 Jul 2026 17:59:26 GMT
• Title: ReContext: Recursive Evidence Replay as LLM Harness for Long-Context Reasoning
• Abstract summary: We propose Recursive Evidence as LLM Harness for Long-Context Reasoning.<n>It is a training-free inference method for improving long-context reasoning.<n> Experiments on eight long-context datasets with 128K context length show it consistently improves evidence utilization.
• Score: 78.94047086588078
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding and reasoning over long contexts has become a key requirement for deploying large language models (LLMs) in realistic applications. Although recent LLMs support increasingly long context windows, they often fail to use relevant evidence that is already present in the input, revealing a gap between context access and effective context utilization. In this work, we propose Recursive Evidence Replay as LLM Harness for Long-Context Reasoning (RECONTEXT), a training-free inference method for improving long-context reasoning. RECONTEXT uses model-internal relevance signals to construct a query-conditioned evidence pool and replays it before final generation while preserving the full original context. This recursive selection process separates evidence organization from answer generation without training, external memory, or context pruning. We also provide a theoretical analysis based on associative memory, which characterizes the context as a memory store, the question as a retrieval cue, attention as cue-trace association, and replay as trace reactivation. Experiments on eight long-context datasets with 128K context length show that RECONTEXT consistently improves evidence utilization across Qwen3-4B, Qwen3-8B, and Llama3-8B, achieving the best average rank on all three backbones. Code is available at https://github.com/Yanjun-Zhao/ReContext.

Related papers

• Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size [0.6155604731137828]
  Large language models (LLMs) process long contexts, including long documents and lengthy conversations.<n>LLMs face token-level memory usage that increases proportionally to input length.<n>This paper proposes a long-context recall method that maintains near-constant GPU memory usage as context length increases.
  arXiv  Detail & Related papers  (2026-09-11T10:31:46Z)
• RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Models [54.53236295237077]
  We introduce RepoReasoner, a benchmark for evaluating repository-level code reasoning.<n> Output Prediction measures fine-grained, stateful execution reasoning across files.<n>Call Chain Prediction evaluates high-level architectural dependency understanding under noisy context.
  arXiv  Detail & Related papers  (2026-07-28T17:12:41Z)
• Incentivizing Vision Language Models to Search for Long Video Question Answering [41.69519333811218]
  VSeek transforms long-video question answering (LVQA) into a multi-turn retrieval process.<n>We propose a novel neuro-symbolic approach that bridges open-ended natural language with discrete visual verification.<n>VSeek improves Pass@1 scores by up to 8% and Pass@4 scores by 15% on long-video understanding benchmarks.
  arXiv  Detail & Related papers  (2026-07-03T05:05:59Z)
• TRACE: State-Aware Query Processing over Temporal Evidence Graphs for Conversational Data [15.389000154441986]
  We present TRACE, a query processing framework over temporal evidence graphs for evolving conversational data.<n>TRACE models conversations as a hierarchical graph spanning events, sessions, and topics, enriched with typed temporal, causal, update, and contradiction relations.<n>At query time, TRACE combines vector-based note retrieval with graph-guided evidence search, generating validity-aware support paths and a hybrid context for answer generation.
  arXiv  Detail & Related papers  (2026-07-01T02:28:47Z)
• LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards [53.339700196282905]
  Reinforcement learning with verifiable rewards (RLVR) has shown promise for this task.<n>Existing methods are limited by low-confusability distractors and sparse, outcome-only reward signals.<n>textscLongTraceRL produces training contexts that are far more challenging than those built by random sampling or one-shot search.
  arXiv  Detail & Related papers  (2026-05-29T17:51:40Z)
• Context Recycling for Long-Horizon LLM Inference [0.3655021726150367]
  Large language models (LLMs) exhibit strong capabilities in short-context reasoning but degrade in performance over long conversational horizons.<n>We introduce ContextForge, a system for context recycling that maintains task-relevant information across turns.<n>System enables efficient reuse of prior computation without relying on full context replay.
  arXiv  Detail & Related papers  (2026-05-01T04:45:08Z)
• RecaLLM: Addressing the Lost-in-Thought Phenomenon with Explicit In-Context Retrieval [0.8594140167290097]
  RecaLLM is a set of reasoning language models post-trained to make effective use of long-context information.<n>We introduce a negligible-overhead constrained decoding mechanism that enables verbatim copying of evidence spans.<n>We observe consistent gains at context windows of up to 128K tokens using training samples of at most 10K tokens, far shorter than those used by existing long-context approaches.
  arXiv  Detail & Related papers  (2026-04-10T17:04:32Z)
• Panini: Continual Learning in Token Space via Structured Memory [4.979820180013486]
  Language models are increasingly used to reason over content they were not trained on.<n>A common approach is retrieval-augmented generation (RAG), which stores verbatim documents externally (as chunks) and retrieves only a relevant subset at inference time.<n>We propose a human-like non-parametric continual learning framework, where the base model remains fixed, and learning occurs by integrating each new experience into an external semantic memory state.
  arXiv  Detail & Related papers  (2026-02-16T19:58:03Z)
• ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering [54.72902502486611]
  ReAG is a Reasoning-Augmented Multimodal RAG approach that combines coarse- and fine-grained retrieval with a critic model that filters irrelevant passages.<n>ReAG significantly outperforms prior methods, improving answer accuracy and providing interpretable reasoning grounded in retrieved evidence.
  arXiv  Detail & Related papers  (2025-11-27T19:01:02Z)
• Vgent: Graph-based Retrieval-Reasoning-Augmented Generation For Long Video Understanding [56.45689495743107]
  Vgent is a graph-based retrieval-reasoning-augmented generation framework to enhance LVLMs for long video understanding.<n>We evaluate our framework with various open-source LVLMs on three long-video understanding benchmarks.
  arXiv  Detail & Related papers  (2025-10-15T19:14:58Z)
• ELITE: Embedding-Less retrieval with Iterative Text Exploration [5.8851517822935335]
  Large Language Models (LLMs) have achieved impressive progress in natural language processing.<n>Their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks.
  arXiv  Detail & Related papers  (2025-05-17T08:48:43Z)
• Unstructured Evidence Attribution for Long Context Query Focused Summarization [53.08341620504465]
  We propose to extract unstructured (i.e., spans of any length) evidence in order to acquire more relevant and consistent evidence than in the fixed granularity case.<n>We show how existing systems struggle to copy and properly cite unstructured evidence, which also tends to be "lost-in-the-middle"
  arXiv  Detail & Related papers  (2025-02-20T09:57:42Z)
• Query Rewriting for Retrieval-Augmented Large Language Models [139.242907155883]
  Large Language Models (LLMs) play powerful, black-box readers in the retrieve-then-read pipeline. This work introduces a new framework, Rewrite-Retrieve-Read instead of the previous retrieve-then-read for the retrieval-augmented LLMs.
  arXiv  Detail & Related papers  (2023-05-23T17:27:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.