SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding
- URL: http://arxiv.org/abs/2608.24011v1
- Date: Tue, 25 Aug 2026 03:01:51 GMT
- Title: SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding
- Abstract summary: We propose SAGE, an evidence-grounded multi-agent framework for Chinese ancient document understanding.<n>SAGE coordinates specialized agents for task-aware planning, tool-mediated evidence acquisition, claim-level verification, and bounded replanning.<n> Experiments on the AncientDoc benchmark show that SAGE consistently outperforms matched direct-answering baselines.
- Score: 61.02068339726333
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Chinese ancient document understanding demands complex visual, linguistic, and historical reasoning. Current Large Vision-Language Models (LVLMs) typically rely on an opaque, single-pass generation paradigm, often producing overconfident and weakly grounded responses. To address this, we propose SAGE, an evidence-grounded multi-agent framework that reformulates Chinese ancient document understanding as evidence-grounded inference rather than direct answer generation. SAGE coordinates specialized agents for task-aware planning, tool-mediated evidence acquisition, claim-level verification, and bounded replanning under a constrained shared-state runtime. This design supports bounded evidence seeking, answer revision, and abstention when grounding is insufficient. Experiments on the AncientDoc benchmark show that SAGE consistently outperforms matched direct-answering baselines across three LVLM backbones. Remarkably, SAGE with Qwen3.5-9B surpasses much larger monolithic LVLMs on most evaluated metrics, highlighting the importance of structured, evidence-grounded inference beyond model scaling.
Related papers
- GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion [2.729876880765472]
Large language models frequently generate plausible but ungrounded claims.<n>We introduce GRACE, a framework that deconstructs responses into atomic claims and grounds them against trusted knowledge priors.<n>We evaluate GRACE across multiple language models and on datasets spanning both general and domain-specific knowledge.
arXiv Detail & Related papers (2026-09-03T20:03:20Z) - Buried in Textual Debt: Context Pruning with Visual Evidence Preservation for MLLM Agents [16.82888862043366]
We propose a Kullback-Leibler-guided framework for pruning accumulated reasoning in tool-use agents.<n> SPARE achieves the highest average accuracy among pruning methods while removing 37.89--64.58% of reasoning tokens.<n>This favorable accuracy--context trade-off shows that reducing textual dominance restores reliance on visual evidence and mitigates over-conditioning on self-generated language.
arXiv Detail & Related papers (2026-08-24T08:29:17Z) - SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering [8.538563236020947]
SAFE-G is a structure-Aware Faithful Evidence-guided Generation framework.<n>It enables precise evidence localization and trustworthy reasoning.<n>It outperforms prior methods by a margin of 8.9% and 3.5%.
arXiv Detail & Related papers (2026-08-22T06:34:53Z) - Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning [42.17614767170884]
We show that models extensively copy text from the input into their reasoning traces rather than productively solving the problem.<n>By separating each prompt into task-relevant key evidence and irrelevant distractor context, we show that the root cause is insufficient grounding.<n>Motivated by this diagnosis, we propose GEAR, a reward shaping method that augments the accuracy signal with a grounding reward for overlap with key evidence and a distractor penalty for overlap with irrelevant context.
arXiv Detail & Related papers (2026-07-21T17:59:21Z) - HMARS: A Hierarchical Multi-Agent Memory System for Long-Context Reasoning [17.783618926697066]
Long-context reasoning requires models to access, retrieve, and integrate evidence scattered across documents, dialogues, and interaction histories.<n>We propose HMARS, a hierarchical multi-agent memory system that treats long contexts as managed memory rather than a flat retrieval corpus.
arXiv Detail & Related papers (2026-06-03T07:15:11Z) - Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation [74.0621258662676]
We propose Ptah, a multi-agent harness for interleaved report generation.<n>Ptah orchestrates the lifecycle from user query to rendered web report through planning, research, and writing stages.<n>A verifier agent serves as the harness's acceptance function, enforcing factual grounding, citation fidelity, and cross-modal consistency throughout the workflow.
arXiv Detail & Related papers (2026-05-28T12:40:34Z) - DocSeeker: Structured Visual Reasoning with Evidence Grounding for Long Document Understanding [63.257540233507626]
We propose a paradigm that requires the model to execute a structured Analysis, Localization and Reasoning workflow.<n>We show it robustly generalizes from short-page training to ultra-long documents and is naturally synergistic with visual Retrieval-Augmented Generation systems.
arXiv Detail & Related papers (2026-04-14T14:39:26Z) - GenProve: Learning to Generate Text with Fine-Grained Provenance [14.66501508318216]
We introduce Generation-time Fine-grained Provenance, a task where models must generate fluent answers while simultaneously producing structured, sentence-level provenance triples.<n>By optimizing a composite reward for answer fidelity and provenance correctness, GenProve significantly outperforms 14 strong LLMs in joint evaluation.
arXiv Detail & Related papers (2026-01-08T13:30:30Z) - ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering [54.72902502486611]
ReAG is a Reasoning-Augmented Multimodal RAG approach that combines coarse- and fine-grained retrieval with a critic model that filters irrelevant passages.<n>ReAG significantly outperforms prior methods, improving answer accuracy and providing interpretable reasoning grounded in retrieved evidence.
arXiv Detail & Related papers (2025-11-27T19:01:02Z) - Unstructured Evidence Attribution for Long Context Query Focused Summarization [53.08341620504465]
We propose to extract unstructured (i.e., spans of any length) evidence in order to acquire more relevant and consistent evidence than in the fixed granularity case.<n>We show how existing systems struggle to copy and properly cite unstructured evidence, which also tends to be "lost-in-the-middle"
arXiv Detail & Related papers (2025-02-20T09:57:42Z) - Ground Every Sentence: Improving Retrieval-Augmented LLMs with Interleaved Reference-Claim Generation [51.8188846284153]
Attributed Text Generation (ATG) is proposed to enhance credibility and verifiability in RAG systems.<n>This paper proposes ReClaim, a fine-grained ATG method that alternates the generation of references and answers step by step.<n>With extensive experiments, we verify the effectiveness of ReClaim in extensive settings, achieving a citation accuracy rate of 90%.
arXiv Detail & Related papers (2024-07-01T20:47:47Z) - GERE: Generative Evidence Retrieval for Fact Verification [57.78768817972026]
We propose GERE, the first system that retrieves evidences in a generative fashion.
The experimental results on the FEVER dataset show that GERE achieves significant improvements over the state-of-the-art baselines.
arXiv Detail & Related papers (2022-04-12T03:49:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.