DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering
- URL: http://arxiv.org/abs/2608.29037v1
- Date: Sat, 29 Aug 2026 04:07:41 GMT
- Title: DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering
- Abstract summary: We propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework.<n>A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable.<n>Experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs.
- Score: 41.13451707400618
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Real-world degradations such as blur, shadow, distortion, and moire patterns severely impair the document question-answering capabilities of Multimodal Large Language Models (MLLMs). Applying restoration tools before Visual Question Answering (VQA) is an intuitive solution. However, existing restoration approaches remain limited, as manually designing and executing restoration strategies is labor-intensive and requires domain expertise. Agentic restoration offers new possibilities for automation, yet existing frameworks primarily target natural images and pursue perceptual quality, overlooking that restoration should serve downstream tasks rather than optimize generic image quality metrics. To this end, we explore the value of agentic restoration for real-world degraded document VQA and propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework. DocIntent first assesses question answerability, then identifies task-relevant degradations and selectively invokes restoration tools. A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable. The entire process requires no additional pretrained degradation classifier or image quality assessment model. Extensive experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs. The code and experimental data will be publicly available.
Related papers
- Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents [54.85451496831771]
Causal-AgentIR is a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence.<n>It organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph.<n>This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions.
arXiv Detail & Related papers (2026-07-23T09:59:44Z) - QuReC: All-in-One Image Restoration with Query-Specific Guidance and Local-Global Response Calibration [20.33280733198936]
All-in-one image restoration aims to recover clean images degraded by multiple corruption types using a single unified model.<n>QuReC consists of a Degradation Reconstruction Module (DQRM) and a Local-Global Response Module (LGRCM)<n>DQRM matches each spatial query against a degradation prototype space to reconstruct a query-specific degradation representation.<n>LGRCM performs local-global dual-branch aggregation and calibrates the aggregated responses with learnable priors.
arXiv Detail & Related papers (2026-07-16T15:10:00Z) - Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration [84.3817904120563]
Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
arXiv Detail & Related papers (2026-03-27T13:13:44Z) - SimpleCall: A Lightweight Image Restoration Agent in Label-Free Environments with MLLM Perceptual Feedback [27.198190496709433]
Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations.<n>Recent restoration agents, powered by vision-language models and large language models, offer promising restoration capabilities but suffer from bottlenecks.<n>We propose a policy optimization-based restoration framework that learns an lightweight agent to determine tool-calling sequences.
arXiv Detail & Related papers (2025-12-21T05:12:25Z) - MoA-VR: A Mixture-of-Agents System Towards All-in-One Video Restoration [62.929029990341796]
Real-world videos often suffer from complex degradations, such as noise, compression artifacts, and low-light distortions.<n>We propose MoA-VR, which mimics the reasoning and processing procedures of human professionals through three coordinated agents.<n>Specifically, we construct a large-scale and high-resolution video degradation recognition benchmark and build a vision-language model (VLM) driven degradation identifier.
arXiv Detail & Related papers (2025-10-09T17:42:51Z) - UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity [79.90839080916913]
We present our UniRestorer with improved restoration performance.<n>Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model.<n>In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration.
arXiv Detail & Related papers (2024-12-28T14:09:08Z) - Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restoration [33.163161549726446]
Perceive-IR is a novel backbone-agnostic All-in-One image restoration framework for fine-grained quality control.<n>Its modular structure allows core components to function independently of specific backbones, enabling seamless integration into advanced restoration models.
arXiv Detail & Related papers (2024-08-28T17:58:54Z) - DocRes: A Generalist Model Toward Unifying Document Image Restoration Tasks [38.6455393290578]
We propose DocRes, a model that unifies five document image restoration tasks including dewarping, deshadowing, appearance enhancement, deblurring, and binarization.
To instruct DocRes to perform different restoration tasks, we propose a novel visual prompt approach called Dynamic Task-Specific Prompt (DTSPrompt)
DTSPrompt is more flexible than prior visual prompt approaches as it can be seamlessly applied and adapted to inputs with high and variable resolutions.
arXiv Detail & Related papers (2024-05-07T15:35:43Z) - InstructIR: High-Quality Image Restoration Following Human Instructions [61.1546287323136]
We present the first approach that uses human-written instructions to guide the image restoration model.
Our method, InstructIR, achieves state-of-the-art results on several restoration tasks.
arXiv Detail & Related papers (2024-01-29T18:53:33Z) - SPIRE: Semantic Prompt-Driven Image Restoration [66.26165625929747]
We develop SPIRE, a Semantic and restoration Prompt-driven Image Restoration framework.
Our approach is the first framework that supports fine-level instruction through language-based quantitative specification of the restoration strength.
Our experiments demonstrate the superior restoration performance of SPIRE compared to the state of the arts.
arXiv Detail & Related papers (2023-12-18T17:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.