Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents

• URL: http://arxiv.org/abs/2607.21125v1
• Date: Thu, 23 Jul 2026 09:59:44 GMT
• Title: Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
• Abstract summary: Causal-AgentIR is a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence.<n>It organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph.<n>This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions.
• Score: 54.85451496831771
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Image restoration agents have recently emerged as a flexible paradigm for handling diverse and unpredictable degradations in real-world scenarios. Existing agents typically formulate restoration as a tool-using process, where the agent perceives degradations, searches candidate tools, executes restoration operations, and revises the plan through reflection or rollback. However, their knowledge is often stored as static tool descriptions, manually defined degradation priors, or unstructured textual summaries, which limits the accumulation, verification, revision, and forgetting of restoration knowledge over long-term experience. In this paper, we propose Causal-AgentIR, a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence. Instead of representing restoration experience as isolated textual records, Causal-AgentIR organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph. This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions. The framework further organizes multiple agents into a collaborative system, including planning, degradation analysis, tool expertise, causal memory reasoning, outcome critique, and memory curation. Through this design, restoration experience can be added, updated, merged, reinforced, ignored, or discarded according to observed quality changes and feedback, allowing the agent to maintain reliable and transferable restoration knowledge. Extensive experiments demonstrate the effectiveness of the proposed framework.

Related papers

• DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering [41.13451707400618]
  We propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework.<n>A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable.<n>Experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs.
  arXiv  Detail & Related papers  (2026-08-29T04:07:41Z)
• DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration [31.441586261696617]
  This paper proposes DVANet, a collaborative unfolding process between degradation-aware observation consistency and visual-prior-guided reconstruction.<n>Experiments demonstrate that DVANet achieves superior or competitive performance on multi-scenario degradation and cross-domain image restoration tasks.
  arXiv  Detail & Related papers  (2026-06-17T14:09:39Z)
• RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations [51.43574078961796]
  We introduce RepoMirage, a two-stage evaluation suite built on SWE-Bench Verified.<n>RepoMirage-Perturb applies three types of semantics-preserving repository-level perturbations, revealing a clear performance drop when correct solving requires broader context access.<n>We propose RepoAnchor, a structure-first prototype workflow that separates repository exploration from downstream problem solving.
  arXiv  Detail & Related papers  (2026-05-25T06:26:43Z)
• RIRF: Reasoning Image Restoration Framework [18.387213732491393]
  We propose Reason and Restore (R&R), a novel framework that integrates structured Chain-of-Thought (CoT) reasoning into the image restoration pipeline.<n>R&R introduces an explicit reasoner, implemented by fine-tuning Qwen3-VL, to diagnose degradation types, quantify degradation severity, infer key degradation-related factors, and describe relevant scene and object semantics.<n>The resulting structured reasoning provides interpretable and fine-grained diagnostic priors for the restorer.
  arXiv  Detail & Related papers  (2026-04-10T17:29:31Z)
• Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration [84.3817904120563]
  Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light.<n>We propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework.<n> Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification.
  arXiv  Detail & Related papers  (2026-03-27T13:13:44Z)
• SimpleCall: A Lightweight Image Restoration Agent in Label-Free Environments with MLLM Perceptual Feedback [27.198190496709433]
  Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations.<n>Recent restoration agents, powered by vision-language models and large language models, offer promising restoration capabilities but suffer from bottlenecks.<n>We propose a policy optimization-based restoration framework that learns an lightweight agent to determine tool-calling sequences.
  arXiv  Detail & Related papers  (2025-12-21T05:12:25Z)
• Learning to Restore Multi-Degraded Images via Ingredient Decoupling and Task-Aware Path Adaptation [51.10017611491389]
  Real-world images often suffer from multiple coexisting degradations, such as rain, noise, and haze coexisting in a single image.<n>We propose an adaptive multi-degradation image restoration network that reconstructs images by leveraging decoupled representations of degradation ingredients.<n>The resulting tightly integrated architecture, termed IMDNet, is extensively validated through experiments.
  arXiv  Detail & Related papers  (2025-11-07T01:50:36Z)
• A Multimodal RAG Framework for Housing Damage Assessment: Collaborative Optimization of Image Encoding and Policy Vector Retrieval [0.0]
  After natural disasters, accurate evaluations of damage to housing are important for insurance claims response and planning of resources.<n>In this work, we introduce a novel multimodal retrieval-augmented generation (MM-RAG) framework.<n>The framework takes end-to-end training, and combines the comparison loss, the retrieval loss and the generation loss to form multi-task optimization objectives.
  arXiv  Detail & Related papers  (2025-09-10T01:58:07Z)
• UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity [79.90839080916913]
  We present our UniRestorer with improved restoration performance.<n>Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model.<n>In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration.
  arXiv  Detail & Related papers  (2024-12-28T14:09:08Z)
• SPIRE: Semantic Prompt-Driven Image Restoration [66.26165625929747]
  We develop SPIRE, a Semantic and restoration Prompt-driven Image Restoration framework. Our approach is the first framework that supports fine-level instruction through language-based quantitative specification of the restoration strength. Our experiments demonstrate the superior restoration performance of SPIRE compared to the state of the arts.
  arXiv  Detail & Related papers  (2023-12-18T17:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.