Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation

• URL: http://arxiv.org/abs/2606.26907v2
• Date: Fri, 26 Jun 2026 14:10:09 GMT
• Title: Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generation
• Abstract summary: We propose Qwen-Image-Agent, a unified agentic framework that integrates plan, reason, search, memory and feedback in a context-centric manner.<n>Qwen-Image-Agent treats user input as partial context and progressively constructs the generation context through Context-Aware Planning and Context Grounding.<n> Experiments on IA-Bench, Mindbench and WISE-Verified show that Qwen-Image-Agent outperforms strong baselines and achieves state-of-the-art performance.
• Score: 70.60638032720748
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While text-to-image (T2I) models have achieved remarkable progress, they struggle with real-world requests that are often underspecified, implicit, or dependent on up-to-date knowledge. We identify this challenge as the Context Gap: the mismatch between the user context and the sufficient generation context for T2I models. To bridge this gap, we propose Qwen-Image-Agent, a unified agentic framework that integrates plan, reason, search, memory and feedback in a context-centric manner. Qwen-Image-Agent treats user input as partial context and progressively constructs the generation context through Context-Aware Planning and Context Grounding. Specifically, Context-Aware Planning identifies missing context and plans how it should be acquired and used, while Context Grounding gathers this context from reason, search, memory, and feedback. To evaluate agentic image generation, we further introduce Image Agent Bench (IA-Bench), a benchmark covering four core image agent capabilities: Plan, Reason, Search, and Memory. Experiments on IA-Bench, Mindbench and WISE-Verified show that Qwen-Image-Agent outperforms strong baselines and achieves state-of-the-art performance.

Related papers

• ImageAuditor: Membership Inference Attack against Image-based Retrieval-Augmented Generation [9.64120050798558]
  Image-based Retrieval-Augmented Generation (IRAG) conditions a frozen generator on reference images retrieved from an external database.<n>Because these databases are opaque and web-scraped, copyright holders need ways to audit whether specific images appear in them.<n>We introduce the first MIA tailored to IRAG, ImageAuditor, which decomposes each attack query into a retrieval segment and an extraction segment.
  arXiv  Detail & Related papers  (2026-06-02T09:03:56Z)
• DeepImageSearch: Benchmarking Multimodal Agents for Context-Aware Image Retrieval in Visual Histories [52.57197752244638]
  We introduce DeepImageSearch, a novel agentic paradigm that reformulates image retrieval as an autonomous exploration task.<n>Models must plan and perform multi-step reasoning over raw visual histories to locate targets based on implicit contextual cues.<n>We construct DISBench, a challenging benchmark built on interconnected visual data.
  arXiv  Detail & Related papers  (2026-02-11T12:51:10Z)
• Self-Supervised Cross-Modal Text-Image Time Series Retrieval in Remote Sensing [3.271701183630488]
  Cross-modal text-image time series retrieval (text-ITSR) is presented.<n>We focus our attention on text-ITSR in pairs of images (i.e., bitemporal images)<n>Our method consists of two key components: 1) modality-specific encoders to model the semantic content of bitemporal images and text sentences with discriminative features; and 2) modality-specific projection heads to align textual and image representations in a shared embedding space.
  arXiv  Detail & Related papers  (2025-01-31T11:14:38Z)
• In-Context LoRA for Diffusion Transformers [49.288489286276146]
  We show that text-to-image DiTs can effectively perform in-context generation without any tuning. We name our models In-Context LoRA (IC-LoRA) Our pipeline generates high-fidelity image sets that better adhere to prompts.
  arXiv  Detail & Related papers  (2024-10-31T09:45:00Z)
• Openstory++: A Large-scale Dataset and Benchmark for Instance-aware Open-domain Visual Storytelling [81.69474860607542]
  We present Openstory++, a large-scale dataset combining additional instance-level annotations with both images and text. We also present Cohere-Bench, a pioneering benchmark framework for evaluating the image generation tasks when long multimodal context is provided.
  arXiv  Detail & Related papers  (2024-08-07T11:20:37Z)
• Divide and Conquer: Language Models can Plan and Self-Correct for Compositional Text-to-Image Generation [72.6168579583414]
  CompAgent is a training-free approach for compositional text-to-image generation with a large language model (LLM) agent as its core. Our approach achieves more than 10% improvement on T2I-CompBench, a comprehensive benchmark for open-world compositional T2I generation.
  arXiv  Detail & Related papers  (2024-01-28T16:18:39Z)
• Context Diffusion: In-Context Aware Image Generation [27.63447546705641]
  Context Diffusion is a diffusion-based framework that enables image generation models to learn from visual examples presented in context.<n>Our experiments and human evaluation demonstrate that Context Diffusion excels in both in-domain and out-of-domain tasks.
  arXiv  Detail & Related papers  (2023-12-06T16:19:51Z)
• OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluation [151.57313182844936]
  We propose a new interleaved generation framework based on prompting large-language models (LLMs) and pre-trained text-to-image (T2I) models, namely OpenLEAF. For model assessment, we first propose to use large multi-modal models (LMMs) to evaluate the entity and style consistencies of open-domain interleaved image-text sequences.
  arXiv  Detail & Related papers  (2023-10-11T17:58:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.