Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation

• URL: http://arxiv.org/abs/2604.22302v1
• Date: Fri, 24 Apr 2026 07:33:52 GMT
• Title: Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation
• Abstract summary: We introduce KVBench, a curriculum-grounded benchmark for evaluating knowledge-intensive T2I generation.<n> KVBench covers six senior high-school subjects: Biology, Chemistry, Geography, History, Mathematics, and Physics.<n>We evaluate 14 state-of-the-art open- and closed-source models, revealing substantial deficiencies in logical reasoning, symbolic precision, and multilingual robustness.
• Score: 26.409191201169367
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliability in knowledge-intensive settings remains largely unexplored. Unlike natural image generation, knowledge visualization requires not only semantic alignment but also strict adherence to domain knowledge, structural constraints, and symbolic conventions, exposing a critical gap between visual plausibility and scientific correctness. To systematically study this problem, we introduce KVBench, a curriculum-grounded benchmark for evaluating knowledge-intensive T2I generation. KVBench covers six senior high-school subjects: Biology, Chemistry, Geography, History, Mathematics, and Physics. The benchmark consists of 1,800 expert-curated prompts derived from over 30 authoritative textbooks. Using this benchmark, we evaluate 14 state-of-the-art open- and closed-source models, revealing substantial deficiencies in logical reasoning, symbolic precision, and multilingual robustness, with open-source models consistently underperforming proprietary systems. To address these limitations, we further propose KE-Check, a two-stage framework that improves scientific fidelity via (1) Knowledge Elaboration for structured prompt enrichment, and (2) Checklist-Guided Refinement for explicit constraint enforcement through violation identification and constraint-guided editing. KE-Check effectively mitigates scientific hallucinations, narrowing the performance gap between open-source and leading closed-source models. Data and codes are publicly available at https://github.com/zhaoran66/KVBench.

Related papers

• Faithful, Enriched, and Precise: Benchmarking Natural-Science Illustration Generation by T2I models [49.93401412148884]
  We introduce FEPBench, a benchmark built from carefully selected high-quality scientific illustrations.<n>We evaluate T2I models along three dimensions: instruction faithfulness, reasoning enrichment, and semantic precision.<n>Results show that even state-of-the-art closed-source models, such as GPT Image 2 and Nano Banana Pro, still suffer from text-rendering bottlenecks, limited reasoning enrichment, and difficulty balancing generation richness with precision.
  arXiv  Detail & Related papers  (2026-06-04T09:49:02Z)
• EruDiff: Refactoring Knowledge in Diffusion Models for Advanced Text-to-Image Synthesis [49.883192716595026]
  EruDiff aims to rectify the knowledge distribution of intractable implicit prompts with that of well-defined explicit anchors.<n>We develop the Diffusion Knowledge Distribution Matching (DK-DM) to register the knowledge distribution of implicit prompts with that of well-defined explicit anchors.<n>We employ the Negative-Only Reinforcement Learning (NO-RL) strategy for fine-grained correction.
  arXiv  Detail & Related papers  (2026-03-21T14:04:08Z)
• GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing [67.29558599215902]
  GRADE is the first benchmark to assess discipline-informed knowledge and reasoning in image editing.<n>GRADE comprises 520 carefully curated samples across 10 academic domains.
  arXiv  Detail & Related papers  (2026-03-12T17:59:52Z)
• Few-Step Distillation for Text-to-Image Generation: A Practical Guide [60.99392100471019]
  Diffusion distillation has dramatically accelerated class-conditional image synthesis, but its applicability to open-ended text-to-image (T2I) generation is still unclear.<n>We present the first systematic study that adapts and compares state-of-the-art distillation techniques on a strong T2I teacher model, FLUX.1-lite.
  arXiv  Detail & Related papers  (2025-12-15T05:58:36Z)
• CLLMRec: LLM-powered Cognitive-Aware Concept Recommendation via Semantic Alignment and Prerequisite Knowledge Distillation [3.200298153814017]
  The growth of Massive Open Online Courses (MOOCs) presents significant challenges for personalized learning, where concept is crucial.<n>Existing approaches typically rely on heterogeneous information networks or knowledge graphs to capture conceptual relationships, combined with knowledge tracing models to assess learners' cognitive states.<n>This paper proposes CLLMRec, a novel framework that leverages Large Language Models to generate personalized concept recommendations.
  arXiv  Detail & Related papers  (2025-11-21T08:37:39Z)
• KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Models [88.58758610679762]
  We introduce KRIS-Bench (Knowledge-based Reasoning in Image-editing Systems Benchmark), a diagnostic benchmark designed to assess models through a cognitively informed lens.<n>We categorize editing tasks across three foundational knowledge types: Factual, Conceptual, and Procedural.<n>To support fine-grained evaluation, we propose a protocol that incorporates a novel Knowledge Plausibility metric, enhanced by knowledge hints and calibrated through human studies.
  arXiv  Detail & Related papers  (2025-05-22T14:08:59Z)
• Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion [21.37254997228105]
  Text-to-Image (T2I) diffusion models encode factual knowledge into their parameters. Knowledge editing techniques aim to update model knowledge in a targeted way. We design a T2I knowledge editing framework by comprehensively spanning on three phases. We introduce textbfMPE, a simple but effective approach for T2I knowledge editing.
  arXiv  Detail & Related papers  (2024-09-26T15:07:30Z)
• Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation [68.13453771001522]
  We propose a multimodal intensive ZSL framework that matches regions of images with corresponding semantic embeddings. We conduct extensive experiments and evaluate our model on large-scale real-world data.
  arXiv  Detail & Related papers  (2023-06-14T13:07:48Z)
• VEM$^2$L: A Plug-and-play Framework for Fusing Text and Structure Knowledge on Sparse Knowledge Graph Completion [14.537509860565706]
  We propose a plug-and-play framework VEM2L over sparse Knowledge Graphs to fuse knowledge extracted from text and structure messages into a unity. Specifically, we partition knowledge acquired by models into two nonoverlapping parts. We also propose a new fusion strategy proved by Variational EM algorithm to fuse the generalization ability of models.
  arXiv  Detail & Related papers  (2022-07-04T15:50:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.