EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution
- URL: http://arxiv.org/abs/2604.09568v1
- Date: Fri, 20 Feb 2026 11:11:02 GMT
- Title: EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution
- Abstract summary: EvoDiagram is an agentic framework that generates object-level editable diagrams via an intermediate canvas schema.<n>EvoDiagram employs a coordinated multi-agent system to decouple semantic intent from rendering logic.<n>We further release CanvasBench, a benchmark consisting of both data and metrics for canvas-based diagramming.
- Score: 46.35311453619801
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: High-fidelity diagram creation requires the complex orchestration of semantic topology, visual styling, and spatial layout, posing a significant challenge for automated systems. Existing methods also suffer from a representation gap: pixel-based models often lack precise control, while code-based synthesis limits intuitive flexibility. To bridge this gap, we introduce EvoDiagram, an agentic framework that generates object-level editable diagrams via an intermediate canvas schema. EvoDiagram employs a coordinated multi-agent system to decouple semantic intent from rendering logic, resolving conflicts across heterogeneous design layers. Additionally, we propose a design knowledge evolution mechanism that distills execution traces into a hierarchical memory of domain guidelines, enabling agents to retrieve context-aware expertise adaptively. We further release CanvasBench, a benchmark consisting of both data and metrics for canvas-based diagramming. Extensive experiments demonstrate that EvoDiagram exhibits excellent performance and balance against baselines in generating editable, structurally consistent, and aesthetically coherent diagrams. Our code is available at https://github.com/AuraX-AI/EvoDiagram.
Related papers
- DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable [10.070492917829995]
We introduce DrawAI, comprising an agentic benchmark, DrawAI-Bench, and a reconstruction workflow, DrawAI-Flow.<n>We formulate image-to-editable reconstruction, which recovers a structured, directly manipulable artifact from an image while preserving its visual and semantic content.<n>The results show that reconstruction quality and costs vary substantially across model-harness configurations, while DrawAI-Flow consistently improves editable structure.
arXiv Detail & Related papers (2026-08-01T09:05:06Z) - VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing [37.60481878724908]
We present VCG-Bench, a unified benchmark for visual-centrictext ttmxGraph tasks.<n> VCG-Bench comprises: (1) a taxonomized dataset of 1,449 diverse diagrams spanning 6 domains and 15 sub-domains, (2) a paradigm definition that integrates Generation (Vision-to-Code) and Editability (Code-to-Code), and (3) a Tailored Evaluation Protocol employing multi-dimensional metrics such as textttmxGraph Execution Success Rate, Style Consistency Score (SCS), etc.
arXiv Detail & Related papers (2026-05-15T06:59:28Z) - Semantic-Structural Alignment for Generative Pictorial Charts [59.45629259524998]
We present a generative framework for the automated synthesis of pictorial charts.<n>We frame the problem as a dual-conditioned generation task guided by two parallel external control signals.<n>Our method produces pictorial charts that are both artistically compelling and structurally consistent.
arXiv Detail & Related papers (2026-05-05T05:20:46Z) - OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward [8.227370271724162]
We introduce a novel visual feedback strategy named Visual Interrogation Verifies All (textscViva)<n>textscViva rewards the visual structure of rendered diagrams through a generative approach.<n>We construct M3$2$Diagram, the first large-scale diagram code generation dataset.
arXiv Detail & Related papers (2026-04-07T07:10:24Z) - Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning [56.24016465596292]
A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric.<n>We introduce the task of Visual Metaphor Transfer (VMT), which challenges models to autonomously decouple the "creative essence" from a reference image and re-materialize that abstract logic onto a user-specified subject.<n>Our method significantly outperforms SOTA baselines in metaphor consistency, analogy appropriateness, and visual creativity, paving the way for automated high-impact creative applications in advertising and media.
arXiv Detail & Related papers (2026-02-01T17:01:36Z) - Youtu-GraphRAG: Vertically Unified Agents for Graph Retrieval-Augmented Complex Reasoning [32.78218766121055]
Graph retrieval-augmented generation (GraphRAG) has effectively enhanced large language models in complex reasoning.<n>We propose a vertically unified agentic paradigm, Youtu-GraphRAG, to jointly connect the entire framework as an intricate integration.
arXiv Detail & Related papers (2025-08-27T13:13:20Z) - SketchAgent: Generating Structured Diagrams from Hand-Drawn Sketches [54.06877048295693]
We introduce SketchAgent, a system designed to automate the transformation of hand-drawn sketches into structured diagrams.<n>SketchAgent integrates sketch recognition, symbolic reasoning, and iterative validation to produce semantically coherent and structurally accurate diagrams.<n>By streamlining the diagram generation process, SketchAgent holds great promise for applications in design, education, and engineering.
arXiv Detail & Related papers (2025-08-02T07:22:51Z) - Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation [91.17994756436259]
Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains.<n>Existing approaches are fundamentally constrained by their reliance on a template graph modification paradigm with a predefined set of agents and hard-coded interaction structures.<n>We propose ARG-Designer, a novel autoregressive model that operationalizes this paradigm by constructing the collaboration graph from scratch.
arXiv Detail & Related papers (2025-07-24T09:17:41Z) - Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation [4.246322465055928]
We propose Draw with Thought (DwT), a training-free framework that guides MLLMs to reconstruct diagrams into editable mxGraph XML code.<n>DwT enables interpretable and controllable outputs without model fine-tuning.<n>We release Plot2XML, a benchmark of 247 real-world scientific diagrams with gold-standard XML annotations.
arXiv Detail & Related papers (2025-04-13T08:22:09Z) - EvoMesh: Adaptive Physical Simulation with Hierarchical Graph Evolutions [61.89682310797067]
EvoMesh is a fully differentiable framework that jointly learns graph hierarchies and physical dynamics.<n>We show that EvoMesh outperforms recent fixed-hierarchy message passing networks by large margins.
arXiv Detail & Related papers (2024-10-03T15:18:00Z) - T-GAE: Transferable Graph Autoencoder for Network Alignment [79.89704126746204]
T-GAE is a graph autoencoder framework that leverages transferability and stability of GNNs to achieve efficient network alignment without retraining.
Our experiments demonstrate that T-GAE outperforms the state-of-the-art optimization method and the best GNN approach by up to 38.7% and 50.8%, respectively.
arXiv Detail & Related papers (2023-10-05T02:58:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.