SAGE: Structured Agentic Graph Editing for Software Diagrams

• URL: http://arxiv.org/abs/2607.01102v1
• Date: Wed, 01 Jul 2026 15:55:09 GMT
• Title: SAGE: Structured Agentic Graph Editing for Software Diagrams
• Abstract summary: We present SAGE, a browser-based tool for prompt-guided editing of Draw.io and Mermaid-style engineering diagrams.<n>The tool maps diagrams into an editable graph representation, analyzes those intents into graph-oriented operation steps, validates and repairs common Draw.io XML issues, and stores successful results as recoverable versioned artifacts.
• Score: 5.927477764911397
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Software diagrams are difficult to edit through human-friendly interfaces because edits expressed in natural language must still preserve visual layout, editable structure, and semantic relationships. As a step forward, we present SAGE, a browser-based tool for prompt-guided editing of Draw.io and Mermaid-style engineering diagrams. The tool maps diagrams into an editable graph representation, translates natural language requests into structured edit intents, analyzes those intents into graph-oriented operation steps, validates and repairs common Draw.io XML issues, and stores successful results as recoverable versioned artifacts. This design separates structured state management from model-driven interpretation, while acknowledging that some prompt-guided XML edits remain model-assisted. The tool also supports direct canvas editing and a secondary mask-based image-editing workflow. We evaluate the system using unit tests and a Kubernetes architecture case study, measuring structural validity, edit success, preservation of unrelated elements, and failure causes.

Related papers

• FRAGMENT: Factorized Graph Representations for Document Generation and Editing via Entity-Aware Transformations [0.0]
  Generative models operating at the pixel or token level often struggle to capture spatial layout, textual content, and logical structure dependencies effectively.<n>We explore FRAGMENT, a generative framework that represents a document as a typed relational graph and factorizes its distribution as p(structure, content) = p(structure) * p(content | structure)<n>Experiments on DocLayNet, FUNSD, and SROIE evaluate FRAGMENT alongside representative autoregressive, layout-only, and graph-based baselines.
  arXiv  Detail & Related papers  (2026-08-19T08:29:19Z)
• ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition [60.25038184390257]
  ReDesign is an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities.<n>To evaluate editability at scale, we introduce the Figma Edit Replay Benchmark consisting of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructed outputs.
  arXiv  Detail & Related papers  (2026-07-28T10:53:33Z)
• SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions [66.46898035008782]
  We present SciDiagramEdit, a benchmark and skill-evolution framework that learns from natural paper revisions.<n>An agentic proposer continually refines the agent's skill specification from execution traces over multiple epochs.<n>The resulting skill progressively lifts edit accuracy on a held-out validation set.
  arXiv  Detail & Related papers  (2026-07-16T17:58:36Z)
• ReLayout: Versatile and Structure-Preserving Design Layout Editing via Relation-Aware Design Reconstruction [26.78568275114657]
  We focus on a foundational redesign task termed design layout editing.<n>We introduce four basic and important editing actions and standardize the format of editing operations.<n>We present Re, a novel framework for versatile structure-aware design editing that operates without triplet data.
  arXiv  Detail & Related papers  (2026-02-01T06:05:44Z)
• CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning [98.98349220451216]
  CoEditor++ is a training-free framework that decomposes editing into "what to edit" and "how to edit"<n>We show that CoEditor++ achieves state-of-the-art performance in both general editing and responsible editing tasks.<n>Our findings suggest the potential toward cognitive-centric instruction-based image editing.
  arXiv  Detail & Related papers  (2026-01-31T12:20:46Z)
• ChartE$^{3}$: A Comprehensive Benchmark for End-to-End Chart Editing [64.65742943745866]
  ChartE$3$ is an End-to-End Chart Editing benchmark.<n>It directly evaluates models without relying on intermediate natural language programs or code-level supervision.<n>It contains over 1,200 high-quality samples constructed via a well-designed data pipeline with human curation.
  arXiv  Detail & Related papers  (2026-01-29T13:29:27Z)
• Flowchart2Mermaid: A Vision-Language Model Powered System for Converting Flowcharts into Editable Diagram Code [0.3007949058551534]
  We present Flowchart2Mermaid, a lightweight web system that converts flowchart images into editable Mermaidjs code.<n>The interface supports mixed-initiative refinement through inline text editing, drag-and-drop node insertion, and natural-language commands interpreted by an integrated AI assistant.
  arXiv  Detail & Related papers  (2025-12-01T20:07:59Z)
• Charts Are Not Images: On the Challenges of Scientific Chart Editing [66.38730113476677]
  textitFigEdit is a benchmark for scientific figure editing comprising over 30,000 samples.<n>Our benchmark demonstrates the profound limitations of pixel-level manipulation.<n>By releasing textitFigEdit, we aim to enable systematic progress in structure-aware figure editing.
  arXiv  Detail & Related papers  (2025-11-30T06:13:48Z)
• Image Editing As Programs with Diffusion Models [69.05164729625052]
  We introduce Image Editing As Programs (IEAP), a unified image editing framework built upon the Diffusion Transformer (DiT) architecture.<n>IEAP approaches instructional editing through a reductionist lens, decomposing complex editing instructions into sequences of atomic operations.<n>Our framework delivers superior accuracy and semantic fidelity, particularly for complex, multi-step instructions.
  arXiv  Detail & Related papers  (2025-06-04T16:57:24Z)
• Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation [4.246322465055928]
  We propose Draw with Thought (DwT), a training-free framework that guides MLLMs to reconstruct diagrams into editable mxGraph XML code.<n>DwT enables interpretable and controllable outputs without model fine-tuning.<n>We release Plot2XML, a benchmark of 247 real-world scientific diagrams with gold-standard XML annotations.
  arXiv  Detail & Related papers  (2025-04-13T08:22:09Z)
• Lost in Edits? A $λ$-Compass for AIGC Provenance [119.95562081325552]
  We propose a novel latent-space attribution method that robustly identifies and differentiates authentic outputs from manipulated ones.<n>LambdaTracer is effective across diverse iterative editing processes, whether automated through text-guided editing tools such as InstructPix2Pix or performed manually with editing software such as Adobe Photoshop.
  arXiv  Detail & Related papers  (2025-02-05T06:24:25Z)
• Learning Structural Edits via Incremental Tree Transformations [102.64394890816178]
  We present a generic model for incremental editing of structured data (i.e., "structural edits") Our editor learns to iteratively generate tree edits (e.g., deleting or adding a subtree) and applies them to the partially edited data. We evaluate our proposed editor on two source code edit datasets, where results show that, with the proposed edit encoder, our editor significantly improves accuracy over previous approaches.
  arXiv  Detail & Related papers  (2021-01-28T16:11:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.