Figures as Programs: Recursive Generation of Editable Scientific Figures

• URL: http://arxiv.org/abs/2609.01006v1
• Date: Tue, 01 Sep 2026 09:53:47 GMT
• Title: Figures as Programs: Recursive Generation of Editable Scientific Figures
• Abstract summary: Recent image-generation models can synthesize visually appealing figures, but producing a human-satisfactory result in a single generation step remains difficult.<n>We formulate textscFigTree, a textitmulti-agent system that automatically transforms scientific paper into a structured vector figure.<n>A render-critic refinement loop jointly inspects the rendered figure and its underlying program, enabling visual defects to be traced to specific statements and accurately repaired.
• Score: 79.78366479117878
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Scientific methodology figures are essential for communicating complex methods clearly, yet creating them remains labor-intensive and typically requires multiple rounds of refinement. Recent image-generation models can synthesize visually appealing raster figures, but producing a human-satisfactory result in a single generation step remains difficult. Moreover, precise edits to raster figures are challenging for both humans and models. We formulate scientific figure generation as recursive SVG program construction and propose \textsc{FigTree}, a \textit{multi-agent} system that automatically transforms a scientific paper into a structured vector figure. \textsc{FigTree} grounds figure content in the source paper, decomposes a figure into a hierarchy of local regions, generates each region as a short SVG program, and assembles the resulting fragments. A render-critic refinement loop jointly inspects the rendered figure and its underlying program, enabling visual defects to be traced to specific statements and accurately repaired. We conduct extensive evaluations of \textsc{FigTree} on figure quality and editability, showing that \textsc{FigTree} produces high-quality figures, while also enabling more effective editing than existing raster-based methods.

Related papers

• VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphics [13.178383449521261]
  We present VectorHarness, a multi-agent framework for reconstruction that recovers components using type-appropriate native representations.<n>Experiments show that VectorHarness improves executable success and relation preservation, reduces avoidable fallback, and maintains high visual fidelity across heterogeneous graphics.
  arXiv  Detail & Related papers  (2026-09-09T15:36:36Z)
• GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers [2.593510481959727]
  We propose GenGA, a new generation framework that directly produces figures in vector format.<n>By generating figures as a collection of vector elements with a hierarchical structure, GenGA produces outputs that can be seamlessly imported into existing drawing tools.<n> Experimental results show that GenGA achieves superior editing simplicity compared to other methods, and even surpasses human-authored GAs in conciseness and semantic alignment.
  arXiv  Detail & Related papers  (2026-08-05T23:53:02Z)
• DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable [10.070492917829995]
  We introduce DrawAI, comprising an agentic benchmark, DrawAI-Bench, and a reconstruction workflow, DrawAI-Flow.<n>We formulate image-to-editable reconstruction, which recovers a structured, directly manipulable artifact from an image while preserving its visual and semantic content.<n>The results show that reconstruction quality and costs vary substantially across model-harness configurations, while DrawAI-Flow consistently improves editable structure.
  arXiv  Detail & Related papers  (2026-08-01T09:05:06Z)
• SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions [66.46898035008782]
  We present SciDiagramEdit, a benchmark and skill-evolution framework that learns from natural paper revisions.<n>An agentic proposer continually refines the agent's skill specification from execution traces over multiple epochs.<n>The resulting skill progressively lifts edit accuracy on a held-out validation set.
  arXiv  Detail & Related papers  (2026-07-16T17:58:36Z)
• Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs [62.54193387399707]
  We develop automated systems for producing publication-quality illustrations from scientific figures.<n>Crafter is a multi-agent harness figure generation that generalizes across figure types without architectural changes.<n>CraftEditor faithfully converts outputs into editable SVGs.
  arXiv  Detail & Related papers  (2026-05-28T22:04:30Z)
• VFIG: Vectorizing Complex Figures in SVG with Vision-Language Models [43.3181510471477]
  In practice, original vector source files are frequently lost or inaccessible.<n>We propose VFIG, a family of Vision-Language Models trained for complex and high-fidelity figure-to-SVG conversion.<n> VFIG achieves state-of-the-art performance among open-source models and performs on par with GPT-5.2.
  arXiv  Detail & Related papers  (2026-03-25T17:52:23Z)
• ChartE$^{3}$: A Comprehensive Benchmark for End-to-End Chart Editing [64.65742943745866]
  ChartE$3$ is an End-to-End Chart Editing benchmark.<n>It directly evaluates models without relying on intermediate natural language programs or code-level supervision.<n>It contains over 1,200 high-quality samples constructed via a well-designed data pipeline with human curation.
  arXiv  Detail & Related papers  (2026-01-29T13:29:27Z)
• Charts Are Not Images: On the Challenges of Scientific Chart Editing [66.38730113476677]
  textitFigEdit is a benchmark for scientific figure editing comprising over 30,000 samples.<n>Our benchmark demonstrates the profound limitations of pixel-level manipulation.<n>By releasing textitFigEdit, we aim to enable systematic progress in structure-aware figure editing.
  arXiv  Detail & Related papers  (2025-11-30T06:13:48Z)
• Point or Line? Using Line-based Representation for Panoptic Symbol Spotting in CAD Drawings [67.5600169375126]
  We study the task of panoptic symbol spotting in computer-aided design (CAD) drawings composed of vector graphical primitives.<n>Existing methods typically rely on imageization, graph construction, or point-based representation.<n>We propose VecFormer, a novel method that addresses these challenges through line-based representation of primitives.
  arXiv  Detail & Related papers  (2025-05-29T12:33:11Z)
• GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing [23.64662356622401]
  We present GlyphMastero, a specialized glyph encoder designed to guide the latent diffusion model for generating texts with stroke-level precision.<n>Our method achieves an 18.02% improvement in sentence accuracy over the state-of-the-art scene text editing baseline.
  arXiv  Detail & Related papers  (2025-05-08T03:11:58Z)
• TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision [114.56048848216254]
  We present a novel framework, TAPS3D, to train a text-guided 3D shape generator with pseudo captions. Based on rendered 2D images, we retrieve relevant words from the CLIP vocabulary and construct pseudo captions using templates. Our constructed captions provide high-level semantic supervision for generated 3D shapes.
  arXiv  Detail & Related papers  (2023-03-23T13:53:16Z)
• OCR-VQGAN: Taming Text-within-Image Generation [4.5718306968064635]
  We present OCR-VQGAN, an image encoder, and decoder that leverages OCR pre-trained features to optimize a text perceptual loss. We demonstrate the effectiveness of OCR-VQGAN by conducting several experiments on the task of figure reconstruction.
  arXiv  Detail & Related papers  (2022-10-19T16:37:48Z)
• Promoting Graph Awareness in Linearized Graph-to-Text Generation [72.83863719868364]
  We study the ability of linearized models to encode local graph structures. Our findings motivate solutions to enrich the quality of models' implicit graph encodings. We find that these denoising scaffolds lead to substantial improvements in downstream generation in low-resource settings.
  arXiv  Detail & Related papers  (2020-12-31T18:17:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.