Editable Visual Design

• URL: http://arxiv.org/abs/2609.04034v2
• Date: Fri, 04 Sep 2026 07:34:25 GMT
• Title: Editable Visual Design
• Abstract summary: We propose Editable Visual Design, a new paradigm driven by a Coding Agent.<n>We designate the creative brain'' for requirement comprehension, task planning, and aesthetic judgment.<n>Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers.
• Score: 32.993324966532235
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator'' to synthesize standalone visual assets. Operating under an ``imagine first, then act'' closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.

Related papers

• DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation [21.789797121277896]
  DesignAsCode is a novel framework that reimagines graphic design as a programmatic task using HTML/CSS.<n>DesignAsCode significantly outperforms state-of-the-art rendering baselines in both structural validity and aesthetic quality.
  arXiv  Detail & Related papers  (2026-02-06T05:10:19Z)
• Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning [56.24016465596292]
  A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric.<n>We introduce the task of Visual Metaphor Transfer (VMT), which challenges models to autonomously decouple the "creative essence" from a reference image and re-materialize that abstract logic onto a user-specified subject.<n>Our method significantly outperforms SOTA baselines in metaphor consistency, analogy appropriateness, and visual creativity, paving the way for automated high-impact creative applications in advertising and media.
  arXiv  Detail & Related papers  (2026-02-01T17:01:36Z)
• PosterCopilot: Toward Layout Reasoning and Controllable Editing for Professional Graphic Design [29.264277919540955]
  PosterCopilot is a framework that advances layout reasoning and controllable editing for professional graphic design.<n>We introduce a progressive three-stage training strategy that equips LMMs with geometric understanding and aesthetic reasoning for layout design.<n>We develop a complete workflow that couples the trained LMM-based design model with generative models, enabling layer-controllable, iterative editing for precise element refinement.
  arXiv  Detail & Related papers  (2025-12-03T18:59:37Z)
• MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues [106.02577891104079]
  We propose MagicQuill V2, a novel system that introduces a textbflayered composition paradigm to generative image editing.<n>Our method deconstructs creative intent into a stack of controllable visual cues.
  arXiv  Detail & Related papers  (2025-12-02T18:59:58Z)
• IGD: Instructional Graphic Design with Multimodal Layer Generation [83.31320209596991]
  Two-stage methods that rely primarily on layout generation lack creativity and intelligence, making graphic design still labor-intensive.<n>We propose instructional graphic designer (IGD) to swiftly generate multimodal layers with editable flexibility with only natural language instructions.
  arXiv  Detail & Related papers  (2025-07-14T04:31:15Z)
• Rethinking Layered Graphic Design Generation with a Top-Down Approach [76.33538798060326]
  Graphic design is crucial for conveying ideas and messages. Designers usually organize their work into objects, backgrounds, and vectorized text layers to simplify editing.<n>With the rise of GenAI methods, an endless supply of high-quality graphic designs in pixel format has become more accessible.<n>Despite this, non-layered designs still inspire human designers, influencing their choices in layouts and text styles, ultimately guiding the creation of layered designs.<n>Motivated by this observation, we propose Accordion, a graphic design generation framework taking the first attempt to convert AI-generated designs into editable layered designs.
  arXiv  Detail & Related papers  (2025-07-08T02:26:08Z)
• Generative Image Layer Decomposition with Visual Effects [49.75021036203426]
  LayerDecomp is a generative framework for image layer decomposition.<n>It produces clean backgrounds and high-quality transparent foregrounds with faithfully preserved visual effects.<n>Our method achieves superior quality in layer decomposition, outperforming existing approaches in object removal and spatial editing tasks.
  arXiv  Detail & Related papers  (2024-11-26T20:26:49Z)
• MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models [51.1034358143232]
  We introduce component-controllable personalization, a new task that enables users to customize and reconfigure individual components within concepts.<n>This task faces two challenges: semantic pollution, where undesired elements disrupt the target concept, and semantic imbalance, which causes disproportionate learning of the target concept and component.<n>We design MagicTailor, a framework that uses Dynamic Masked Degradation to adaptively perturb unwanted visual semantics and Dual-Stream Balancing for more balanced learning of desired visual semantics.
  arXiv  Detail & Related papers  (2024-10-17T09:22:53Z)
• Alfie: Democratising RGBA Image Generation With No $$$ [33.334956022229846]
  We propose a fully-automated approach for obtaining RGBA illustrations by modifying the inference-time behavior of a pre-trained Diffusion Transformer model. We force the generation of entire subjects without sharp croppings, whose background is easily removed for seamless integration into design projects or artistic scenes.
  arXiv  Detail & Related papers  (2024-08-27T07:13:44Z)
• BlenderAlchemy: Editing 3D Graphics with Vision-Language Models [4.852796482609347]
  A vision-based edit generator and state evaluator work together to find the correct sequence of actions to achieve the goal. Inspired by the role of visual imagination in the human design process, we supplement the visual reasoning capabilities of Vision-Language Models with "imagined" reference images.
  arXiv  Detail & Related papers  (2024-04-26T19:37:13Z)
• LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [80.61492265221817]
  Graphic layout designs play an essential role in visual communication. Yet handcrafting layout designs is skill-demanding, time-consuming, and non-scalable to batch production. Generative models emerge to make design automation scalable but it remains non-trivial to produce designs that comply with designers' desires.
  arXiv  Detail & Related papers  (2022-12-19T21:57:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.