ReLayout: Versatile and Structure-Preserving Design Layout Editing via Relation-Aware Design Reconstruction

• URL: http://arxiv.org/abs/2602.01046v1
• Date: Sun, 01 Feb 2026 06:05:44 GMT
• Title: ReLayout: Versatile and Structure-Preserving Design Layout Editing via Relation-Aware Design Reconstruction
• Abstract summary: We focus on a foundational redesign task termed design layout editing.<n>We introduce four basic and important editing actions and standardize the format of editing operations.<n>We present Re, a novel framework for versatile structure-aware design editing that operates without triplet data.
• Score: 26.78568275114657
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Automated redesign without manual adjustments marks a key step forward in the design workflow. In this work, we focus on a foundational redesign task termed design layout editing, which seeks to autonomously modify the geometric composition of a design based on user intents. To overcome the ambiguity of user needs expressed in natural language, we introduce four basic and important editing actions and standardize the format of editing operations. The underexplored task presents a unique challenge: satisfying specified editing operations while simultaneously preserving the layout structure of unedited elements. Besides, the scarcity of triplet (original design, editing operation, edited design) samples poses another formidable challenge. To this end, we present ReLayout, a novel framework for versatile and structure-preserving design layout editing that operates without triplet data. Specifically, ReLayout first introduces the relation graph, which contains the position and size relationships among unedited elements, as the constraint for layout structure preservation. Then, relation-aware design reconstruction (RADR) is proposed to bypass the data challenge. By learning to reconstruct a design from its elements, a relation graph, and a synthesized editing operation, RADR effectively emulates the editing process in a self-supervised manner. A multi-modal large language model serves as the backbone for RADR, unifying multiple editing actions within a single model and thus achieving versatile editing after fine-tuning. Qualitative, quantitative results and user studies show that ReLayout significantly outperforms the baseline models in terms of editing quality, accuracy, and layout structure preservation.

Related papers

• LLM-Aided Design for Manufacturing: A Multi-Agent System for Intent-Preserving Redesign of CAD for Improved Manufacturability [9.129375375221457]
  We introduce autonomous, intent-preserving Design for Manufacturing (DFM) redesign of CAD parts.<n>We instead produce it as a sequence of individually verified design transitions.<n>Iterating review and verified modification compounds edits into parts more complex than one-shot generators reliably produce.
  arXiv  Detail & Related papers  (2026-09-03T18:19:27Z)
• ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition [60.25038184390257]
  ReDesign is an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities.<n>To evaluate editability at scale, we introduce the Figma Edit Replay Benchmark consisting of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructed outputs.
  arXiv  Detail & Related papers  (2026-07-28T10:53:33Z)
• SAGE: Structured Agentic Graph Editing for Software Diagrams [5.927477764911397]
  We present SAGE, a browser-based tool for prompt-guided editing of Draw.io and Mermaid-style engineering diagrams.<n>The tool maps diagrams into an editable graph representation, analyzes those intents into graph-oriented operation steps, validates and repairs common Draw.io XML issues, and stores successful results as recoverable versioned artifacts.
  arXiv  Detail & Related papers  (2026-07-01T15:55:09Z)
• CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing [51.73433734209541]
  Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
  arXiv  Detail & Related papers  (2026-03-12T11:15:11Z)
• CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning [98.98349220451216]
  CoEditor++ is a training-free framework that decomposes editing into "what to edit" and "how to edit"<n>We show that CoEditor++ achieves state-of-the-art performance in both general editing and responsible editing tasks.<n>Our findings suggest the potential toward cognitive-centric instruction-based image editing.
  arXiv  Detail & Related papers  (2026-01-31T12:20:46Z)
• FlowDC: Flow-Based Decoupling-Decay for Complex Image Editing [52.54102743380658]
  We propose FlowDC, which decouples the complex editing into multiple sub-editing effects and superposes them in parallel during the editing process.<n>FlowDC shows superior results compared with existing methods.
  arXiv  Detail & Related papers  (2025-12-12T09:08:39Z)
• ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models [7.288330685534444]
  We introduce Re, a novel method that leverages relation-CoT to generate more reasonable and coherent layouts.<n>Specifically, we enhance layout annotations by introducing explicit relation definitions, such as region, salient, and margin between elements.<n>We also introduce a layout prototype sampler, which defines layout prototype features across three dimensions and quantifies distinct layout styles.
  arXiv  Detail & Related papers  (2025-07-08T01:13:43Z)
• Image Editing As Programs with Diffusion Models [69.05164729625052]
  We introduce Image Editing As Programs (IEAP), a unified image editing framework built upon the Diffusion Transformer (DiT) architecture.<n>IEAP approaches instructional editing through a reductionist lens, decomposing complex editing instructions into sequences of atomic operations.<n>Our framework delivers superior accuracy and semantic fidelity, particularly for complex, multi-step instructions.
  arXiv  Detail & Related papers  (2025-06-04T16:57:24Z)
• Improving Editability in Image Generation with Layer-wise Memory [23.004027029130953]
  Current editing approaches, primarily designed for single-object modifications, struggle with sequential editing.<n>We propose enabling rough mask inputs that preserve existing content while naturally integrating new elements.<n>Our framework achieves this through layer-wise memory, which stores latent representations and prompt embeddings from previous edits.
  arXiv  Detail & Related papers  (2025-05-02T07:36:49Z)
• SPICE: A Synergistic, Precise, Iterative, and Customizable Image Editing Workflow [13.815228931600236]
  We introduce SPICE, a training-free workflow that accepts arbitrary resolutions and aspect ratios, accurately follows user requirements, and consistently improves image quality during more than 100 editing steps.<n>On a challenging realistic image-editing dataset, SPICE quantitatively outperforms state-of-the-art baselines and is consistently preferred by human annotators.
  arXiv  Detail & Related papers  (2025-04-13T19:13:04Z)
• Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing [60.730661748555214]
  We introduce textbfTask-textbfOriented textbfDiffusion textbfInversion (textbfTODInv), a novel framework that inverts and edits real images tailored to specific editing tasks. ToDInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability.
  arXiv  Detail & Related papers  (2024-08-23T22:16:34Z)
• Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training [61.984277261016146]
  We propose a CustomNeRF model that unifies a text description or a reference image as the editing prompt. To tackle the first challenge, we propose a Local-Global Iterative Editing (LGIE) training scheme that alternates between foreground region editing and full-image editing. For the second challenge, we also design a class-guided regularization that exploits class priors within the generation model to alleviate the inconsistency problem.
  arXiv  Detail & Related papers  (2023-12-04T06:25:06Z)
• Optimisation-Based Multi-Modal Semantic Image Editing [58.496064583110694]
  We propose an inference-time editing optimisation to accommodate multiple editing instruction types. By allowing to adjust the influence of each loss function, we build a flexible editing solution that can be adjusted to user preferences. We evaluate our method using text, pose and scribble edit conditions, and highlight our ability to achieve complex edits.
  arXiv  Detail & Related papers  (2023-11-28T15:31:11Z)
• Understanding Iterative Revision from Human-Written Text [10.714872525208385]
  IteraTeR is the first large-scale, multi-domain, edit-intention annotated corpus of iteratively revised text. We better understand the text revision process, making vital connections between edit intentions and writing quality.
  arXiv  Detail & Related papers  (2022-03-08T01:47:42Z)
• Learning Structural Edits via Incremental Tree Transformations [102.64394890816178]
  We present a generic model for incremental editing of structured data (i.e., "structural edits") Our editor learns to iteratively generate tree edits (e.g., deleting or adding a subtree) and applies them to the partially edited data. We evaluate our proposed editor on two source code edit datasets, where results show that, with the proposed edit encoder, our editor significantly improves accuracy over previous approaches.
  arXiv  Detail & Related papers  (2021-01-28T16:11:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.