LADIS: Language Disentanglement for 3D Shape Editing

• URL: http://arxiv.org/abs/2212.05011v1
• Date: Fri, 9 Dec 2022 17:54:28 GMT
• Title: LADIS: Language Disentanglement for 3D Shape Editing
• Abstract summary: We show that our method outperforms existing SOTA methods by 20% in terms of edit locality. Our work suggests that by solely disentangling language representations, downstream 3D shape editing can become more local to relevant parts.
• Score: 35.796594606657735
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Natural language interaction is a promising direction for democratizing 3D shape design. However, existing methods for text-driven 3D shape editing face challenges in producing decoupled, local edits to 3D shapes. We address this problem by learning disentangled latent representations that ground language in 3D geometry. To this end, we propose a complementary tool set including a novel network architecture, a disentanglement loss, and a new editing procedure. Additionally, to measure edit locality, we define a new metric that we call part-wise edit precision. We show that our method outperforms existing SOTA methods by 20% in terms of edit locality, and up to 6.6% in terms of language reference resolution accuracy. Our work suggests that by solely disentangling language representations, downstream 3D shape editing can become more local to relevant parts, even if the model was never given explicit part-based supervision.

Related papers

• EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning [59.36059865997641]
  We propose EditVerse3D, a novel 3D editing framework that enables high-quality object editing under coarse guidance.<n>Our approach takes as input a 3D object to be edited, a coarse 3D bounding box indicating the target region, and a reference 2D image describing the desired modification.<n>To facilitate this editing, we introduce a novel region-aware adaptive loss that emphasizes hard-to-learn regions.
  arXiv  Detail & Related papers  (2026-07-08T09:21:22Z)
• 3DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing [1.7558503530534386]
  We introduce 3DMorph, a training-free framework for single-image-guided local 3D shape editing and morphing.<n>Given an edited image showing a desired shape modification, our method automatically localizes the relevant 3D region and transfers 2D modifications to 3D while preserving unmodified areas.<n>3DMorph also enables intermediate shape generation between the original and edited objects, facilitating design exploration.
  arXiv  Detail & Related papers  (2026-06-05T10:10:33Z)
• Vinedresser3D: Agentic Text-guided 3D Editing [26.81659566314386]
  Vinedresser3D is an agentic framework for high-quality text-guided 3D editing.<n>It operates directly in the latent space of a native 3D generative model.<n>Experiments on diverse 3D edits demonstrate that Vinedresser3D outperforms prior baselines in both automatic metrics and human preference studies.
  arXiv  Detail & Related papers  (2026-02-23T06:30:36Z)
• Error-Driven Scene Editing for 3D Grounding in Large Language Models [71.41120775319088]
  Despite recent progress in 3D-LLMs, they remain limited in accurately grounding language to visual and spatial elements in 3D environments.<n>This limitation stems in part from training data that focuses on language reasoning rather than spatial understanding due to scarce 3D resources.<n>We propose 3D scene editing as a key mechanism to generate precise visual counterfactuals that mitigate these biases.
  arXiv  Detail & Related papers  (2025-11-18T03:13:29Z)
• Towards Scalable and Consistent 3D Editing [32.16698854719098]
  3D editing has wide applications in immersive content creation, digital entertainment, and AR/VR.<n>Unlike 2D editing, it remains challenging due to the need for cross-view consistency, structural fidelity, and fine-grained controllability.<n>We introduce 3DEditVerse, the largest paired 3D editing benchmark to date, comprising 116,309 high-quality training pairs and 1,500 curated test pairs.<n>On the model side, we propose 3DEditFormer, a 3D-structure-preserving conditional transformer.
  arXiv  Detail & Related papers  (2025-10-03T13:34:55Z)
• 3D-LATTE: Latent Space 3D Editing from Textual Instructions [64.77718887666312]
  We propose a training-free editing method that operates within the latent space of a native 3D diffusion model.<n>We guide the edit synthesis by blending 3D attention maps from the generation with the source object.
  arXiv  Detail & Related papers  (2025-08-29T22:51:59Z)
• Blended Point Cloud Diffusion for Localized Text-guided Shape Editing [12.332668298895717]
  In this work, we introduce an inpainting-based framework for editing shapes represented as point clouds.<n>We propose an inference-time coordinate blending algorithm which balances reconstruction of the full shape with inpainting.<n>Our coordinate blending algorithm seamlessly blends the original shape with its edited version, enabling a fine-grained editing of 3D shapes.
  arXiv  Detail & Related papers  (2025-07-21T09:00:19Z)
• Mastering Regional 3DGS: Locating, Initializing, and Editing with Diverse 2D Priors [67.22744959435708]
  3D semantic parsing often underperforms compared to its 2D counterpart, making targeted manipulations within 3D spaces more difficult and limiting the fidelity of edits.<n>We address this problem by leveraging 2D diffusion editing to accurately identify modification regions in each view, followed by inverse rendering for 3D localization.<n> Experiments demonstrate that our method achieves state-of-the-art performance while delivering up to a $4times$ speedup.
  arXiv  Detail & Related papers  (2025-07-07T19:15:43Z)
• PrEditor3D: Fast and Precise 3D Shape Editing [100.09112677669376]
  We propose a training-free approach to 3D editing that enables the editing of a single shape within a few minutes. The edited 3D mesh aligns well with the prompts, and remains identical for regions that are not intended to be altered.
  arXiv  Detail & Related papers  (2024-12-09T15:44:47Z)
• GSEditPro: 3D Gaussian Splatting Editing with Attention-based Progressive Localization [11.170354299559998]
  We propose GSEditPro, a novel 3D scene editing framework which allows users to perform various creative and precise editing using text prompts only. We introduce an attention-based progressive localization module to add semantic labels to each Gaussian during rendering. This enables precise localization on editing areas by classifying Gaussians based on their relevance to the editing prompts derived from cross-attention layers of the T2I model.
  arXiv  Detail & Related papers  (2024-11-15T08:25:14Z)
• EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editing [114.14164860467227]
  We propose Edit-Room, a framework capable of executing a variety of layout edits through natural language commands. Specifically, EditRoom leverages Large Language Models (LLMs) for command planning and generates target scenes. We have developed an automatic pipeline to augment existing 3D scene datasets and introduced EditRoom-DB, a large-scale dataset with 83k editing pairs.
  arXiv  Detail & Related papers  (2024-10-03T17:42:24Z)
• Chat-Edit-3D: Interactive 3D Scene Editing via Text Prompts [76.73043724587679]
  We propose a dialogue-based 3D scene editing approach, termed CE3D. Hash-Atlas represents 3D scene views, which transfers the editing of 3D scenes onto 2D atlas images. Results demonstrate that CE3D effectively integrates multiple visual models to achieve diverse editing visual effects.
  arXiv  Detail & Related papers  (2024-07-09T13:24:42Z)
• ParSEL: Parameterized Shape Editing with Language [17.312928067096543]
  ParSEL is a system that enables controllable editing of high-quality 3D assets from natural language. adjusting the program parameters allows users to explore shape variations with a precise control over the magnitudes of edits.
  arXiv  Detail & Related papers  (2024-05-30T17:55:46Z)
• ShapeFusion: A 3D diffusion model for localized shape editing [37.82690898932135]
  We propose an effective diffusion masking training strategy that, by design, facilitates localized manipulation of any shape region. Compared to the current state-of-the-art our method leads to more interpretable shape manipulations than methods relying on latent code state.
  arXiv  Detail & Related papers  (2024-03-28T18:50:19Z)
• CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization [56.47175002368553]
  This paper introduces a new approach based on a coupled representation and a neural volume optimization to implicitly perform 3D shape editing in latent space. First, we design the coupled neural shape representation for supporting 3D shape editing. Second, we formulate the coupled neural shape optimization procedure to co-optimize the two coupled components in the representation subject to the editing operation.
  arXiv  Detail & Related papers  (2024-02-04T01:52:56Z)
• SERF: Fine-Grained Interactive 3D Segmentation and Editing with Radiance Fields [92.14328581392633]
  We introduce a novel fine-grained interactive 3D segmentation and editing algorithm with radiance fields, which we refer to as SERF. Our method entails creating a neural mesh representation by integrating multi-view algorithms with pre-trained 2D models. Building upon this representation, we introduce a novel surface rendering technique that preserves local information and is robust to deformation.
  arXiv  Detail & Related papers  (2023-12-26T02:50:42Z)
• Directional Texture Editing for 3D Models [51.31499400557996]
  ITEM3D is designed for automatic textbf3D object editing according to the text textbfInstructions. Leveraging the diffusion models and the differentiable rendering, ITEM3D takes the rendered images as the bridge of text and 3D representation.
  arXiv  Detail & Related papers  (2023-09-26T12:01:13Z)
• 3Deformer: A Common Framework for Image-Guided Mesh Deformation [27.732389685912214]
  Given a source 3D mesh with semantic materials, and a user-specified semantic image, 3Deformer can accurately edit the source mesh. Our 3Deformer is able to produce impressive results and reaches the state-of-the-art level.
  arXiv  Detail & Related papers  (2023-07-19T10:44:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.