Beyond Voxel 3D Editing: Learning from 3D Masks and Self-Constructed Data

• URL: http://arxiv.org/abs/2604.13688v1
• Date: Wed, 15 Apr 2026 10:10:27 GMT
• Title: Beyond Voxel 3D Editing: Learning from 3D Masks and Self-Constructed Data
• Abstract summary: 3D editing requires maintaining semantic consistency by performing localized changes according to prompts.<n>We propose a Beyond Voxel 3D Editing (BVE) framework with a self-constructed large-scale dataset specifically tailored for 3D editing.<n>BVE achieves superior performance in generating high-quality, text-aligned 3D assets, while faithfully retaining the visual characteristics of the original input.
• Score: 40.44238807341562
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 3D editing refers to the ability to apply local or global modifications to 3D assets. Effective 3D editing requires maintaining semantic consistency by performing localized changes according to prompts, while also preserving local invariance so that unchanged regions remain consistent with the original. However, existing approaches have significant limitations: multi-view editing methods incur losses when projecting back to 3D, while voxel-based editing is constrained in both the regions that can be modified and the scale of modifications. Moreover, the lack of sufficiently large editing datasets for training and evaluation remains a challenge. To address these challenges, we propose a Beyond Voxel 3D Editing (BVE) framework with a self-constructed large-scale dataset specifically tailored for 3D editing. Building upon this dataset, our model enhances a foundational image-to-3D generative architecture with lightweight, trainable modules, enabling efficient injection of textual semantics without the need for expensive full-model retraining. Furthermore, we introduce an annotation-free 3D masking strategy to preserve local invariance, maintaining the integrity of unchanged regions during editing. Extensive experiments demonstrate that BVE achieves superior performance in generating high-quality, text-aligned 3D assets, while faithfully retaining the visual characteristics of the original input.

Related papers

• EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation [21.575142861728636]
  We present EditFlow3D, a training-free framework for local 3D editing.<n>Given a source asset and an edit instruction, a VLM-driven workflow interprets the editing intent.<n>Mask-guided differential flow focuses the edit on the target region.<n>Step-wise trajectory preservation maintains consistency between non-target regions and the source asset.
  arXiv  Detail & Related papers  (2026-08-04T06:16:17Z)
• EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning [59.36059865997641]
  We propose EditVerse3D, a novel 3D editing framework that enables high-quality object editing under coarse guidance.<n>Our approach takes as input a 3D object to be edited, a coarse 3D bounding box indicating the target region, and a reference 2D image describing the desired modification.<n>To facilitate this editing, we introduce a novel region-aware adaptive loss that emphasizes hard-to-learn regions.
  arXiv  Detail & Related papers  (2026-07-08T09:21:22Z)
• Feedforward 3D Editing Learns from Semantic-Part Transformation [13.61340944347895]
  A central challenge of feedforward 3D editing lies in the lack of high-quality paired supervision.<n>We introduce a new perspective: scalable feedforward 3D editing should be learned from semantic-part transformations.<n>PartFlow is a feedforward 3D editing network that injects source-aware latent control into pretrained 3D generative priors.
  arXiv  Detail & Related papers  (2026-05-26T17:51:59Z)
• CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing [51.73433734209541]
  Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
  arXiv  Detail & Related papers  (2026-03-12T11:15:11Z)
• Geometry-Guided Reinforcement Learning for Multi-view Consistent 3D Scene Editing [106.07976338405793]
  Leveraging the priors of 2D diffusion models for 3D editing has emerged as a promising paradigm.<n>We propose textbfRL3DEdit, a single-pass framework driven by reinforcement learning with novel rewards derived from the 3D foundation model, VGGT.<n>Experiments demonstrate that RL3DEdit achieves stable multi-view consistency and outperforms state-of-the-art methods in editing quality with high efficiency.
  arXiv  Detail & Related papers  (2026-03-03T16:31:10Z)
• Easy3E: Feed-Forward 3D Asset Editing via Rectified Voxel Flow [29.8200628539749]
  We propose an effective and fully feedforward 3D editing framework based on the TRELLIS generative backbone.<n>Our framework addresses two key issues: adapting training-free 2D editing to structured 3D representations, and overcoming the bottleneck of appearance fidelity in compressed 3D features.
  arXiv  Detail & Related papers  (2026-02-25T02:15:14Z)
• Vinedresser3D: Agentic Text-guided 3D Editing [26.81659566314386]
  Vinedresser3D is an agentic framework for high-quality text-guided 3D editing.<n>It operates directly in the latent space of a native 3D generative model.<n>Experiments on diverse 3D edits demonstrate that Vinedresser3D outperforms prior baselines in both automatic metrics and human preference studies.
  arXiv  Detail & Related papers  (2026-02-23T06:30:36Z)
• Native 3D Editing with Full Attention [47.908091876301796]
  We propose a novel native 3D editing framework that directly manipulates 3D representations in a single, efficient feed-forward pass.<n>This dataset is meticulously curated to ensure that edited objects faithfully adhere to the instructional changes.<n>Our results demonstrate that token concatenation is more parameter-efficient and achieves superior performance.
  arXiv  Detail & Related papers  (2025-11-21T18:59:26Z)
• Error-Driven Scene Editing for 3D Grounding in Large Language Models [71.41120775319088]
  Despite recent progress in 3D-LLMs, they remain limited in accurately grounding language to visual and spatial elements in 3D environments.<n>This limitation stems in part from training data that focuses on language reasoning rather than spatial understanding due to scarce 3D resources.<n>We propose 3D scene editing as a key mechanism to generate precise visual counterfactuals that mitigate these biases.
  arXiv  Detail & Related papers  (2025-11-18T03:13:29Z)
• NANO3D: A Training-Free Approach for Efficient 3D Editing Without Masks [29.825760228576744]
  Nano3D is a training-free framework for precise and coherent 3D object editing without masks.<n>We construct the first large-scale 3D editing datasets Nano3D-Edit-100k, which contains over 100,000 high-quality 3D editing pairs.
  arXiv  Detail & Related papers  (2025-10-16T17:51:50Z)
• Mastering Regional 3DGS: Locating, Initializing, and Editing with Diverse 2D Priors [67.22744959435708]
  3D semantic parsing often underperforms compared to its 2D counterpart, making targeted manipulations within 3D spaces more difficult and limiting the fidelity of edits.<n>We address this problem by leveraging 2D diffusion editing to accurately identify modification regions in each view, followed by inverse rendering for 3D localization.<n> Experiments demonstrate that our method achieves state-of-the-art performance while delivering up to a $4times$ speedup.
  arXiv  Detail & Related papers  (2025-07-07T19:15:43Z)
• Plasticine3D: 3D Non-Rigid Editing with Text Guidance by Multi-View Embedding Optimization [21.8454418337306]
  We propose Plasticine3D, a novel text-guided controlled 3D editing pipeline that can perform 3D non-rigid editing. Our work divides the editing process into a geometry editing stage and a texture editing stage to achieve separate control of structure and appearance. For the purpose of fine-grained control, we propose Embedding-Fusion (EF) to blend the original characteristics with the editing objectives in the embedding space.
  arXiv  Detail & Related papers  (2023-12-15T09:01:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.