CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing
- URL: http://arxiv.org/abs/2603.11810v1
- Date: Thu, 12 Mar 2026 11:15:11 GMT
- Title: CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing
- Abstract summary: Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
- Score: 51.73433734209541
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks. To address the challenge, this paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing. Specifically, we propose a collaborative explicit-implicit reconstruction approach, which represents the target object using an implicit SDF network and a differentially sampled, locally controllable set of handler points. The implicit network provides a smooth and continuous geometry prior, while the explicit handler points offer localized control, enabling mutual guidance between the global 3D structure and user-specified local editing regions. To independently control each attribute of the handler points, we design a physical properties disentangling module to decouple the color of the handler points into separate physical properties. We also propose a dual-diffuse-albedo network in this module to process the edited and non-edited regions through separate branches, thereby preventing undesired interference from editing operations. Building on the reconstructed collaborative explicit-implicit representation with disentangled properties, we introduce a spatial-aware editing module that enables part-wise adjustment of relevant handler points. This module employs a cross-view propagation-based 3D segmentation strategy, which helps users to edit the specified physical attributes of a target part efficiently. Extensive experiments on both real and synthetic datasets demonstrate that our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time. Our code is available on https://github.com/shiyue001/CEI-3D.
Related papers
- EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation [21.575142861728636]
We present EditFlow3D, a training-free framework for local 3D editing.<n>Given a source asset and an edit instruction, a VLM-driven workflow interprets the editing intent.<n>Mask-guided differential flow focuses the edit on the target region.<n>Step-wise trajectory preservation maintains consistency between non-target regions and the source asset.
arXiv Detail & Related papers (2026-08-04T06:16:17Z) - Geometry-Instructed Video Editing [54.86319853573801]
GIVE is a geometry-instructed video editing framework that represents edits through a unified object-state formulation.<n>We build a scalable graphics-engine pipeline that executes object-level edit programs and renders controlled before/after pairs.<n> Experimental results demonstrate that GIVE produces faithful geometric edits with temporal coherence and consistent secondary effects.
arXiv Detail & Related papers (2026-06-23T07:11:45Z) - Velocity-Space 3D Asset Editing [45.94997633532406]
editing a 3D asset locally, modifying a target region while preserving the rest, is a fundamental requirement of native 3D editing.<n>We propose VS3D (Ve-Space 3D Asset editing), an inversion-free, training-free, and mask-free framework that addresses each problem with a targeted intervention inside the sampler.
arXiv Detail & Related papers (2026-05-08T07:42:12Z) - Beyond Voxel 3D Editing: Learning from 3D Masks and Self-Constructed Data [40.44238807341562]
3D editing requires maintaining semantic consistency by performing localized changes according to prompts.<n>We propose a Beyond Voxel 3D Editing (BVE) framework with a self-constructed large-scale dataset specifically tailored for 3D editing.<n>BVE achieves superior performance in generating high-quality, text-aligned 3D assets, while faithfully retaining the visual characteristics of the original input.
arXiv Detail & Related papers (2026-04-15T10:10:27Z) - InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning [60.799998743918955]
We propose a novel text-vision Interleaved Chain-of-Grounding reasoning framework for fine-grained image editing in complex real-world scenes.<n>The key insight of InterCoG is to first perform object position reasoning solely within text.<n>We also propose two auxiliary training modules: multimodal grounding reconstruction supervision and multimodal grounding reasoning alignment.
arXiv Detail & Related papers (2026-03-02T08:13:16Z) - POCI-Diff: Position Objects Consistently and Interactively with 3D-Layout Guided Diffusion [46.97254555348757]
We propose a diffusion-based approach for Text-to-Image (T2I) generation with consistent and interactive 3D layout control and editing.<n>We introduce a framework for Positioning Objects Consistently and Interactively (POCI-Diff)<n>Our method enables explicit per-object semantic control by binding individual text descriptions to specific 3D bounding boxes.
arXiv Detail & Related papers (2026-01-20T15:13:43Z) - HPR3D: Hierarchical Proxy Representation for High-Fidelity 3D Reconstruction and Controllable Editing [33.554101922316946]
3D representations like meshes, voxels, point clouds, and NeRF-based neural implicit fields exhibit significant limitations.<n>We introduce a novel 3D Hierarchical Proxy Node representation.<n>Our method's expressive efficiency, high-fidelity rendering quality, and superior editability are shown.
arXiv Detail & Related papers (2025-07-16T07:09:05Z) - SplatMesh: Interactive 3D Segmentation and Editing Using Mesh-Based Gaussian Splatting [86.50200613220674]
A key challenge in 3D-based interactive editing is the absence of an efficient representation that balances diverse modifications with high-quality view synthesis under a given memory constraint.<n>We introduce SplatMesh, a novel fine-grained interactive 3D segmentation and editing algorithm that integrates 3D Gaussian Splatting with a precomputed mesh.<n>By segmenting and editing the simplified mesh, we can effectively edit the Gaussian splats as well, which will lead to extensive experiments on real and synthetic datasets.
arXiv Detail & Related papers (2023-12-26T02:50:42Z) - Plasticine3D: 3D Non-Rigid Editing with Text Guidance by Multi-View Embedding Optimization [21.8454418337306]
We propose Plasticine3D, a novel text-guided controlled 3D editing pipeline that can perform 3D non-rigid editing.
Our work divides the editing process into a geometry editing stage and a texture editing stage to achieve separate control of structure and appearance.
For the purpose of fine-grained control, we propose Embedding-Fusion (EF) to blend the original characteristics with the editing objectives in the embedding space.
arXiv Detail & Related papers (2023-12-15T09:01:54Z) - SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds [73.91114735118298]
Shap-Editor is a novel feed-forward 3D editing framework.
We demonstrate that direct 3D editing in this space is possible and efficient by building a feed-forward editor network.
arXiv Detail & Related papers (2023-12-14T18:59:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.