GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance

• URL: http://arxiv.org/abs/2604.05721v1
• Date: Tue, 07 Apr 2026 11:23:23 GMT
• Title: GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance
• Abstract summary: 3D Gaussian Splatting has demonstrated superior performance in rendering efficiency and quality.<n>Existing methods have explored predicting point maps as geometric references for inferring Gaussian primitives.<n>We introduce GaussianGrow, a novel approach that generates 3D Gaussians by learning to grow them from easily accessible 3D point clouds.
• Score: 60.86483080195698
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 3D Gaussian Splatting has demonstrated superior performance in rendering efficiency and quality, yet the generation of 3D Gaussians still remains a challenge without proper geometric priors. Existing methods have explored predicting point maps as geometric references for inferring Gaussian primitives, while the unreliable estimated geometries may lead to poor generations. In this work, we introduce GaussianGrow, a novel approach that generates 3D Gaussians by learning to grow them from easily accessible 3D point clouds, naturally enforcing geometric accuracy in Gaussian generation. Specifically, we design a text-guided Gaussian growing scheme that leverages a multi-view diffusion model to synthesize consistent appearances from input point clouds for supervision. To mitigate artifacts caused by fusing neighboring views, we constrain novel views generated at non-preset camera poses identified in overlapping regions across different views. For completing the hard-to-observe regions, we propose to iteratively detect the camera pose by observing the largest un-grown regions in point clouds and inpainting them by inpainting the rendered view with a pretrained 2D diffusion model. The process continues until complete Gaussians are generated. We extensively evaluate GaussianGrow on text-guided Gaussian generation from synthetic and even real-scanned point clouds. Project Page: https://weiqi-zhang.github.io/GaussianGrow

Related papers

• G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors [51.398600453223274]
  G-Skin is a novel generative skinning framework designed for expressive and high-fidelity animation with 3D Gaussian representation.<n>We introduce a skeleton-controllable image generation model leveraging 2D vision foundation models to distill powerful motion priors into pseudo-guidance.<n>G-Skin also generalizes flexibly to the augmented variants of 3D Gaussian representation designed to mitigate animation-induced rendering artifacts.
  arXiv  Detail & Related papers  (2026-08-03T05:45:23Z)
• AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priors [23.943522711585597]
  We propose AnchorSplat, a novel feed-forward 3DGS framework for scene-level reconstruction.<n> anchor-aligned Gaussian representation guided by 3D geometric priors.<n>Design substantially reduces the number of required Gaussians.
  arXiv  Detail & Related papers  (2026-04-08T13:04:54Z)
• Free-Range Gaussians: Non-Grid-Aligned Generative 3D Gaussian Reconstruction [72.85652875805387]
  Free-Range Gaussians is a multi-view reconstruction method that predicts non-pixel, non-voxel-aligned 3D Gaussians from as few as four images.<n>Our generative formulation of reconstruction allows the model to be supervised with non-grid-aligned 3D data.
  arXiv  Detail & Related papers  (2026-04-06T17:24:18Z)
• VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction [45.95623374754385]
  VolSplat is a new multi-view feed-forward paradigm that replaces pixel alignment with voxel-aligned Gaussians.<n>It overcomes pixel alignment's reliance on error-prone 2D feature matching, ensuring robust multi-view consistency.<n> Experiments on widely used benchmarks including RealEstate10K and ScanNet demonstrate that VolSplat achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-09-23T17:59:02Z)
• GAP: Gaussianize Any Point Clouds with Text Guidance [29.002390913738203]
  We propose GAP, a novel approach that gaussianizes raw point clouds into high-fidelity 3D Gaussians with text guidance.<n>To ensure geometric accuracy, we introduce a surface-anchoring mechanism that effectively constrains Gaussians to lie on the surfaces of 3D shapes.<n>We evaluate GAP on the Point-to-Gaussian generation task across varying complexity levels, from synthetic point clouds to challenging real-world scans, and even large-scale scenes.
  arXiv  Detail & Related papers  (2025-08-07T17:59:27Z)
• GaussianPainter: Painting Point Cloud into 3D Gaussians with Normal Guidance [43.97159590077809]
  We present GaussianPainter, the first method to paint a point cloud into 3D Gaussians given a reference image.<n>Our method addresses the non-uniqueness problem inherent in the large parameter space of 3D Gaussian splatting.
  arXiv  Detail & Related papers  (2024-12-23T16:45:37Z)
• NovelGS: Consistent Novel-view Denoising via Large Gaussian Reconstruction Model [57.92709692193132]
  NovelGS is a diffusion model for Gaussian Splatting given sparse-view images. We leverage the novel view denoising through a transformer-based network to generate 3D Gaussians.
  arXiv  Detail & Related papers  (2024-11-25T07:57:17Z)
• UniGS: Modeling Unitary 3D Gaussians for Novel View Synthesis from Sparse-view Images [20.089890859122168]
  We introduce UniGS, a novel 3D Gaussian reconstruction and novel view synthesis model.<n>UniGS predicts a high-fidelity representation of 3D Gaussians from arbitrary number of posed sparse-view images.
  arXiv  Detail & Related papers  (2024-10-17T03:48:02Z)
• GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality [99.63429416013713]
  3D-GS has achieved great success in reconstructing and rendering real-world scenes. To transfer the high rendering quality to generation tasks, a series of research works attempt to generate 3D-Gaussian assets from text. We propose a novel framework named GaussianDreamerPro to enhance the generation quality.
  arXiv  Detail & Related papers  (2024-06-26T16:12:09Z)
• Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenes [50.92217884840301]
  Gaussian Opacity Fields (GOF) is a novel approach for efficient, high-quality, and adaptive surface reconstruction in scenes. GOF is derived from ray-tracing-based volume rendering of 3D Gaussians. GOF surpasses existing 3DGS-based methods in surface reconstruction and novel view synthesis.
  arXiv  Detail & Related papers  (2024-04-16T17:57:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.