Deformable Beta Splatting

• URL: http://arxiv.org/abs/2501.18630v1
• Date: Mon, 27 Jan 2025 18:58:43 GMT
• Title: Deformable Beta Splatting
• Authors: Rong Liu, Dylan Sun, Meida Chen, Yue Wang, Andrew Feng,
• Abstract summary: 3D Gaussian Splatting (3DGS) has advanced radiance field reconstruction by enabling real-time rendering.<n>We introduce Deformable Beta Splatting (DBS), a deformable and compact approach that enhances both geometry and color representation.
• Score: 4.855751031707892
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D Gaussian Splatting (3DGS) has advanced radiance field reconstruction by enabling real-time rendering. However, its reliance on Gaussian kernels for geometry and low-order Spherical Harmonics (SH) for color encoding limits its ability to capture complex geometries and diverse colors. We introduce Deformable Beta Splatting (DBS), a deformable and compact approach that enhances both geometry and color representation. DBS replaces Gaussian kernels with deformable Beta Kernels, which offer bounded support and adaptive frequency control to capture fine geometric details with higher fidelity while achieving better memory efficiency. In addition, we extended the Beta Kernel to color encoding, which facilitates improved representation of diffuse and specular components, yielding superior results compared to SH-based methods. Furthermore, Unlike prior densification techniques that depend on Gaussian properties, we mathematically prove that adjusting regularized opacity alone ensures distribution-preserved Markov chain Monte Carlo (MCMC), independent of the splatting kernel type. Experimental results demonstrate that DBS achieves state-of-the-art visual quality while utilizing only 45% of the parameters and rendering 1.5x faster than 3DGS-based methods. Notably, for the first time, splatting-based methods outperform state-of-the-art Neural Radiance Fields, highlighting the superior performance and efficiency of DBS for real-time radiance field rendering.

Related papers

• 3DGEER: Exact and Efficient Volumetric Rendering with 3D Gaussians [15.776720879897345]
  We introduce 3DGEER, an Exact and Efficient Volumetric Gaussian Rendering method.<n>Our method consistently outperforms prior methods, establishing a new state-of-the-art in real-time neural rendering.
  arXiv  Detail & Related papers  (2025-05-29T22:52:51Z)
• MonoGS++: Fast and Accurate Monocular RGB Gaussian SLAM [9.37281948308712]
  We present MonoGS++, a novel fast and accurate Simultaneous localization and Mapping (SLAM) method.<n>Our approach reduces the hardware dependency and only requires RGB input, leveraging online visual odometry (VO) to generate sparse point clouds in real-time.<n>Our method realized a significant 5.57x improvement in frames per second (fps) over the previous state-of-the-art, MonoGS.
  arXiv  Detail & Related papers  (2025-04-03T09:51:51Z)
• EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesis [61.1662426227688]
  Existing NeRF and 3DGS-based methods show promising results in achieving photorealistic renderings but require slow, per-scene optimization. We introduce EVolSplat, an efficient 3D Gaussian Splatting model for urban scenes that works in a feed-forward manner.
  arXiv  Detail & Related papers  (2025-03-26T02:47:27Z)
• SG-Splatting: Accelerating 3D Gaussian Splatting with Spherical Gaussians [21.00454010373162]
  3D Gaussian Splatting is emerging as a state-of-the-art technique in novel view synthesis.<n>However, reliance on third-degree spherical harmonics for color representation introduces significant storage demands and computational overhead.<n>We introduce SG-Splatting with Spherical Gaussians based color representation, a novel approach to enhance rendering speed and quality.
  arXiv  Detail & Related papers  (2024-12-31T08:31:52Z)
• Deformable Radial Kernel Splatting [53.92593804734493]
  We introduce Deformable Radial Kernel (DRK), which extends Gaussian splatting into a more general and flexible framework.<n>DRK efficiently models diverse shape primitives while enabling precise control over edge sharpness and boundary curvature.
  arXiv  Detail & Related papers  (2024-12-16T13:11:02Z)
• SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors [51.54964131894217]
  We introduce a new method called SuperGaussians that utilizes spatially varying colors and opacity in a single Gaussian primitive to improve its representation ability.<n>We have implemented bilinear, movable kernels, and even tiny neural networks as spatially varying functions.
  arXiv  Detail & Related papers  (2024-11-28T07:36:22Z)
• Textured Gaussians for Enhanced 3D Scene Appearance Modeling [58.134905268540436]
  3D Gaussian Splatting (3DGS) has emerged as a state-of-the-art 3D reconstruction and rendering technique.<n>We propose a new generalized Gaussian appearance representation that augments each Gaussian with alpha(A), RGB, or RGBA texture maps.<n>We demonstrate image quality improvements over existing methods while using a similar or lower number of Gaussians.
  arXiv  Detail & Related papers  (2024-11-27T18:59:59Z)
• 3D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexes [87.01284850604495]
  We introduce 3D Convexting (3DCS), which leverages 3D smooth convexes as primitives for modeling geometrically-meaningful radiance fields from multiview images.<n>3DCS achieves superior performance over 3DGS on benchmarks such as MipNeizer, Tanks and Temples, and Deep Blending.<n>Our results highlight the potential of 3D Convexting to become the new standard for high-quality scene reconstruction.
  arXiv  Detail & Related papers  (2024-11-22T14:31:39Z)
• Beyond Gaussians: Fast and High-Fidelity 3D Splatting with Linear Kernels [51.08794269211701]
  We introduce 3D Linear Splatting (3DLS), which replaces Gaussian kernels with linear kernels to achieve sharper and more precise results.<n>3DLS demonstrates state-of-the-art fidelity and accuracy, along with a 30% FPS improvement over baseline 3DGS.
  arXiv  Detail & Related papers  (2024-11-19T11:59:54Z)
• RayGauss: Volumetric Gaussian-Based Ray Casting for Photorealistic Novel View Synthesis [3.4341938551046227]
  Differentiable rendering methods made significant progress in novel view synthesis. We provide a consistent formulation of the emitted radiance c and density sigma for differentiable ray casting of irregularly distributed Gaussians. We achieve superior quality rendering compared to the state-of-the-art while maintaining reasonable training times and achieving inference speeds of 25 FPS on the Blender dataset.
  arXiv  Detail & Related papers  (2024-08-06T10:59:58Z)
• Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity [7.861993966048637]
  We introduce Textured-GS, an innovative method for rendering Gaussian splatting using Spherical Harmonics (SH) This approach enables each Gaussian to exhibit a richer representation by accommodating varying colors and opacities across its surface. Our experiments show that Textured-GS consistently outperforms both the baseline Mini-Splatting and standard 3DGS in terms of visual fidelity.
  arXiv  Detail & Related papers  (2024-07-13T00:45:37Z)
• R$^2$-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction [53.19869886963333]
  3D Gaussian splatting (3DGS) has shown promising results in rendering image and surface reconstruction. This paper introduces R2$-Gaussian, the first 3DGS-based framework for sparse-view tomographic reconstruction.
  arXiv  Detail & Related papers  (2024-05-31T08:39:02Z)
• RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting [51.51310922527121]
  We present a real-time 3D reconstruction system with an RGBD camera for large-scale environments using Gaussian splatting. We force each Gaussian to be either opaque or nearly transparent, with the opaque ones fitting the surface and dominant colors, and transparent ones fitting residual colors. We show real-time reconstructions of a variety of large scenes and show superior performance in the realism of novel view synthesis and camera tracking accuracy.
  arXiv  Detail & Related papers  (2024-04-30T16:54:59Z)
• GaussianPro: 3D Gaussian Splatting with Progressive Propagation [49.918797726059545]
  3DGS relies heavily on the point cloud produced by Structure-from-Motion (SfM) techniques. We propose a novel method that applies a progressive propagation strategy to guide the densification of the 3D Gaussians. Our method significantly surpasses 3DGS on the dataset, exhibiting an improvement of 1.15dB in terms of PSNR.
  arXiv  Detail & Related papers  (2024-02-22T16:00:20Z)
• Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM [58.736472371951955]
  We introduce a ternary-type opacity (TT) model, which categorizes points on a ray intersecting a surface into three regions: before, on, and behind the surface. This enables a more accurate rendering of depth, subsequently improving the performance of image warping techniques. Our integrated approach of TT and HO achieves state-of-the-art performance on synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-12-20T18:03:17Z)
• Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fields [54.482261428543985]
  Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. 3D Gaussian splatting has shown state-of-the-art performance on real-time radiance field rendering. We propose architectural and training changes to efficiently avert this problem.
  arXiv  Detail & Related papers  (2023-12-06T00:46:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.