Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity

• URL: http://arxiv.org/abs/2407.09733v3
• Date: Wed, 13 Nov 2024 17:07:45 GMT
• Title: Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity
• Authors: Zhentao Huang, Minglun Gong,
• Abstract summary: We introduce Textured-GS, an innovative method for rendering Gaussian splatting using Spherical Harmonics (SH) This approach enables each Gaussian to exhibit a richer representation by accommodating varying colors and opacities across its surface. Our experiments show that Textured-GS consistently outperforms both the baseline Mini-Splatting and standard 3DGS in terms of visual fidelity.
• Score: 7.861993966048637
• License:
• Abstract: In this paper, we introduce Textured-GS, an innovative method for rendering Gaussian splatting that incorporates spatially defined color and opacity variations using Spherical Harmonics (SH). This approach enables each Gaussian to exhibit a richer representation by accommodating varying colors and opacities across its surface, significantly enhancing rendering quality compared to traditional methods. To demonstrate the merits of our approach, we have adapted the Mini-Splatting architecture to integrate textured Gaussians without increasing the number of Gaussians. Our experiments across multiple real-world datasets show that Textured-GS consistently outperforms both the baseline Mini-Splatting and standard 3DGS in terms of visual fidelity. The results highlight the potential of Textured-GS to advance Gaussian-based rendering technologies, promising more efficient and high-quality scene reconstructions. Our implementation is available at https://github.com/ZhentaoHuang/Textured-GS.

Related papers

• Gaussian Billboards: Expressive 2D Gaussian Splatting with Textures [8.724367699416893]
  We highlight the similarity between 2D Gaussian Splatting (2DGS) and billboards from traditional computer graphics. We propose a modification of 2DGS to add spatially-varying color achieved using per-splat texture. We show that our method can improve the sharpness and quality of the scene representation in a wide range of qualitative and quantitative evaluations.
  arXiv  Detail & Related papers  (2024-12-17T09:57:04Z)
• SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors [51.54964131894217]
  We introduce a new method called SuperGaussians that utilizes spatially varying colors and opacity in a single Gaussian primitive to improve its representation ability. We have implemented bilinear, movable kernels, and even tiny neural networks as spatially varying functions.
  arXiv  Detail & Related papers  (2024-11-28T07:36:22Z)
• Textured Gaussians for Enhanced 3D Scene Appearance Modeling [58.134905268540436]
  3D Gaussian Splatting (3DGS) has emerged as a state-of-the-art 3D reconstruction and rendering technique. We propose a new generalized Gaussian appearance representation that augments each Gaussian with alpha(A), RGB, or RGBA texture maps. We demonstrate image quality improvements over existing methods while using a similar or lower number of Gaussians.
  arXiv  Detail & Related papers  (2024-11-27T18:59:59Z)
• G2SDF: Surface Reconstruction from Explicit Gaussians with Implicit SDFs [84.07233691641193]
  We introduce G2SDF, a novel approach that integrates a neural implicit Signed Distance Field into the Gaussian Splatting framework. G2SDF achieves superior quality than prior works while maintaining the efficiency of 3DGS.
  arXiv  Detail & Related papers  (2024-11-25T20:07:07Z)
• GStex: Per-Primitive Texturing of 2D Gaussian Splatting for Decoupled Appearance and Geometry Modeling [None]
  Gaussian splatting has demonstrated excellent performance for view synthesis and scene reconstruction. Since each Gaussian primitive encodes both appearance and geometry, appearance modeling requires a number of Gaussian primitives. We propose to employ perprimitive representation so that even a single Gaussian can be used to capture appearance details.
  arXiv  Detail & Related papers  (2024-09-19T17:58:44Z)
• HO-Gaussian: Hybrid Optimization of 3D Gaussian Splatting for Urban Scenes [24.227745405760697]
  We propose a hybrid optimization method named HO-Gaussian, which combines a grid-based volume with the 3DGS pipeline. Results on widely used autonomous driving datasets demonstrate that HO-Gaussian achieves photo-realistic rendering in real-time on multi-camera urban datasets.
  arXiv  Detail & Related papers  (2024-03-29T07:58:21Z)
• Hybrid Explicit Representation for Ultra-Realistic Head Avatars [55.829497543262214]
  We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real-time. UV-mapped 3D mesh is utilized to capture sharp and rich textures on smooth surfaces, while 3D Gaussian Splatting is employed to represent complex geometric structures. Experiments that our modeled results exceed those of state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-03-18T04:01:26Z)
• GaussianStyle: Gaussian Head Avatar via StyleGAN [64.85782838199427]
  We propose a novel framework that integrates the volumetric strengths of 3DGS with the powerful implicit representation of StyleGAN. We show that our method achieves state-of-the-art performance in reenactment, novel view synthesis, and animation.
  arXiv  Detail & Related papers  (2024-02-01T18:14:42Z)
• GS-IR: 3D Gaussian Splatting for Inverse Rendering [71.14234327414086]
  We propose GS-IR, a novel inverse rendering approach based on 3D Gaussian Splatting (GS) We extend GS, a top-performance representation for novel view synthesis, to estimate scene geometry, surface material, and environment illumination from multi-view images captured under unknown lighting conditions. The flexible and expressive GS representation allows us to achieve fast and compact geometry reconstruction, photorealistic novel view synthesis, and effective physically-based rendering.
  arXiv  Detail & Related papers  (2023-11-26T02:35:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.