STGA: Selective-Training Gaussian Head Avatars

• URL: http://arxiv.org/abs/2503.05196v1
• Date: Fri, 07 Mar 2025 07:37:34 GMT
• Title: STGA: Selective-Training Gaussian Head Avatars
• Abstract summary: We propose selective-training Gaussian head avatars (STGA) to enhance the details of dynamic head Gaussian.<n>Each Gaussian splat is embedded within the FLAME mesh to achieve mesh-based animation of the Gaussian model.
• Score: 3.738410998183615
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose selective-training Gaussian head avatars (STGA) to enhance the details of dynamic head Gaussian. The dynamic head Gaussian model is trained based on the FLAME parameterized model. Each Gaussian splat is embedded within the FLAME mesh to achieve mesh-based animation of the Gaussian model. Before training, our selection strategy calculates the 3D Gaussian splat to be optimized in each frame. The parameters of these 3D Gaussian splats are optimized in the training of each frame, while those of the other splats are frozen. This means that the splats participating in the optimization process differ in each frame, to improve the realism of fine details. Compared with network-based methods, our method achieves better results with shorter training time. Compared with mesh-based methods, our method produces more realistic details within the same training time. Additionally, the ablation experiment confirms that our method effectively enhances the quality of details.

Related papers

• SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting [26.626951365522526]
  We introduce a novel method for reconstructing an animatable head avatar from a single image.<n>We propose a Graph splitting network to progressively generate Gaussians from coarse to fine.<n>This process, enabled by the GNN-guided splitting, synthesizes more precise facial details and achieves higher reconstruction quality.
  arXiv  Detail & Related papers  (2026-05-25T12:02:43Z)
• Optimization-Free Style Transfer for 3D Gaussian Splats [2.123980355630267]
  We propose a reconstruction- and optimization-free approach to stylizing 3D Gaussian splats.<n>A feed-forward, surface-based stylization method is then used and interpolated back to the individual splats in the scene.<n>This also allows for fast stylization of splats, achieving speeds under 2 minutes even on consumer-grade hardware.
  arXiv  Detail & Related papers  (2025-08-07T19:35:01Z)
• 3DGEER: Exact and Efficient Volumetric Rendering with 3D Gaussians [15.776720879897345]
  We introduce 3DGEER, an Exact and Efficient Volumetric Gaussian Rendering method.<n>Our method consistently outperforms prior methods, establishing a new state-of-the-art in real-time neural rendering.
  arXiv  Detail & Related papers  (2025-05-29T22:52:51Z)
• EasySplat: View-Adaptive Learning makes 3D Gaussian Splatting Easy [34.27245715540978]
  We introduce a novel framework EasySplat to achieve high-quality 3DGS modeling. We propose an efficient grouping strategy based on view similarity, and use robust pointmap priors to obtain high-quality point clouds. After obtaining a reliable scene structure, we propose a novel densification approach that adaptively splits Gaussian primitives based on the average shape of neighboring Gaussian ellipsoids.
  arXiv  Detail & Related papers  (2025-01-02T01:56:58Z)
• Gradient-Weighted Feature Back-Projection: A Fast Alternative to Feature Distillation in 3D Gaussian Splatting [6.647959476396794]
  Our approach back-projects 2D features into pre-trained 3D Gaussians, using a weighted sum based on each Gaussian's influence in the final rendering. While most training-based feature field rendering methods excel at 2D segmentation but perform poorly at 3D segmentation without post-processing, our method achieves high-quality results in both 2D and 3D segmentation.
  arXiv  Detail & Related papers  (2024-11-19T12:17:15Z)
• MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Rendering [61.64903786502728]
  We propose a novel approach that integrates mesh representation with 3D Gaussian splats to perform high-quality rendering of reconstructed real-world scenes. We consider the distance between each Gaussian splat and the mesh surface to distinguish between tightly-bound and loosely-bound splats. Our method surpasses recent mesh-based neural rendering techniques by achieving a 2dB higher PSNR, and outperforms mesh-based Gaussian splatting methods by 1.3 dB PSNR.
  arXiv  Detail & Related papers  (2024-10-11T16:07:59Z)
• MVGS: Multi-view-regulated Gaussian Splatting for Novel View Synthesis [22.80370814838661]
  Recent works in volume rendering, textite.g. NeRF and 3D Gaussian Splatting (3DGS), significantly advance the rendering quality and efficiency. We propose a new 3DGS optimization method embodying four key novel contributions.
  arXiv  Detail & Related papers  (2024-10-02T23:48:31Z)
• FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimally [66.28517576128381]
  This study addresses the challenge of accurately segmenting 3D Gaussian Splatting from 2D masks. We propose a straightforward yet globally optimal solver for 3D-GS segmentation. Our method completes within 30 seconds, about 50$times$ faster than the best existing methods.
  arXiv  Detail & Related papers  (2024-09-12T17:58:13Z)
• Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Rendering [81.88246351984908]
  We propose a unified optimization method to make Gaussians adaptive for arbitrary scales. Inspired by the mipmap technique, we design pseudo ground-truth for the target scale and propose a scale-consistency guidance loss to inject scale information into 3D Gaussians. Our method outperforms 3DGS in PSNR by an average of 9.25 dB for zoom-in and 10.40 dB for zoom-out.
  arXiv  Detail & Related papers  (2024-08-12T16:49:22Z)
• Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos [58.22272760132996]
  We show that existing 4D Gaussian methods dramatically fail in this setup because the monocular setting is underconstrained. We propose Dynamic Gaussian Marbles, which consist of three core modifications that target the difficulties of the monocular setting. We evaluate on the Nvidia Dynamic Scenes dataset and the DyCheck iPhone dataset, and show that Gaussian Marbles significantly outperforms other Gaussian baselines in quality.
  arXiv  Detail & Related papers  (2024-06-26T19:37:07Z)
• GVGEN: Text-to-3D Generation with Volumetric Representation [89.55687129165256]
  3D Gaussian splatting has emerged as a powerful technique for 3D reconstruction and generation, known for its fast and high-quality rendering capabilities. This paper introduces a novel diffusion-based framework, GVGEN, designed to efficiently generate 3D Gaussian representations from text input.
  arXiv  Detail & Related papers  (2024-03-19T17:57:52Z)
• GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting [7.121259735505479]
  We introduce the Gaussian Mesh Splatting (GaMeS) model, which allows modification of Gaussian components in a similar way as meshes.<n>We also define Gaussian splats solely based on their location on the mesh, allowing for automatic adjustments in position, scale, and rotation during animation.
  arXiv  Detail & Related papers  (2024-02-02T14:50:23Z)
• SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering [24.91019554830571]
  We propose a method to allow precise and extremely fast mesh extraction from 3D Gaussian Splatting. It is however challenging to extract a mesh from the millions of tiny 3D gaussians as these gaussians tend to be unorganized after optimization.
  arXiv  Detail & Related papers  (2023-11-21T18:38:03Z)
• GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting [51.96353586773191]
  We introduce textbfGS-SLAM that first utilizes 3D Gaussian representation in the Simultaneous Localization and Mapping system. Our method utilizes a real-time differentiable splatting rendering pipeline that offers significant speedup to map optimization and RGB-D rendering. Our method achieves competitive performance compared with existing state-of-the-art real-time methods on the Replica, TUM-RGBD datasets.
  arXiv  Detail & Related papers  (2023-11-20T12:08:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.