Generalizable Human Gaussian Splatting via Multi-view Semantic Consistency

• URL: http://arxiv.org/abs/2604.25466v1
• Date: Tue, 28 Apr 2026 10:12:28 GMT
• Title: Generalizable Human Gaussian Splatting via Multi-view Semantic Consistency
• Abstract summary: We propose a novel method to accurately localize 3D Gaussians and improve the quality of human rendering.<n>The key idea is to unproject latent embeddings encoded from each viewpoint into a shared 3D space through predicted depth maps.<n> Experimental results on benchmark datasets show that the proposed method efficiently improves the performance of generalizable human Gaussian splatting from sparse-view inputs.
• Score: 6.489803560613637
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, generalizable human Gaussian splatting from sparse-view inputs has been actively studied for the photorealistic human rendering. Most existing methods rely on explicit geometric constraints or predefined structural representations to accurately position 3D Gaussians. Although these approaches have shown the remarkable progress in this field, they still suffer from inconsistent feature representations across multi-view inputs due to complex articulations of the human body and limited overlaps between different views. To address this problem, we propose a novel method to accurately localize 3D Gaussians and ultimately improve the quality of human rendering. The key idea is to unproject latent embeddings encoded from each viewpoint into a shared 3D space through predicted depth maps and recalibrate them belonging to the same body part based on cross-view attention. This helps the model resolve the spatial ambiguity occurring in highly textured regions as well as occluded body parts, thus leading to the accurate localization of 3D Gaussians. Experimental results on benchmark datasets show that the proposed method efficiently improves the performance of generalizable human Gaussian splatting from sparse-view inputs.

Related papers

• PointSplat: Compact Gaussian Splatting via Human-Centric Prediction [70.45838533838104]
  We propose PointSplat, a novel human-centric approach to producing 3D human representations from input views on the fly.<n>The proposed method first estimates a coarse geometric proxy and performs ray casting to prune redundant points.<n>It then employs a Point-Image Transformer to fuse appearance and geometry features, predicting Gaussian attributes in a single forward pass.
  arXiv  Detail & Related papers  (2026-06-30T17:59:05Z)
• SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting [8.690795471370643]
  We propose a category-agnostic articulated object reconstruction framework via planar Gaussian Splatting.<n>Our method achieves higher-fidelity part-level surface reconstruction on both synthetic and real-world data.
  arXiv  Detail & Related papers  (2025-11-21T09:49:53Z)
• SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering [6.706168135661958]
  State-of-the-art multi-view methods learn to fuse predictions across views by training on large annotated datasets.<n>We propose SkelSplat, a novel framework for multi-view 3D human pose estimation based on differentiable Gaussian rendering.
  arXiv  Detail & Related papers  (2025-11-11T14:28:43Z)
• RoGSplat: Learning Robust Generalizable Human Gaussian Splatting from Sparse Multi-View Images [39.03889696169877]
  RoGSplat is a novel approach for synthesizing high-fidelity novel views of unseen human from sparse multi-view images.<n>Our method outperforms state-of-the-art methods in novel view synthesis and cross-dataset generalization.
  arXiv  Detail & Related papers  (2025-03-18T12:18:34Z)
• NovelGS: Consistent Novel-view Denoising via Large Gaussian Reconstruction Model [57.92709692193132]
  NovelGS is a diffusion model for Gaussian Splatting given sparse-view images. We leverage the novel view denoising through a transformer-based network to generate 3D Gaussians.
  arXiv  Detail & Related papers  (2024-11-25T07:57:17Z)
• GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Views [67.34073368933814]
  We propose a generalizable Gaussian Splatting approach for high-resolution image rendering under a sparse-view camera setting. We train our Gaussian parameter regression module on human-only data or human-scene data, jointly with a depth estimation module to lift 2D parameter maps to 3D space. Experiments on several datasets demonstrate that our method outperforms state-of-the-art methods while achieving an exceeding rendering speed.
  arXiv  Detail & Related papers  (2024-11-18T08:18:44Z)
• No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images [100.80376573969045]
  NoPoSplat is a feed-forward model capable of reconstructing 3D scenes parameterized by 3D Gaussians from multi-view images. Our model achieves real-time 3D Gaussian reconstruction during inference. This work makes significant advances in pose-free generalizable 3D reconstruction and demonstrates its applicability to real-world scenarios.
  arXiv  Detail & Related papers  (2024-10-31T17:58:22Z)
• PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting [54.7468067660037]
  PF3plat sets a new state-of-the-art across all benchmarks, supported by comprehensive ablation studies validating our design choices.<n>Our framework capitalizes on fast speed, scalability, and high-quality 3D reconstruction and view synthesis capabilities of 3DGS.
  arXiv  Detail & Related papers  (2024-10-29T15:28:15Z)
• Generalizable Human Gaussians for Sparse View Synthesis [48.47812125126829]
  This paper introduces a new method to learn generalizable human Gaussians that allows photorealistic and accurate view-rendering of a new human subject from a limited set of sparse views. A pivotal innovation of our approach involves reformulating the learning of 3D Gaussian parameters into a regression process defined on the 2D UV space of a human template. Our method outperforms recent methods on both within-dataset generalization as well as cross-dataset generalization settings.
  arXiv  Detail & Related papers  (2024-07-17T17:56:30Z)
• GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Prediction [70.65250036489128]
  3D semantic occupancy prediction aims to obtain 3D fine-grained geometry and semantics of the surrounding scene. We propose an object-centric representation to describe 3D scenes with sparse 3D semantic Gaussians. GaussianFormer achieves comparable performance with state-of-the-art methods with only 17.8% - 24.8% of their memory consumption.
  arXiv  Detail & Related papers  (2024-05-27T17:59:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.