ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views
- URL: http://arxiv.org/abs/2605.24304v1
- Date: Sat, 23 May 2026 00:31:47 GMT
- Title: ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views
- Abstract summary: ArtSplat is the first feed-forward framework for articulated 3D Gaussian Splatting.<n>It reconstructs both geometry and joint parameters from sparse multi-view images across multiple articulation states in a single forward pass.<n>Experiments on 68 articulated objects from PartNet-Mobility, including both single- and multi-joint configurations, demonstrate that ArtSplat achieves competitive performance in both geometry and joint estimation, while being over 400 times faster than baselines.
- Score: 26.73085272044419
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Articulated object reconstruction from sparse-view images is an ill-posed problem that requires simultaneous inference of geometry and underlying articulation structure. Existing methods for articulated object reconstruction based on NeRF and 3D Gaussian Splatting (3DGS) typically rely on dense views or strong priors (e.g., depth maps, joint types, predefined number of joints) and require costly per-object optimization. In this paper, we propose ArtSplat, the first feed-forward framework for articulated 3D Gaussian Splatting. It reconstructs both geometry and joint parameters from sparse multi-view images across multiple articulation states in a single forward pass. To address the challenges of single-pass articulated reconstruction, we introduce a per-pixel joint map representation that enables the integration of joint parameter estimation into the feed-forward pipeline. We further propose a Cross-State Attention (CSA) mechanism with state tokens, which effectively captures discrete motion across input states. Experiments on 68 articulated objects from PartNet-Mobility, including both single- and multi-joint configurations, demonstrate that ArtSplat achieves competitive performance in both geometry and joint estimation, while being over 400 times faster than baselines.
Related papers
- InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis [49.87457834078904]
InfiniSplat is a feed-forward single-image 3DGS framework that moves from a pixel-aligned representation toward a surface-aligned representation.<n>InfiniSplat achieves state-of-the-art performance compared with single-image feed-forward baselines.
arXiv Detail & Related papers (2026-08-03T16:17:39Z) - QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction [25.05567017307621]
We propose textbfQuerySplat, a feed-forward 3DGS framework driven by geometric priors and explicit appearance decoupling.<n>Experiments demonstrate that QuerySplat mitigates the blurry rendering issues of early query-based models.<n>On the challenging DL3DV benchmark, it achieves state-of-the-art novel view synthesis performance, with average PSNR gains of 2.30 dB and 1.04 dB over the best pose-free and pose-required baselines.
arXiv Detail & Related papers (2026-08-02T12:12:02Z) - AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting [45.65377534924918]
3D Gaussian Splatting (3DGS) has emerged as a powerful representation for high-fidelity rendering.<n>Existing assets often suffer from quality bottlenecks such as missing details and texture noise.<n>We propose a novel 3D-native refinement paradigm named AnchorSplat.
arXiv Detail & Related papers (2026-07-01T12:14:29Z) - PointSplat: Compact Gaussian Splatting via Human-Centric Prediction [70.45838533838104]
We propose PointSplat, a novel human-centric approach to producing 3D human representations from input views on the fly.<n>The proposed method first estimates a coarse geometric proxy and performs ray casting to prune redundant points.<n>It then employs a Point-Image Transformer to fuse appearance and geometry features, predicting Gaussian attributes in a single forward pass.
arXiv Detail & Related papers (2026-06-30T17:59:05Z) - ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics [22.43942785482678]
ArtMesh is a mesh-native method for reconstructing articulated objects explicitly as connected triangle meshes with per-part rigid motion.<n>We introduce Articulate-100, a new benchmark of 100 articulated objects spanning 16 PartNet-Mobility categories.
arXiv Detail & Related papers (2026-05-15T19:37:55Z) - UniQueR: Unified Query-based Feedforward 3D Reconstruction [68.01984215138098]
We present UniQueR, a unified query-based feedforward framework for efficient and accurate 3D reconstruction from unposed images.<n>Our model learns a compact set of 3D anchor points that act as explicit geometric queries.<n>Experiments on Mip-NeRF 360 and VR-NeRF demonstrate that UniQueR surpasses state-of-the-art feedforward methods in both rendering quality and geometric accuracy.
arXiv Detail & Related papers (2026-03-24T06:42:02Z) - 2Xplat: Two Experts Are Better Than One Generalist [22.824154073395878]
We introduce 2Xplat, a pose-free feed-forward 3DGS framework based on a two-expert design.<n>A dedicated geometry expert first predicts camera poses, which are then explicitly passed to a powerful appearance expert that synthesizes 3D Gaussians.<n>Despite its conceptual simplicity, being largely underexplored in prior works, the proposed approach proves highly effective.
arXiv Detail & Related papers (2026-03-22T05:14:38Z) - Joint Geometry-Appearance Human Reconstruction in a Unified Latent Space via Bridge Diffusion [57.09673862519791]
This paper introduces textbfJGA-LBD, a novel framework that unifies the modeling of geometry and appearance into a joint latent representation.<n> Experiments demonstrate that JGA-LBD outperforms current state-of-the-art approaches in terms of both geometry fidelity and appearance quality.
arXiv Detail & Related papers (2026-01-01T12:48:56Z) - REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splatting [44.02799256666578]
We propose REArtGS++, a novel method towards generalizable articulated object reconstruction.<n>We first model a decoupled screw motion for each joint without type prior, and jointly optimize part-aware Gaussians with joint parameters.<n>Experiments on both synthetic and real-world articulated objects demonstrate our superiority in generalizable part-level surface reconstruction and joint parameter estimation.
arXiv Detail & Related papers (2025-11-21T09:07:56Z) - SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting [85.87902260102652]
We introduce the novel task of Sequential 3D Gaussian Affordance Reasoning.<n>We then propose SeqSplatNet, an end-to-end framework that directly maps an instruction to a sequence of 3D affordance masks.<n>Our method sets a new state-of-the-art on our challenging benchmark, effectively advancing affordance reasoning from single-step interactions to complex, sequential tasks at the scene level.
arXiv Detail & Related papers (2025-07-31T17:56:55Z) - FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes [50.534213038479926]
FreeSplat is capable of reconstructing geometrically consistent 3D scenes from long sequence input towards free-view synthesis.
We propose a simple but effective free-view training strategy that ensures robust view synthesis across broader view range regardless of the number of views.
arXiv Detail & Related papers (2024-05-28T08:40:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.