Autoregressive Appearance Prediction for 3D Gaussian Avatars

• URL: http://arxiv.org/abs/2604.00928v1
• Date: Wed, 01 Apr 2026 14:07:14 GMT
• Title: Autoregressive Appearance Prediction for 3D Gaussian Avatars
• Abstract summary: We propose a 3D Splatting avatar model with a spatial backbone conditioned on both pose and an appearance latent.<n>The latent is learned during training by an encoder, yielding a compact representation that improves reconstruction quality.<n>Our method delivers a robust and practical path to high-fidelity, stable avatar driving.
• Score: 67.37159422872219
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A photorealistic and immersive human avatar experience demands capturing fine, person-specific details such as cloth and hair dynamics, subtle facial expressions, and characteristic motion patterns. Achieving this requires large, high-quality datasets, which often introduce ambiguities and spurious correlations when very similar poses correspond to different appearances. Models that fit these details during training can overfit and produce unstable, abrupt appearance changes for novel poses. We propose a 3D Gaussian Splatting avatar model with a spatial MLP backbone that is conditioned on both pose and an appearance latent. The latent is learned during training by an encoder, yielding a compact representation that improves reconstruction quality and helps disambiguate pose-driven renderings. At driving time, our predictor autoregressively infers the latent, producing temporally smooth appearance evolution and improved stability. Overall, our method delivers a robust and practical path to high-fidelity, stable avatar driving.

Related papers

• Latent Dynamics for Full Body Avatar Animation [18.84485573885924]
  We augment a pose-conditioned 3D Gaussian avatar with a transformer-based decoder and a dynamics residual latent.<n>The model decomposes each update into driving, restoring, and dissipative forces, producing temporally coherent, history-dependent rollouts.<n>Across nine captured sequences of everyday motion with diverse loose garments, quantitative metrics and a perceptual user study show improved animation quality over recent data-driven baselines.
  arXiv  Detail & Related papers  (2026-05-20T17:58:03Z)
• Structure-Aware Fine-Grained Gaussian Splatting for Expressive Avatar Reconstruction [27.915439949805876]
  We propose a novel method for reconstructing expressive and coherent full-body 3D human avatars from a monocular video sequence.<n>Our method requires only a single-stage training and outperforms state-of-the-art baselines in both quantitative and qualitative evaluations.
  arXiv  Detail & Related papers  (2026-04-10T13:49:15Z)
• Large-scale Codec Avatars: The Unreasonable Effectiveness of Large-scale Avatar Pretraining [62.501929209687056]
  Large-Scale Codec Avatars (LCA) is a high-fidelity, full-body 3D avatar model that generalizes to world-scale populations in a feedforward manner.<n>LCA generalizes across hair styles, clothing, and demographics while providing precise, fine-grained facial expressions and finger-level articulation control.
  arXiv  Detail & Related papers  (2026-04-02T17:58:40Z)
• Relightable and Dynamic Gaussian Avatar Reconstruction from Monocular Video [42.36677003378551]
  We propose a 3DGS-based human avatar modeling framework, termed as Relightable and Dynamic Gaussian Avatar (RnD-Avatar)<n>Our framework enables realistic rendering of novel poses and views while supporting photo-realistic lighting effects under arbitrary lighting conditions.
  arXiv  Detail & Related papers  (2025-12-10T05:51:59Z)
• RealityAvatar: Towards Realistic Loose Clothing Modeling in Animatable 3D Gaussian Avatars [4.332718737928592]
  We propose RealityAvatar, an efficient framework for high-fidelity digital human modeling, specifically targeting loosely dressed avatars.<n>By incorporating a motion trend module and a latentbone encoder, we explicitly model pose-dependent deformations and temporal variations in clothing behavior.<n>Our method significantly enhances structural fidelity and perceptual quality in dynamic human reconstruction, particularly in non-rigid regions.
  arXiv  Detail & Related papers  (2025-04-02T09:59:12Z)
• FRESA: Feedforward Reconstruction of Personalized Skinned Avatars from Few Images [74.86864398919467]
  We present a novel method for reconstructing personalized 3D human avatars with realistic animation from only a few images.<n>We learn a universal prior from over a thousand clothed humans to achieve instant feedforward generation and zero-shot generalization.<n>Our method generates more authentic reconstruction and animation than state-of-the-arts, and can be directly generalized to inputs from casually taken phone photos.
  arXiv  Detail & Related papers  (2025-03-24T23:20:47Z)
• Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence [47.16903508897047]
  In this study, we elucidate that variations in human appearance depend not only on the current frame's pose condition but also on past pose states. We introduce Dyco, a novel method utilizing the delta pose sequence representation for non-rigid deformations. In addition, our inertia-aware 3D human method can unprecedentedly simulate appearance changes caused by inertia at different velocities.
  arXiv  Detail & Related papers  (2024-03-28T06:05:14Z)
• GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians [51.46168990249278]
  We present an efficient approach to creating realistic human avatars with dynamic 3D appearances from a single video. GustafAvatar is validated on both the public dataset and our collected dataset.
  arXiv  Detail & Related papers  (2023-12-04T18:55:45Z)
• Drivable Volumetric Avatars using Texel-Aligned Features [52.89305658071045]
  Photo telepresence requires both high-fidelity body modeling and faithful driving to enable dynamically synthesized appearance. We propose an end-to-end framework that addresses two core challenges in modeling and driving full-body avatars of real people.
  arXiv  Detail & Related papers  (2022-07-20T09:28:16Z)
• Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation [67.23327074124855]
  This paper presents an elegant solution for the integration of temporal constraints in the fitting process. We derive parameters of a sequence of body models, representing shape and motion of a person, including jaw poses, facial expressions, and finger poses. Our approach enables the derivation of realistic 3D body models from image sequences, including facial expression and articulated hands.
  arXiv  Detail & Related papers  (2022-02-07T11:11:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.