Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture

• URL: http://arxiv.org/abs/2604.00857v1
• Date: Wed, 01 Apr 2026 13:09:44 GMT
• Title: Sparkle: A Robust and Versatile Representation for Point Cloud based Human Motion Capture
• Abstract summary: We propose Sparkle, a structured representation unifying skeletal joints and surface anchors with explicit kinematic-geometric factorization.<n>Our framework, SparkleMotion, learns this representation through hierarchical modules embedding geometric continuity and kinematic constraints.
• Score: 49.03484143534186
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Point cloud-based motion capture leverages rich spatial geometry and privacy-preserving sensing, but learning robust representations from noisy, unstructured point clouds remains challenging. Existing approaches face a struggle trade-off between point-based methods (geometrically detailed but noisy) and skeleton-based ones (robust but oversimplified). We address the fundamental challenge: how to construct an effective representation for human motion capture that can balance expressiveness and robustness. In this paper, we propose Sparkle, a structured representation unifying skeletal joints and surface anchors with explicit kinematic-geometric factorization. Our framework, SparkleMotion, learns this representation through hierarchical modules embedding geometric continuity and kinematic constraints. By explicitly disentangling internal kinematic structure from external surface geometry, SparkleMotion achieves state-of-the-art performance not only in accuracy but crucially in robustness and generalization under severe domain shifts, noise, and occlusion. Extensive experiments demonstrate our superiority across diverse sensor types and challenging real-world scenarios.

Related papers

• Monocular Vision Based Control Framework for Grasping [8.44254908378373]
  We present a vision-based grasping framework that targets both soft and rigid objects within a single control pipeline.<n>The proposed system combines open-vocabulary object detection, image segmentation, boundary-aware point assignment, real-time point tracking, and monocular depth estimation.<n>Results demonstrate that the framework achieves stable grasping across both soft and rigid objects using visual feedback alone.
  arXiv  Detail & Related papers  (2026-07-08T20:13:17Z)
• Vision Pretraining for Dense Spatial Perception [69.54043654361772]
  We study vision pretraining through a boundary-centric lens, motivated by the premise that boundaries and shape discontinuities offer essential cues for perceiving geometric properties.<n>Our findings reveal that boundary modeling goes beyond simple line segments and instead serves as a scalable pretraining principle for learning spatially structured visual representations.
  arXiv  Detail & Related papers  (2026-07-06T15:56:14Z)
• Detailed Geometry and Appearance from Opportunistic Motion [44.38825288921379]
  Reconstructing 3D geometry and appearance from a sparse set of fixed cameras is a foundational task with broad applications.<n>We show that the static cameras effectively orbit'' the object in its local coordinate frame, providing additional virtual viewpoints.<n> Harnessing this object motion, however, poses two challenges: the tight coupling of object pose and geometry estimation and the complex appearance variations of a moving object under static illumination.
  arXiv  Detail & Related papers  (2026-03-27T17:59:16Z)
• Motion Forcing: A Decoupled Framework for Robust Video Generation in Motion Dynamics [37.22501359080204]
  We introduce textbfMotion Forcing, a framework designed to stabilize a video generation equilibrium.<n>Our key insight is to explicitly decouple physical reasoning from visual synthesis.<n>Experiments on autonomous driving benchmarks show that Motion Forcing significantly outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-03-11T04:44:46Z)
• Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects [59.51185639557874]
  We introduce Kinematify, an automated framework that synthesizes articulated objects directly from arbitrary RGB images or textual descriptions.<n>Our method addresses two core challenges: (i) inferring kinematic topologies for high-DoF objects and (ii) estimating joint parameters from static geometry.
  arXiv  Detail & Related papers  (2025-11-03T07:21:42Z)
• Explicitly Disentangled Representations in Object-Centric Learning [0.0]
  We propose a novel architecture that biases object-centric models toward disentangling shape and texture components.<n>In particular, we propose a novel architecture that biases object-centric models toward disentangling shape and texture components.
  arXiv  Detail & Related papers  (2024-01-18T17:22:11Z)
• ZoomNeXt: A Unified Collaborative Pyramid Network for Camouflaged Object Detection [70.11264880907652]
  Recent object (COD) attempts to segment objects visually blended into their surroundings, which is extremely complex and difficult in real-world scenarios. We propose an effective unified collaborative pyramid network that mimics human behavior when observing vague images and camouflaged zooming in and out. Our framework consistently outperforms existing state-of-the-art methods in image and video COD benchmarks.
  arXiv  Detail & Related papers  (2023-10-31T06:11:23Z)
• Spotlight Attention: Robust Object-Centric Learning With a Spatial Locality Prior [88.9319150230121]
  Object-centric vision aims to construct an explicit representation of the objects in a scene. We incorporate a spatial-locality prior into state-of-the-art object-centric vision models. We obtain significant improvements in segmenting objects in both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-05-31T04:35:50Z)
• Robust and Controllable Object-Centric Learning through Energy-based Models [95.68748828339059]
  ours is a conceptually simple and general approach to learning object-centric representations through an energy-based model. We show that ours can be easily integrated into existing architectures and can effectively extract high-quality object-centric representations.
  arXiv  Detail & Related papers  (2022-10-11T15:11:15Z)
• A Hierarchy-Aware Pose Representation for Deep Character Animation [2.47343886645587]
  We present a robust pose representation for motion modeling, suitable for deep character animation. Our representation is based on dual quaternions, the mathematical abstractions with well-defined operations, which simultaneously encode rotational and positional orientation. We show that our representation overcomes common motion artifacts, and assess its performance compared to other popular representations.
  arXiv  Detail & Related papers  (2021-11-27T14:33:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.