Classifying daily activities needs posture, reconstructing them needs motion

• URL: http://arxiv.org/abs/2607.13216v1
• Date: Tue, 14 Jul 2026 19:21:32 GMT
• Title: Classifying daily activities needs posture, reconstructing them needs motion
• Abstract summary: We used videos of 16 daily activities from the MoVi dataset to compare three movement analysis strategies.<n>We found two discriminative features for movement classification.<n>We identified 9 critical joints that are most predictive for movement classification.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Humans recognize movements effortlessly, even from noisy and complex visual input. But what information in the stimulus allows humans to rapidly classify movements? No framework has systematically compared different strategies of movement analysis to address this question. Here, we used videos of 16 daily activities from the MoVi dataset and compared three strategies: Temporal Movement Primitives (TMPs), which decompose movements into weighted sums of temporally smooth basis functions; Legendre polynomial coefficients, which project joint-coordinate trajectories onto an orthogonal polynomial basis; and Autoencoder latent embeddings. Legendre coefficients and TMPs achieved the highest classifier accuracy, followed by autoencoders. We found two discriminative features for movement classification. The most informative is the general posture of the body, the average spatial configuration that distinguishes one activity from another. Additionally, we identified 9 critical joints that are most predictive for movement classification. Interestingly, good classification accuracy did not automatically lead to good movement generation: when we reconstructed movements for each activity, TMPs preserved the temporal dynamics and produced perceptually natural motion, whereas reconstructions from Legendre coefficients retained only the average posture and appeared frozen. These results reveal a dissociation in how movement information is organized: the static configuration of the body suffices to classify what activity is performed, but the temporal dynamics of movement are required to reconstruct how it unfolds. This distinction clarifies which features the visual system may rely upon for rapid action recognition, and suggests that postural features could enable efficient movement screening in clinical applications, while dynamic information remain essential wherever movement generation is the goal.

Related papers

• MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations [51.837372131319285]
  MotionMAR is a framework for motion reconstruction from sparse observations.<n>It first estimates the global trajectory of human motion and then gradually refines the temporal details.<n>MotionMAR achieves state-of-the-art accuracy on the AMASS dataset.
  arXiv  Detail & Related papers  (2026-06-22T08:15:56Z)
• IAM: Identity-Aware Human Motion and Shape Joint Generation [14.037850965399384]
  We propose an identity-aware motion generation framework that explicitly models the relationship between body morphology and motion dynamics.<n>We introduce a joint motion-shape generation paradigm that simultaneously synthesizes motion sequences and body shape parameters.<n>Experiments on motion capture datasets and large-scale in-the-wild videos demonstrate improved motion realism and motion-identity consistency.
  arXiv  Detail & Related papers  (2026-04-28T03:15:12Z)
• Bio-Inspired Self-Supervised Learning for Wrist-worn IMU Signals [21.295169769759053]
  We introduce a novel tokenization strategy grounded in the submovement theory of motor control.<n>We define our token as the movement segment, a unit of motion composed of a finite sequence of submovements.<n>Our representations outperform strong wearable SSL baselines across six subject-disjoint HAR benchmarks.
  arXiv  Detail & Related papers  (2026-03-11T16:48:33Z)
• Training-free Motion Factorization for Compositional Video Generation [57.819757612370374]
  We propose a motion factorization framework that decomposes complex motion into three primary categories: motionlessness, rigid motion, and non-rigid motion.<n>Our framework achieves impressive performance in motion synthesis on real-world benchmarks.
  arXiv  Detail & Related papers  (2026-03-10T02:27:48Z)
• PALUM: Part-based Attention Learning for Unified Motion Retargeting [53.17113525688095]
  Remotion between characters with different skeleton structures is a fundamental challenge in computer animation.<n>We present a novel approach that learns common motion representations across diverse skeleton topologies.<n>Experiments demonstrate superior performance in handling diverse skeletal structures while maintaining motion realism and semantic fidelity.
  arXiv  Detail & Related papers  (2026-01-12T07:29:44Z)
• Universal Humanoid Motion Representations for Physics-Based Control [71.46142106079292]
  We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control. We first learn a motion imitator that can imitate all of human motion from a large, unstructured motion dataset. We then create our motion representation by distilling skills directly from the imitator.
  arXiv  Detail & Related papers  (2023-10-06T20:48:43Z)
• Priority-Centric Human Motion Generation in Discrete Latent Space [59.401128190423535]
  We introduce a Priority-Centric Motion Discrete Diffusion Model (M2DM) for text-to-motion generation. M2DM incorporates a global self-attention mechanism and a regularization term to counteract code collapse. We also present a motion discrete diffusion model that employs an innovative noise schedule, determined by the significance of each motion token.
  arXiv  Detail & Related papers  (2023-08-28T10:40:16Z)
• Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Video [16.32910684198013]
  We present a novel multi-frame human pose estimation framework, which employs temporal differences across frames to model dynamic contexts. To be specific, we design a multi-stage entangled learning sequences conditioned on multi-stage differences to derive informative motion representation sequences. These place us to rank No.1 in the Crowd Pose Estimation in Complex Events Challenge on benchmark HiEve.
  arXiv  Detail & Related papers  (2023-03-15T09:29:03Z)
• Human MotionFormer: Transferring Human Motions with Vision Transformers [73.48118882676276]
  Human motion transfer aims to transfer motions from a target dynamic person to a source static one for motion synthesis. We propose Human MotionFormer, a hierarchical ViT framework that leverages global and local perceptions to capture large and subtle motion matching. Experiments show that our Human MotionFormer sets the new state-of-the-art performance both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2023-02-22T11:42:44Z)
• Motion Gait: Gait Recognition via Motion Excitation [5.559482051571756]
  We propose Motion Excitation Module (MEM) to guide-temporal features to focus on human parts with large dynamic changes. MEM learns the difference information between frames and intervals, so as to obtain the representation of changes temporal motion changes. We present the Fine Feature Extractor (EFF), which independently learns according to the spatial-temporal representations of human horizontal parts of individuals.
  arXiv  Detail & Related papers  (2022-06-22T13:47:14Z)
• Affective Movement Generation using Laban Effort and Shape and Hidden Markov Models [6.181642248900806]
  This paper presents an approach for automatic affective movement generation that makes use of two movement abstractions: 1) Laban movement analysis (LMA), and 2) hidden Markov modeling. The LMA provides a systematic tool for an abstract representation of the kinematic and expressive characteristics of movements. An HMM abstraction of the identified movements is obtained and used with the desired motion path to generate a novel movement that conveys the target emotion. The efficacy of the proposed approach in generating movements with recognizable target emotions is assessed using a validated automatic recognition model and a user study.
  arXiv  Detail & Related papers  (2020-06-10T21:24:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.