Learning Quantised Structure-Preserving Motion Representations for Dance Fingerprinting

• URL: http://arxiv.org/abs/2604.00927v1
• Date: Wed, 01 Apr 2026 14:06:59 GMT
• Title: Learning Quantised Structure-Preserving Motion Representations for Dance Fingerprinting
• Abstract summary: We present DANCEMATCH, an end-to-end framework for motion-based dance retrieval.<n>It identifies semantically similar choreographies from raw video, defined as DANCE FINGERING.
• Score: 15.668734718800065
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present DANCEMATCH, an end-to-end framework for motion-based dance retrieval, the task of identifying semantically similar choreographies directly from raw video, defined as DANCE FINGERPRINTING. While existing motion analysis and retrieval methods can compare pose sequences, they rely on continuous embeddings that are difficult to index, interpret, or scale. In contrast, DANCEMATCH constructs compact, discrete motion signatures that capture the spatio-temporal structure of dance while enabling efficient large-scale retrieval. Our system integrates Skeleton Motion Quantisation (SMQ) with Spatio-Temporal Transformers (STT) to encode human poses, extracted via Apple CoMotion, into a structured motion vocabulary. We further design DANCE RETRIEVAL ENGINE (DRE), which performs sub-linear retrieval using a histogram-based index followed by re-ranking for refined matching. To facilitate reproducible research, we release DANCETYPESBENCHMARK, a pose-aligned dataset annotated with quantised motion tokens. Experiments demonstrate robust retrieval across diverse dance styles and strong generalisation to unseen choreographies, establishing a foundation for scalable motion fingerprinting and quantitative choreographic analysis.

Related papers

• Music-to-Dance Generation via Atomic Movements [67.09789936557199]
  Music-driven dance generation aims to produce human motion that is rhythmically synchronized and semantically consistent with music.<n>We introduce a structure-aware framework that models choreography as a sequence of atomic movements-semantically interpretable motion events.<n>Our method produces dances with significantly improved structural coherence, rhythmic alignment, and perceptual naturalness compared to existing baselines.
  arXiv  Detail & Related papers  (2026-07-15T16:03:55Z)
• DanceCrafter: Fine-Grained Text-Driven Controllable Dance Generation via Choreographic Syntax [39.51425337194989]
  Text-driven controllable dance generation remains under-explored.<n>Characterizing dance is challenging owing to its intricate spatial dynamics, strong directionality, and the highly decoupled movements of distinct body parts.<n>We propose textitChoreographic Syntax, a novel theoretical framework with a tailored annotation system.
  arXiv  Detail & Related papers  (2026-04-20T01:59:30Z)
• Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Dataset [8.721362823189077]
  Listen to Rhythm, Choose Movements (LRCM) is a multimodal-guided diffusion framework supporting both diverse input modalities and autoregressive dance motion generation.<n>We will release the full dataset, and pretrained models publicly upon acceptance.
  arXiv  Detail & Related papers  (2026-01-06T14:59:22Z)
• Dance Style Classification using Laban-Inspired and Frequency-Domain Motion Features [0.13048920509133805]
  We present a framework for classifying dance styles based on pose estimates extracted from videos.<n>These features capture local joint dynamics such as velocity, acceleration, and angular movement of the upper body.<n>To further encode rhythmic and periodic aspects of movement, we integrate Fast Fourier Transform features that characterize movement patterns in the frequency domain.
  arXiv  Detail & Related papers  (2025-11-25T16:33:45Z)
• Global Position Aware Group Choreography using Large Language Model [0.0]
  We present a group choreography framework that leverages recent advancements in Large Language Models (LLM)<n>Our framework consists of a tokenizer that transforms continuous features into discrete tokens, and an LLM that is fine-tuned to predict motion tokens.<n>Our framework can generate realistic and diverse group dances while maintaining strong music correlation and dancer-wise consistency.
  arXiv  Detail & Related papers  (2025-03-12T07:25:32Z)
• Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment [87.20240797625648]
  We introduce a novel task within the field of 3D dance generation, termed dance accompaniment. It requires the generation of responsive movements from a dance partner, the "follower", synchronized with the lead dancer's movements and the underlying musical rhythm. We propose a GPT-based model, Duolando, which autoregressively predicts the subsequent tokenized motion conditioned on the coordinated information of the music, the leader's and the follower's movements.
  arXiv  Detail & Related papers  (2024-03-27T17:57:02Z)
• DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation [89.50310360658791]
  We present a novel cascaded motion diffusion model, DiffDance, designed for high-resolution, long-form dance generation. This model comprises a music-to-dance diffusion model and a sequence super-resolution diffusion model. We demonstrate that DiffDance is capable of generating realistic dance sequences that align effectively with the input music.
  arXiv  Detail & Related papers  (2023-08-05T16:18:57Z)
• BRACE: The Breakdancing Competition Dataset for Dance Motion Synthesis [123.73677487809418]
  We introduce a new dataset aiming to challenge common assumptions in dance motion synthesis. We focus on breakdancing which features acrobatic moves and tangled postures. Our efforts produced the BRACE dataset, which contains over 3 hours and 30 minutes of densely annotated poses.
  arXiv  Detail & Related papers  (2022-07-20T18:03:54Z)
• Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory [92.81383016482813]
  We propose a novel music-to-dance framework, Bailando, for driving 3D characters to dance following a piece of music. We introduce an actor-critic Generative Pre-trained Transformer (GPT) that composes units to a fluent dance coherent to the music. Our proposed framework achieves state-of-the-art performance both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2022-03-24T13:06:43Z)
• Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure [47.09425316677689]
  We present a music-driven motion synthesis framework that generates long-term sequences of human motions synchronized with the input beats. Our framework enables generation of diverse motions that are controlled by the content of the music, and not only by the beat.
  arXiv  Detail & Related papers  (2021-11-23T21:26:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.