RoleMotion: A Large-Scale Dataset towards Robust Scene-Specific Role-Playing Motion Synthesis with Fine-grained Descriptions

• URL: http://arxiv.org/abs/2512.01582v1
• Date: Mon, 01 Dec 2025 11:59:03 GMT
• Title: RoleMotion: A Large-Scale Dataset towards Robust Scene-Specific Role-Playing Motion Synthesis with Fine-grained Descriptions
• Abstract summary: RoleMotion is a large-scale human motion dataset that encompasses a wealth of role-playing and functional motion data.<n>The dataset features 25 classic scenes, 110 functional roles, over 500 behaviors, and 10296 high-quality human motion sequences of body and hands.
• Score: 30.667328312674368
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we introduce RoleMotion, a large-scale human motion dataset that encompasses a wealth of role-playing and functional motion data tailored to fit various specific scenes. Existing text datasets are mainly constructed decentrally as amalgamation of assorted subsets that their data are nonfunctional and isolated to work together to cover social activities in various scenes. Also, the quality of motion data is inconsistent, and textual annotation lacks fine-grained details in these datasets. In contrast, RoleMotion is meticulously designed and collected with a particular focus on scenes and roles. The dataset features 25 classic scenes, 110 functional roles, over 500 behaviors, and 10296 high-quality human motion sequences of body and hands, annotated with 27831 fine-grained text descriptions. We build an evaluator stronger than existing counterparts, prove its reliability, and evaluate various text-to-motion methods on our dataset. Finally, we explore the interplay of motion generation of body and hands. Experimental results demonstrate the high-quality and functionality of our dataset on text-driven whole-body generation.

Related papers

• RoboTacDex: A Dexterous Visual-Tactile-Action Dataset for Humanoid Manipulation [29.49648908136145]
  RoboTacDex is a large, multi-modal, and diverse dataset of dexterous manipulation behaviors performed with a humanoid robot.<n>Built on the publicly accessible humanoid robot Unitree G1, RoboTacDex consists of 6k trajectories covering 19 tasks, 23 skills, and interactions with 22 objects.
  arXiv  Detail & Related papers  (2026-06-30T15:39:29Z)
• XmoPipe: A Pipeline for Large-Scale In-the-Wild Human Motion Dataset Construction [39.41824537790665]
  Large-scale human motion datasets are essential for training robust motion models for analysis, synthesis, and understanding.<n>Recent advances in monocular motion capture and video-language understanding open the way to extract plausible motion from online videos.<n>We present a scalable pipeline for constructing in-the-wild human motion datasets.
  arXiv  Detail & Related papers  (2026-06-17T09:33:33Z)
• HandX: Scaling Bimanual Motion and Interaction Generation [55.486397101415]
  HandX is a unified foundation spanning data, annotation, and evaluation.<n>We consolidate and filter existing datasets for quality, and collect a new motion-capture dataset.<n>Experiments demonstrate high-quality dexterous motion generation, supported by our newly proposed hand-focused metrics.
  arXiv  Detail & Related papers  (2026-03-30T17:59:49Z)
• Kimodo: Scaling Controllable Human Motion Generation [77.66868439601062]
  Kimodo is a controllable kinematic motion diffusion model trained on 700 hours of optical motion capture data.<n>Our model generates high-quality motions while being easily controlled through text and a comprehensive suite of kinematic constraints.
  arXiv  Detail & Related papers  (2026-03-16T17:09:30Z)
• FrankenMotion: Part-level Human Motion Generation and Composition [41.84042766842064]
  We construct a high-quality motion dataset with atomic, temporally-aware part-level text annotations.<n>Our dataset captures asynchronous and semantically distinct part movements at fine temporal resolution.<n>Based on this dataset, we introduce a diffusion-based part-aware motion generation framework, namely FrankenMotion.
  arXiv  Detail & Related papers  (2026-01-15T23:50:07Z)
• InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation [54.09384502044162]
  We introduce InterAct, a large-scale 3D HOI benchmark featuring dataset and methodological advancements.<n>First, we consolidate and standardize 21.81 hours of HOI data from diverse sources, enriching it with detailed textual annotations.<n>Second, we propose a unified optimization framework to enhance data quality by reducing artifacts and correcting hand motions.<n>Third, we define six benchmarking tasks and develop a unified HOI generative modeling perspective, achieving state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-09-11T15:43:54Z)
• FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editing [36.42160163142448]
  We propose the FineMotion dataset, which contains over 442,000 human motion snippets.<n>The dataset includes about 95k detailed paragraphs describing the movements of human body parts of entire motion sequences.
  arXiv  Detail & Related papers  (2025-07-26T07:54:29Z)
• How to Move Your Dragon: Text-to-Motion Synthesis for Large-Vocabulary Objects [37.10752536568922]
  Motion synthesis for diverse object categories holds great potential for 3D content creation.<n>We address the lack of comprehensive motion datasets that include a wide range of high-quality motions and annotations.<n>We introduce rig augmentation techniques that generate diverse motion data while preserving consistent dynamics.
  arXiv  Detail & Related papers  (2025-03-06T09:39:09Z)
• InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions [67.37790144477503]
  We propose InterDance, a large-scale duet dance dataset that significantly enhances motion quality, data scale, and the variety of dance genres.<n>We introduce a diffusion-based framework with an interaction refinement guidance strategy to optimize the realism of interactions progressively.
  arXiv  Detail & Related papers  (2024-12-22T11:53:51Z)
• Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description [56.69740649781989]
  3D scene understanding is a long-standing challenge in computer vision and a key component in enabling mixed reality, wearable computing, and embodied AI.<n>We introduce Articulate3D, an expertly curated 3D dataset featuring high-quality manual annotations on 280 indoor scenes.<n>We also present USDNet, a novel unified framework capable of simultaneously predicting part segmentation along with a full specification of motion attributes for articulated objects.
  arXiv  Detail & Related papers  (2024-12-02T11:33:55Z)
• Autonomous Character-Scene Interaction Synthesis from Text Instruction [45.255215402142596]
  We introduce a framework for synthesizing multi-stage scene-aware interaction motions directly from a single text instruction and goal location. Our approach employs an auto-regressive diffusion model to synthesize the next motion segment, along with an autonomous scheduler predicting the transition for each action stage. We present a comprehensive motion-captured dataset comprising 16 hours of motion sequences in 120 indoor scenes covering 40 types of motions, each annotated with precise language descriptions.
  arXiv  Detail & Related papers  (2024-10-04T06:58:45Z)
• Towards Open Domain Text-Driven Synthesis of Multi-Person Motions [36.737740727883924]
  We curate human pose and motion datasets by estimating pose information from large-scale image and video datasets. Our method is the first to generate multi-subject motion sequences with high diversity and fidelity from a large variety of textual prompts.
  arXiv  Detail & Related papers  (2024-05-28T18:00:06Z)
• Generating Human Interaction Motions in Scenes with Text Control [66.74298145999909]
  We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Our approach begins with pre-training a scene-agnostic text-to-motion diffusion model. To facilitate training, we embed annotated navigation and interaction motions within scenes.
  arXiv  Detail & Related papers  (2024-04-16T16:04:38Z)
• Scaling Up Dynamic Human-Scene Interaction Modeling [58.032368564071895]
  TRUMANS is the most comprehensive motion-captured HSI dataset currently available. It intricately captures whole-body human motions and part-level object dynamics. We devise a diffusion-based autoregressive model that efficiently generates HSI sequences of any length.
  arXiv  Detail & Related papers  (2024-03-13T15:45:04Z)
• Synthesizing Physical Character-Scene Interactions [64.26035523518846]
  It is necessary to synthesize such interactions between virtual characters and their surroundings. We present a system that uses adversarial imitation learning and reinforcement learning to train physically-simulated characters. Our approach takes physics-based character motion generation a step closer to broad applicability.
  arXiv  Detail & Related papers  (2023-02-02T05:21:32Z)
• Learning Action-Effect Dynamics from Pairs of Scene-graphs [50.72283841720014]
  We propose a novel method that leverages scene-graph representation of images to reason about the effects of actions described in natural language. Our proposed approach is effective in terms of performance, data efficiency, and generalization capability compared to existing models.
  arXiv  Detail & Related papers  (2022-12-07T03:36:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.