Dance2Hesitate: A Multi-Modal Dataset of Dancer-Taught Hesitancy for Understandable Robot Motion

• URL: http://arxiv.org/abs/2603.10166v1
• Date: Tue, 10 Mar 2026 18:59:27 GMT
• Title: Dance2Hesitate: A Multi-Modal Dataset of Dancer-Taught Hesitancy for Understandable Robot Motion
• Abstract summary: In human-robot collaboration, a robot's expression of hesitancy is a critical factor that shapes human coordination strategies, attention allocation, and safety-related judgments.<n>We introduce and open-source a multi-modal, dancer-generated dataset of hesitant motion.<n>The dataset includes (i) kinesthetic teaching demonstrations on a Franka Emika Panda reaching from a fixed start configuration to a fixed target (a Jenga tower) with three graded hesitancy levels.
• Score: 71.79098459623397
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In human-robot collaboration, a robot's expression of hesitancy is a critical factor that shapes human coordination strategies, attention allocation, and safety-related judgments. However, designing hesitant robot motion that generalizes is challenging because the observer's inference is highly dependent on embodiment and context. To address these challenges, we introduce and open-source a multi-modal, dancer-generated dataset of hesitant motion where we focus on specific context-embodiment pairs (i.e., manipulator/human upper-limb approaching a Jenga Tower, and anthropomorphic whole body motion in free space). The dataset includes (i) kinesthetic teaching demonstrations on a Franka Emika Panda reaching from a fixed start configuration to a fixed target (a Jenga tower) with three graded hesitancy levels (slight, significant, extreme) and (ii) synchronized RGB-D motion capture of dancers performing the same reaching behavior using their upper limb across three hesitancy levels, plus full human body sequences for extreme hesitancy. We further provide documentation to enable reproducible benchmarking across robot and human modalities. Across all dancers, we obtained 70 unique whole-body trajectories, 84 upper limb trajectories spanning over the three hesitancy levels, and 66 kinesthetic teaching trajectories spanning over the three hesitancy levels. The dataset can be accessed here: https://brsrikrishna.github.io/Dance2Hesitate/.

Related papers

• SMASH: Mastering Scalable Whole-Body Skills for Humanoid Ping-Pong with Egocentric Vision [53.709632118234936]
  Methodname is a modular system for agile humanoid table tennis.<n>It unifies scalable whole-body skill learning with onboard egocentric perception.<n>We demonstrate the first humanoid table-tennis system capable of consecutive strikes using onboard sensing alone.
  arXiv  Detail & Related papers  (2026-04-01T17:11:52Z)
• Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
  We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-02-17T18:59:11Z)
• A Kung Fu Athlete Bot That Can Do It All Day: Highly Dynamic, Balance-Challenging Motion Dataset and Autonomous Fall-Resilient Tracking [5.968082051565195]
  Martial arts are characterized by rapid center-of-mass shifts, complex coordination, and abrupt posture transitions.<n>KungFuAthlete is a high-dynamic martial arts motion dataset derived from professional athletes' daily training videos.<n>We propose a novel training paradigm that enables a single policy to jointly learn high-dynamic motion tracking and fall recovery.
  arXiv  Detail & Related papers  (2026-02-14T07:49:56Z)
• ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control [37.4764082674475]
  We introduce ZEST, a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources.<n>ZEST generalizes across behaviors and platforms while avoiding contact labels, reference or observation windows, state estimators, and extensive reward shaping.<n>On Boston Dynamics' Atlas humanoid, ZEST learns dynamic, multi-contact skills (e.g., army crawl, breakdancing) from motion capture.
  arXiv  Detail & Related papers  (2026-01-30T23:35:02Z)
• Generalizable Geometric Prior and Recurrent Spiking Feature Learning for Humanoid Robot Manipulation [90.90219129619344]
  This paper presents a novel R-prior-S, Recurrent Geometric-priormodal Policy with Spiking features.<n>To ground high-level reasoning in physical reality, we leverage lightweight 2D geometric inductive biases.<n>For the data efficiency issue in robotic action generation, we introduce a Recursive Adaptive Spiking Network.
  arXiv  Detail & Related papers  (2026-01-13T23:36:30Z)
• KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control [30.738592041595933]
  We present VMS, a unified whole-body controller that enables humanoid robots to learn diverse and dynamic behaviors within a single policy.<n>Our framework integrates a hybrid tracking objective that balances local motion fidelity with global trajectory consistency.<n>We validate VMS specialization extensively in both simulation and real-world experiments, demonstrating accurate imitation of dynamic skills, stable performance over minute-long sequences, and strong generalization to unseen motions.
  arXiv  Detail & Related papers  (2025-09-20T11:31:14Z)
• Salsa as a Nonverbal Embodied Language -- The CoMPAS3D Dataset and Benchmarks [0.5937476291232802]
  We present CoMPAS3D, the largest and most diverse motion capture dataset of improvised salsa dancing.<n>The dataset includes 3 hours of leader-follower salsa dances performed by 18 dancers spanning beginner, intermediate, and professional skill levels.<n>We evaluate CoMPAS3D on two benchmark tasks for synthetic humans that parallel key problems in spoken language and dialogue processing.
  arXiv  Detail & Related papers  (2025-07-25T21:33:48Z)
• ExBody2: Advanced Expressive Humanoid Whole-Body Control [16.69009772546575]
  We propose a method for producing whole-body tracking controllers that are trained on both human motion capture and simulated data.<n>We use a teacher policy to produce intermediate data that better conforms to the robot's kinematics.<n>We observed significant improvement of tracking performance after fine-tuning on a small amount of data.
  arXiv  Detail & Related papers  (2024-12-17T18:59:51Z)
• DisCo: Disentangled Control for Realistic Human Dance Generation [125.85046815185866]
  We introduce DISCO, which includes a novel model architecture with disentangled control to improve the compositionality of dance synthesis. DisCc can generate high-quality human dance images and videos with diverse appearances and flexible motions.
  arXiv  Detail & Related papers  (2023-06-30T17:37:48Z)
• RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning [61.10744686260994]
  We introduce RoboPianist, a system that enables simulated anthropomorphic hands to learn an extensive repertoire of 150 piano pieces. We additionally introduce an open-sourced environment, benchmark of tasks, interpretable evaluation metrics, and open challenges for future study.
  arXiv  Detail & Related papers  (2023-04-09T03:53:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.