Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions

• URL: http://arxiv.org/abs/2509.12741v1
• Date: Tue, 16 Sep 2025 06:53:18 GMT
• Title: Force-Modulated Visual Policy for Robot-Assisted Dressing with Arm Motions
• Abstract summary: We develop a robot-assisted dressing system capable of handling partial observations and robustly adapting to arm motions.<n>Given a policy trained in simulation with partial observations, we propose a method to fine-tune it in the real world.<n>We evaluate our method in simulation with simplified articulated human meshes and in a real world human study with 12 participants.
• Score: 17.312909681066174
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robot-assisted dressing has the potential to significantly improve the lives of individuals with mobility impairments. To ensure an effective and comfortable dressing experience, the robot must be able to handle challenging deformable garments, apply appropriate forces, and adapt to limb movements throughout the dressing process. Prior work often makes simplifying assumptions -- such as static human limbs during dressing -- which limits real-world applicability. In this work, we develop a robot-assisted dressing system capable of handling partial observations with visual occlusions, as well as robustly adapting to arm motions during the dressing process. Given a policy trained in simulation with partial observations, we propose a method to fine-tune it in the real world using a small amount of data and multi-modal feedback from vision and force sensing, to further improve the policy's adaptability to arm motions and enhance safety. We evaluate our method in simulation with simplified articulated human meshes and in a real world human study with 12 participants across 264 dressing trials. Our policy successfully dresses two long-sleeve everyday garments onto the participants while being adaptive to various kinds of arm motions, and greatly outperforms prior baselines in terms of task completion and user feedback. Video are available at https://dressing-motion.github.io/.

Related papers

• Dressing in Motion: A Human Motion-Aware Diffusion Policy for Robot-Assisted Dressing [11.869204127828944]
  We propose a visuomotor policy that learns dressing skills from static expert demonstrations and generalizes to dynamic user-motion scenarios.<n>A diffusion policy tailored to garment--human interaction geometry learns from partially observed point clouds with varied arm postures.<n>We evaluate our method in simulation and a real-world human study involving nine participants, three garment types, and six arm-motion patterns.
  arXiv  Detail & Related papers  (2026-09-04T05:42:04Z)
• Wearing A Coat: Dual-Arm Robot-Assisted Dressing with Differentiable Clothing Simulation [23.068937683212212]
  We propose a novel robotic dressing control algorithm that integrates realtime differentiable clothing simulation.<n>We experimentally validate our approach through both simulated and physical dressing scenarios.
  arXiv  Detail & Related papers  (2026-07-13T01:58:45Z)
• RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting [52.18271301977709]
  We propose RPG, a hybrid expert policy framework, for smooth and stable humanoid multi-skills transition.<n>Our approach incorporates motion transition randomization and temporal randomization to train a unified policy that generates agile fighting actions.<n>We design a control pipeline that integrates walking/running locomotion with fighting skills, allowing humanlike long-time combat of arbitrary duration.
  arXiv  Detail & Related papers  (2026-04-23T07:14:35Z)
• Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot [56.377161933570335]
  Humans naturally exploit a "weightless" state during non-self-stabilizing (NSS) motions.<n>Inspired by this biological mechanism, we propose a weightlessness-state auto-labeling strategy for dataset annotation.<n>Our work bridges the gap between precise trajectory tracking and adaptive environmental interaction, offering a biologically-inspired solution for contact-rich humanoid control.
  arXiv  Detail & Related papers  (2026-04-23T07:10:05Z)
• Imitating What Works: Simulation-Filtered Modular Policy Learning from Human Videos [56.510263910611684]
  We tackle prehensile manipulation, in which tasks involve grasping an object before performing various post-grasp motions.<n>Human videos offer strong signals for learning the post-grasp motions, but they are less useful for learning the prerequisite grasping behaviors.<n>We present Perceive-Simulate-Imitate (PSI), a framework for training a modular manipulation policy using human video motion data.
  arXiv  Detail & Related papers  (2026-02-13T18:59:10Z)
• SoftMimic: Learning Compliant Whole-body Control from Examples [10.040505865690498]
  We introduce SoftMimic, a framework for learning compliant whole-body control policies for humanoid robots from example motions.<n>We validate our method through simulations and real-world experiments, demonstrating safe and effective interaction with the environment.
  arXiv  Detail & Related papers  (2025-10-20T17:49:27Z)
• ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning [59.64325421657381]
  Humanoid whole-body loco-manipulation promises transformative capabilities for daily service and warehouse tasks.<n>We introduce ResMimic, a two-stage residual learning framework for precise and expressive humanoid control from human motion data.<n>Results show substantial gains in task success, training efficiency, and robustness over strong baselines.
  arXiv  Detail & Related papers  (2025-10-06T17:47:02Z)
• Feel the Force: Contact-Driven Learning from Humans [52.36160086934298]
  Controlling fine-grained forces during manipulation remains a core challenge in robotics.<n>We present FeelTheForce, a robot learning system that models human tactile behavior to learn force-sensitive manipulation.<n>Our approach grounds robust low-level force control in scalable human supervision, achieving a 77% success rate across 5 force-sensitive manipulation tasks.
  arXiv  Detail & Related papers  (2025-06-02T17:57:52Z)
• Imitation Learning for Adaptive Control of a Virtual Soft Exoglove [3.3030080038744947]
  We propose a customized wearable robotic controller that is able to address specific muscle deficits and to provide compensation for hand-object manipulation tasks.<n>Video data of a same subject performing human grasping tasks is used to train a manipulation model through learning from demonstration.<n>This manipulation model is subsequently fine-tuned to perform object-specific interaction tasks.<n>The muscle forces in the musculoskeletal manipulation model are then weakened to simulate neurological motor impairments, which are later compensated by the actuation of a virtual wearable robotics glove.
  arXiv  Detail & Related papers  (2025-05-14T03:09:21Z)
• HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpit [52.12750762494588]
  This paper introduces HOMIE, a semi-autonomous teleoperation system.<n>It combines a reinforcement learning policy for body control mapped to a pedal, an isomorphic exoskeleton arm for arm control, and motion-sensing gloves for hand control.<n>The system is fully open-source, demos and code can be found in our https://homietele.org/.
  arXiv  Detail & Related papers  (2025-02-18T16:33:38Z)
• ExBody2: Advanced Expressive Humanoid Whole-Body Control [16.69009772546575]
  We propose a method for producing whole-body tracking controllers that are trained on both human motion capture and simulated data.<n>We use a teacher policy to produce intermediate data that better conforms to the robot's kinematics.<n>We observed significant improvement of tracking performance after fine-tuning on a small amount of data.
  arXiv  Detail & Related papers  (2024-12-17T18:59:51Z)
• Visual Whole-Body Control for Legged Loco-Manipulation [22.50054654508986]
  We study the problem of mobile manipulation using legged robots equipped with an arm. We propose a framework that can conduct the whole-body control autonomously with visual observations.
  arXiv  Detail & Related papers  (2024-03-25T17:26:08Z)
• Expressive Whole-Body Control for Humanoid Robots [20.132927075816742]
  We learn a whole-body control policy on a human-sized robot to mimic human motions as realistic as possible. With training in simulation and Sim2Real transfer, our policy can control a humanoid robot to walk in different styles, shake hands with humans, and even dance with a human in the real world.
  arXiv  Detail & Related papers  (2024-02-26T18:09:24Z)
• AniDress: Animatable Loose-Dressed Avatar from Sparse Views Using Garment Rigging Model [58.035758145894846]
  We introduce AniDress, a novel method for generating animatable human avatars in loose clothes using very sparse multi-view videos. A pose-driven deformable neural radiance field conditioned on both body and garment motions is introduced, providing explicit control of both parts. Our method is able to render natural garment dynamics that deviate highly from the body and well to generalize to both unseen views and poses.
  arXiv  Detail & Related papers  (2024-01-27T08:48:18Z)
• Universal Humanoid Motion Representations for Physics-Based Control [71.46142106079292]
  We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control. We first learn a motion imitator that can imitate all of human motion from a large, unstructured motion dataset. We then create our motion representation by distilling skills directly from the imitator.
  arXiv  Detail & Related papers  (2023-10-06T20:48:43Z)
• Learning Dexterous Grasping with Object-Centric Visual Affordances [86.49357517864937]
  Dexterous robotic hands are appealing for their agility and human-like morphology. We introduce an approach for learning dexterous grasping. Our key idea is to embed an object-centric visual affordance model within a deep reinforcement learning loop.
  arXiv  Detail & Related papers  (2020-09-03T04:00:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.