Adaptive Torque Control of Exoskeletons under Spasticity Conditions via Reinforcement Learning

• URL: http://arxiv.org/abs/2503.11433v1
• Date: Fri, 14 Mar 2025 14:22:09 GMT
• Title: Adaptive Torque Control of Exoskeletons under Spasticity Conditions via Reinforcement Learning
• Authors: Andrés Chavarrías, David Rodriguez-Cianca, Pablo Lanillos,
• Abstract summary: We describe a novel adaptive torque controller via deep reinforcement learning (RL) for a knee exoskeleton under joint spasticity conditions.<n>Results for a simulated knee extension movement showed that the agent learns to control the exoskeleton for individuals with different levels of spasticity.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spasticity is a common movement disorder symptom in individuals with cerebral palsy, hereditary spastic paraplegia, spinal cord injury and stroke, being one of the most disabling features in the progression of these diseases. Despite the potential benefit of using wearable robots to treat spasticity, their use is not currently recommended to subjects with a level of spasticity above ${1^+}$ on the Modified Ashworth Scale. The varying dynamics of this velocity-dependent tonic stretch reflex make it difficult to deploy safe personalized controllers. Here, we describe a novel adaptive torque controller via deep reinforcement learning (RL) for a knee exoskeleton under joint spasticity conditions, which accounts for task performance and interaction forces reduction. To train the RL agent, we developed a digital twin, including a musculoskeletal-exoskeleton system with joint misalignment and a differentiable spastic reflexes model for the muscles activation. Results for a simulated knee extension movement showed that the agent learns to control the exoskeleton for individuals with different levels of spasticity. The proposed controller was able to reduce maximum torques applied to the human joint under spastic conditions by an average of 10.6\% and decreases the root mean square until the settling time by 8.9\% compared to a conventional compliant controller.

Related papers

• Bridging Structural Dynamics and Biomechanics: Human Motion Estimation through Footstep-Induced Floor Vibrations [2.7180946990643466]
  Existing approaches involve monitoring devices such as cameras, wearables, and pressure mats. We leverage gait-induced floor vibration to estimate lower-limb joint motion. Our model poses physical constraints to reduce uncertainty while allowing information sharing between the body and the floor.
  arXiv  Detail & Related papers  (2025-02-21T20:10:15Z)
• Deep-Learning Control of Lower-Limb Exoskeletons via simplified Therapist Input [0.0]
  Partial-assistance exoskeletons hold significant potential for gait rehabilitation.<n>The control of interaction torques in exoskeletons relies on a hierarchical control structure.<n>This work proposes a three-step, data-driven approach to address the limitations of hierarchical control in exoskeletons.
  arXiv  Detail & Related papers  (2024-12-10T22:52:44Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Learning Realistic Joint Space Boundaries for Range of Motion Analysis of Healthy and Impaired Human Arms [0.5530212768657544]
  We propose a data-driven method to learn realistic anatomically constrained upper-limb range of motion boundaries from motion capture data. We also propose an impairment index (II) metric that offers a quantitative assessment of capability/impairment when comparing healthy and impaired arms.
  arXiv  Detail & Related papers  (2023-11-17T17:14:42Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• An adaptive closed-loop ECoG decoder for long-term and stable bimanual control of an exoskeleton by a tetraplegic [91.6474995587871]
  High performance control of diverse effectors for complex tasks must be robust over time and of high decoding performance without continuous recalibration of the decoders. We developed an adaptive online tensor-based decoder: the Recursive Exponentially Weighted Markov-Switching multi- Linear Model (REW-MSLM) We demonstrated over a period of 6 months the stability of the 8-dimensional alternative bimanual control of the exoskeleton and its virtual avatar using REW-MSLM without recalibration of the decoder.
  arXiv  Detail & Related papers  (2022-01-25T16:51:29Z)
• A Novel Sample-efficient Deep Reinforcement Learning with Episodic Policy Transfer for PID-Based Control in Cardiac Catheterization Robots [2.3939470784308914]
  The model was validated for axial motion control of a robotic system designed for intravascular catheterization. Performance comparison with conventional methods in average of 10 trials shows the agent tunes the gain better with error of 0.003 mm.
  arXiv  Detail & Related papers  (2021-10-28T08:18:01Z)
• A novel approach for modelling and classifying sit-to-stand kinematics using inertial sensors [0.6243048287561809]
  The sit-to-stand movement is often affected in older adults due to frailty and in patients with motor impairments such as Parkinson's disease leading to falls. We propose a three-segment body model for estimating sit-to-stand kinematics using only two wearable inertial sensors. We applied this model on 10 younger healthy adults (YH), 12 older healthy adults (OH) and 12 people with Parkinson's disease (PwP)
  arXiv  Detail & Related papers  (2021-07-14T17:31:50Z)
• Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses [78.120734120667]
  We introduce a novel method, based on a long short-term memory (LSTM) network, to continuously map forearm EMG activity onto hand kinematics. Ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset. Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.
  arXiv  Detail & Related papers  (2021-04-29T00:11:32Z)
• Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
  The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator. A cost-sensitive active learning approach is used to select optimal joint configurations. The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
  arXiv  Detail & Related papers  (2021-01-26T16:01:02Z)
• Learning Compliance Adaptation in Contact-Rich Manipulation [81.40695846555955]
  We propose a novel approach for learning predictive models of force profiles required for contact-rich tasks. The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller.
  arXiv  Detail & Related papers  (2020-05-01T05:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.