Reinforcement-Learning-Based Assistance Reduces Squat Effort with a Modular Hip--Knee Exoskeleton

• URL: http://arxiv.org/abs/2602.17794v1
• Date: Thu, 19 Feb 2026 19:51:38 GMT
• Title: Reinforcement-Learning-Based Assistance Reduces Squat Effort with a Modular Hip--Knee Exoskeleton
• Abstract summary: We evaluated the effectiveness of a neural network controller for a modular Hip-Knee exoskeleton designed to assist squatting tasks.<n>The controller generated real-time hip and knee assistance torques based on recent joint-angle and velocity histories.<n>Results show that the RL-based controller adapts to individuals by producing torque profiles tailored to each subject's kinematics and timing.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Squatting is one of the most demanding lower-limb movements, requiring substantial muscular effort and coordination. Reducing the physical demands of this task through intelligent and personalized assistance has significant implications, particularly in industries involving repetitive low-level assembly activities. In this study, we evaluated the effectiveness of a neural network controller for a modular Hip-Knee exoskeleton designed to assist squatting tasks. The neural network controller was trained via reinforcement learning (RL) in a physics-based, human-exoskeleton interaction simulation environment. The controller generated real-time hip and knee assistance torques based on recent joint-angle and velocity histories. Five healthy adults performed three-minute metronome-guided squats under three conditions: (1) no exoskeleton (No-Exo), (2) exoskeleton with Zero-Torque, and (3) exoskeleton with active assistance (Assistance). Physiological effort was assessed using indirect calorimetry and heart rate monitoring, alongside concurrent kinematic data collection. Results show that the RL-based controller adapts to individuals by producing torque profiles tailored to each subject's kinematics and timing. Compared with the Zero-Torque and No-Exo condition, active assistance reduced the net metabolic rate by approximately 10%, with minor reductions observed in heart rate. However, assisted trials also exhibited reduced squat depth, reflected by smaller hip and knee flexion. These preliminary findings suggest that the proposed controller can effectively lower physiological effort during repetitive squatting, motivating further improvements in both hardware design and control strategies.

Related papers

• Physics-Informed Deep Learning for False Ventricular Tachycardia Alarm Reduction in the ICU [44.313512671851306]
  False ventricular tachycardia (VT) alarms are a leading contributor to alarm fatigue in intensive care units.<n>We propose a deep learning framework combining a 1D SE-ResNet with ICU-realistic data augmentations and a physics-informed auxiliary reconstruction task.
  arXiv  Detail & Related papers  (2026-09-08T16:33:07Z)
• ATP: Anatomical Torque with Passivity-based Control Framework for Safe Upper-Limb Exoskeleton Assistance [8.72367908819341]
  This paper proposes Anatomical Torque with Passivity-Based Control for safe upper-limb exoskeleton assistance.<n>An online torque-refinement scheme adapts the reference to diverse movements, suppresses tendon-induced spikes, and incorporates a learned anomaly score for safe and comfortable assistance.<n> Simulations and real-world experiments show accurate tracking of long-duration motion sequences and generalization to real-time human movements.
  arXiv  Detail & Related papers  (2026-08-06T08:06:40Z)
• Friction Characterization of a Cable-Driven Differential Actuation System for Lower-Limb Exoskeletons [42.628421392139]
  Lower-limb exoskeletons require actuation systems that can provide accurate joint torque control.<n> Conventional architectures often rely on independently actuated joints and joint-level torque sensors.<n>This paper presents a novel differential actuation architecture for hip-knee flexion/extension.
  arXiv  Detail & Related papers  (2026-06-14T19:47:32Z)
• Musculoskeletal Motion Imitation for Learning Personalized Exoskeleton Control Policy in Impaired Gait [1.224954637705144]
  We introduce a device-agnostic framework to enable scalable personalized exoskeleton assistance for both able-bodied and clinical populations.<n>Our control policies generate physiologically plausible locomotion dynamics and capture clinically observed compensatory strategies under targeted muscular deficits.<n>Without task-specific tuning, the resulting exoskeleton control policies produce assistive torque profiles at the hip and ankle that align with state-of-the-art profiles validated in human experiments.
  arXiv  Detail & Related papers  (2026-04-10T15:49:24Z)
• Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation [0.0]
  Human locomotion emerges from high-dimensional neuromuscular control, making predictive musculoskeletal simulation challenging.<n>We present a physiology-informed reinforcement-learning framework that constrains control using muscle synergies.<n>These results show that embedding neurophysiological structure into reinforcement learning can improve biomechanical fidelity and generalization in predictive human locomotion simulation with limited experimental data.
  arXiv  Detail & Related papers  (2026-03-11T06:48:15Z)
• SMAT: Staged Multi-Agent Training for Co-Adaptive Exoskeleton Control [1.7061322026474812]
  We propose a four-stage curriculum designed to mirror how users naturally acclimate to a wearable device.<n>We implement SMAT in the MyoAssist simulation environment using a 26-muscle lower-limb model and an attached hip exoskeleton.<n>Our musculoskeletal simulations demonstrate that the learned exoskeleton control policy produces an average 10.1% reduction in hip muscle activation relative to the no-assist condition.
  arXiv  Detail & Related papers  (2026-03-08T13:06:36Z)
• From Vision to Assistance: Gaze and Vision-Enabled Adaptive Control for a Back-Support Exoskeleton [42.24099624713759]
  We present a vision-gated control framework for an active lumbar occupational exoskeleton.<n>The proposed system integrates real-time grasp detection from a first-person YOLO-based perception system.<n>A user study shows that vision-gated assistance significantly reduces perceived physical demand.
  arXiv  Detail & Related papers  (2026-02-04T15:23:42Z)
• Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor control [47.423243831156285]
  We present a model-free motion imitation framework (KINESIS) to advance the understanding of muscle-based motor control.<n>We demonstrate that KINESIS achieves strong imitation performance on 1.9 hours of motion capture data.<n>KINESIS generates muscle activity patterns that correlate well with human EMG activity.
  arXiv  Detail & Related papers  (2025-03-18T18:37:49Z)
• Adaptive Torque Control of Exoskeletons under Spasticity Conditions via Reinforcement Learning [0.0]
  We describe a novel adaptive torque controller via deep reinforcement learning (RL) for a knee exoskeleton under joint spasticity conditions.<n>Results for a simulated knee extension movement showed that the agent learns to control the exoskeleton for individuals with different levels of spasticity.
  arXiv  Detail & Related papers  (2025-03-14T14:22:09Z)
• Bridging Structural Dynamics and Biomechanics: Human Motion Estimation through Footstep-Induced Floor Vibrations [2.7180946990643466]
  Existing approaches involve monitoring devices such as cameras, wearables, and pressure mats.<n>We leverage gait-induced floor vibration to estimate lower-limb joint motion.<n>Our model poses physical constraints to reduce uncertainty while allowing information sharing between the body and the floor.
  arXiv  Detail & Related papers  (2025-02-21T20:10:15Z)
• Muscles in Time: Learning to Understand Human Motion by Simulating Muscle Activations [64.98299559470503]
  Muscles in Time (MinT) is a large-scale synthetic muscle activation dataset. It contains over nine hours of simulation data covering 227 subjects and 402 simulated muscle strands. We show results on neural network-based muscle activation estimation from human pose sequences.
  arXiv  Detail & Related papers  (2024-10-31T18:28:53Z)
• Machine Learning-based Estimation of Respiratory Fluctuations in a Healthy Adult Population using BOLD fMRI and Head Motion Parameters [39.96015789655091]
  In many fMRI studies, respiratory signals are often missing or of poor quality. It could be highly beneficial to have a tool to extract respiratory variation (RV) waveforms directly from fMRI data without the need for peripheral recording devices. This study proposes a CNN model for reconstruction of RV waveforms using head motion parameters and BOLD signals.
  arXiv  Detail & Related papers  (2024-04-30T21:53:11Z)
• Advancements in Upper Body Exoskeleton: Implementing Active Gravity Compensation with a Feedforward Controller [0.0]
  We present a feedforward control system designed for active gravity compensation on an upper body exoskeleton. The system utilizes only positional data from internal motor sensors to calculate torque, employing analytical control equations based on Newton-Euler Inverse Dynamics.
  arXiv  Detail & Related papers  (2023-09-09T06:39:38Z)
• Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses [78.120734120667]
  We introduce a novel method, based on a long short-term memory (LSTM) network, to continuously map forearm EMG activity onto hand kinematics. Ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset. Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.
  arXiv  Detail & Related papers  (2021-04-29T00:11:32Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching [76.4844593082362]
  We investigate the reason why existing end-to-end networks perform poorly in challenging conditions and establish a strong baseline for remote HR measurement with architecture search (NAS) Comprehensive experiments are performed on three benchmark datasets on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2020-04-26T05:43:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.