Safe reinforcement learning with online filtering for fatigue-predictive human-robot task planning and allocation in production

• URL: http://arxiv.org/abs/2604.12667v2
• Date: Thu, 16 Apr 2026 08:32:15 GMT
• Title: Safe reinforcement learning with online filtering for fatigue-predictive human-robot task planning and allocation in production
• Abstract summary: This paper addresses the dynamic human-robot task planning and allocation problem.<n>It involves determining when to perform tasks and who should execute them to maximize efficiency.<n>The inclusion of fatigue constraints, combined with production dynamics, significantly increases the complexity of the HRTPA problem.
• Score: 3.8704000484099264
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Human-robot collaborative manufacturing, a core aspect of Industry 5.0, emphasizes ergonomics to enhance worker well-being. This paper addresses the dynamic human-robot task planning and allocation (HRTPA) problem, which involves determining when to perform tasks and who should execute them to maximize efficiency while ensuring workers' physical fatigue remains within safe limits. The inclusion of fatigue constraints, combined with production dynamics, significantly increases the complexity of the HRTPA problem. Traditional fatigue-recovery models in HRTPA often rely on static, predefined hyperparameters. However, in practice, human fatigue sensitivity varies daily due to factors such as changed work conditions and insufficient sleep. To better capture this uncertainty, we treat fatigue-related parameters as inaccurate and estimate them online based on observed fatigue progression during production. To address these challenges, we propose PF-CD3Q, a safe reinforcement learning (safe RL) approach that integrates the particle filter with constrained dueling double deep Q-learning for real-time fatigue-predictive HRTPA. Specifically, we first develop PF-based estimators to track human fatigue and update fatigue model parameters in real-time. These estimators are then integrated into CD3Q by making task-level fatigue predictions during decision-making and excluding tasks that exceed fatigue limits, thereby constraining the action space and formulating the problem as a constrained Markov decision process (CMDP).

Related papers

• Efficient and Robust Spiking Neural Networks for sEMG-Based Muscle Fatigue Detection [6.801129260713164]
  We propose an energy-efficient framework for muscle fatigue detection based on Spiking Neural Networks (SNNs)<n>We introduce a quantization-compatible robustness training scheme (SDH) that combines multiple regularization terms to improve computation under noisy conditions.<n>Results demonstrate the framework's strong potential for real-time deployment in low-power wearable systems.
  arXiv  Detail & Related papers  (2026-07-13T04:05:13Z)
• RoboWits: Unexpected Challenges for Robotic Creative Problem Solving [58.58727722988084]
  We introduce RoboWits, a bi-manual robotic benchmark designed to evaluate cognitive reasoning, creative tool use, and robustness to unexpected conditions.<n>Using the pipeline, we curated 30 diverse seed tasks and 208 tasks with mutations and graded difficulty across geometry, material, and assembly-based reasoning.<n>Our results reveal a significant performance gap: while pre-trained VLAs exhibit preliminary success on seed tasks after single-task fine-tuning, they struggle to perform on mutated tasks.
  arXiv  Detail & Related papers  (2026-05-28T17:57:15Z)
• FatigueFusion: Latent Space Fusion for Fatigue-Driven Motion Synthesis [3.5195917252906272]
  We present FatigueFusion, a deep-learning architecture for the fusion of fatigue features within a latent representation space.<n>Our framework incorporates algorithmic and data-driven modules to impose subject-specific temporal and spatial fatigue features on nonfatigued motions.<n>FatigueFusion offers an end-to-end architecture that operates directly on non-fatigued joint angle sequences and control parameters.
  arXiv  Detail & Related papers  (2026-04-11T13:12:20Z)
• Estimating Human Muscular Fatigue in Dynamic Collaborative Robotic Tasks with Learning-Based Models [0.19249287163937967]
  This work presents a data-driven framework to estimate fatigue in dynamic, cyclic pHRI using arm-mounted surface electromyography(sEMG)<n>Subject-specific machine-learning regression models predict the fraction of cycles to fatigue(FCF) from three frequency-domain and one time-domain EMG features, and are benchmarked against a convolutional neural network(CNN)<n>Overall, the study shows that both feature-based ML and spectrogram-based DL can estimate remaining work capacity during repetitive pHRI, with the CNN delivering the lowest error and the tree-based models close behind.
  arXiv  Detail & Related papers  (2026-02-17T16:08:11Z)
• TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Acceleration [64.32072516882947]
  Diffusion Policy excels in embodied control but suffers from high inference latency and computational cost.<n>We propose Temporal-aware Reinforcement-based Speculative Diffusion Policy (TS-DP)<n>TS-DP achieves up to 4.17 times faster inference with over 94% accepted drafts, reaching an inference frequency of 25 Hz.
  arXiv  Detail & Related papers  (2025-12-13T07:53:14Z)
• Fatigue-PINN: Physics-Informed Fatigue-Driven Motion Modulation and Synthesis [2.0308338182844263]
  Fatigue modeling is essential for motion synthesis tasks to model human motions under fatigued conditions.<n>We present Fatigue-PINN, a deep learning framework based on Physics-Informed Neural Networks.<n>We simulate the fatigue-induced fluctuations in the maximum exerted joint torques by leveraging a PINN adaptation of the Three-Compartment Controller model.
  arXiv  Detail & Related papers  (2025-02-26T11:14:48Z)
• Model Predictive Task Sampling for Efficient and Robust Adaptation [57.414812940406996]
  We introduce Model Predictive Task Sampling (MPTS), a framework that bridges the task space and adaptation risk distributions.<n>MPTS employs a generative model to characterize the episodic optimization process and predicts task-specific adaptation risk via posterior inference.<n>MPTS seamlessly integrates into zero-shot, few-shot, and supervised finetuning settings.
  arXiv  Detail & Related papers  (2025-01-19T13:14:53Z)
• Towards Robust Continual Learning with Bayesian Adaptive Moment Regularization [51.34904967046097]
  Continual learning seeks to overcome the challenge of catastrophic forgetting, where a model forgets previously learnt information. We introduce a novel prior-based method that better constrains parameter growth, reducing catastrophic forgetting. Results show that BAdam achieves state-of-the-art performance for prior-based methods on challenging single-headed class-incremental experiments.
  arXiv  Detail & Related papers  (2023-09-15T17:10:51Z)
• Long Short-term Memory with Two-Compartment Spiking Neuron [64.02161577259426]
  We propose a novel biologically inspired Long Short-Term Memory Leaky Integrate-and-Fire spiking neuron model, dubbed LSTM-LIF. Our experimental results, on a diverse range of temporal classification tasks, demonstrate superior temporal classification capability, rapid training convergence, strong network generalizability, and high energy efficiency of the proposed LSTM-LIF model. This work, therefore, opens up a myriad of opportunities for resolving challenging temporal processing tasks on emerging neuromorphic computing machines.
  arXiv  Detail & Related papers  (2023-07-14T08:51:03Z)
• Vision-based Estimation of Fatigue and Engagement in Cognitive Training Sessions [9.018775341716305]
  We develop and validate a novel Recurrent Video Transformer (RVT) method for monitoring realtime mental fatigue. The RVT model achieved the highest balanced accuracy(78%) and precision (0.82) compared to the state-of-the-art binary models.
  arXiv  Detail & Related papers  (2023-04-24T21:58:14Z)
• Clinical Risk Prediction with Temporal Probabilistic Asymmetric Multi-Task Learning [80.66108902283388]
  Multi-task learning methods should be used with caution for safety-critical applications, such as clinical risk prediction. Existing asymmetric multi-task learning methods tackle this negative transfer problem by performing knowledge transfer from tasks with low loss to tasks with high loss. We propose a novel temporal asymmetric multi-task learning model that performs knowledge transfer from certain tasks/timesteps to relevant uncertain tasks, based on feature-level uncertainty.
  arXiv  Detail & Related papers  (2020-06-23T06:01:36Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.