A Multi-Resolution Physics-Informed Recurrent Neural Network: Formulation and Application to Musculoskeletal Systems

• URL: http://arxiv.org/abs/2305.16593v1
• Date: Fri, 26 May 2023 02:51:39 GMT
• Title: A Multi-Resolution Physics-Informed Recurrent Neural Network: Formulation and Application to Musculoskeletal Systems
• Authors: Karan Taneja, Xiaolong He, Qizhi He and J. S. Chen
• Abstract summary: This work presents a physics-informed recurrent neural network (MR PI-RNN) for simultaneous prediction of musculoskeletal (MSK) motion. The proposed method utilizes the fast wavelet transform to decompose the mixed frequency input sEMG and output joint motion signals into nested multi-resolution signals. The framework is also capable of identifying muscle parameters that are physiologically consistent with the subject's kinematics data.
• Score: 1.978587235008588
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This work presents a multi-resolution physics-informed recurrent neural network (MR PI-RNN), for simultaneous prediction of musculoskeletal (MSK) motion and parameter identification of the MSK systems. The MSK application was selected as the model problem due to its challenging nature in mapping the high-frequency surface electromyography (sEMG) signals to the low-frequency body joint motion controlled by the MSK and muscle contraction dynamics. The proposed method utilizes the fast wavelet transform to decompose the mixed frequency input sEMG and output joint motion signals into nested multi-resolution signals. The prediction model is subsequently trained on coarser-scale input-output signals using a gated recurrent unit (GRU), and then the trained parameters are transferred to the next level of training with finer-scale signals. These training processes are repeated recursively under a transfer-learning fashion until the full-scale training (i.e., with unfiltered signals) is achieved, while satisfying the underlying dynamic equilibrium. Numerical examples on recorded subject data demonstrate the effectiveness of the proposed framework in generating a physics-informed forward-dynamics surrogate, which yields higher accuracy in motion predictions of elbow flexion-extension of an MSK system compared to the case with single-scale training. The framework is also capable of identifying muscle parameters that are physiologically consistent with the subject's kinematics data.

Related papers

• KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter [49.85369344101118]
  We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea is to model the dynamic radiance field as a dynamic system whose temporally varying states are estimated based on two sources of knowledge: observations and predictions. Our KFD-NeRF demonstrates similar or even superior performance within comparable computational time and state-of-the-art view synthesis performance with thorough training.
  arXiv  Detail & Related papers  (2024-07-18T05:48:24Z)
• Predicting Multi-Joint Kinematics of the Upper Limb from EMG Signals Across Varied Loads with a Physics-Informed Neural Network [0.0]
  The PINN model is constructed by combining a feed-forward Artificial Neural Network (ANN) with a joint torque model. The training dataset for the PINN model comprises EMG and time data collected from four different subjects. The results demonstrated strong correlations of 58% to 83% in joint angle prediction.
  arXiv  Detail & Related papers  (2023-11-28T16:55:11Z)
• The bionic neural network for external simulation of human locomotor system [2.6311880922890842]
  This paper proposes a physics-informed deep learning method based on musculoskeletal (MSK) modeling to predict joint motion and muscle forces. The method can effectively identify subject-specific MSK physiological parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion and muscle forces predictions.
  arXiv  Detail & Related papers  (2023-09-11T23:02:56Z)
• Latent State Models of Training Dynamics [51.88132043461152]
  We train models with different random seeds and compute a variety of metrics throughout training. We then fit a hidden Markov model (HMM) over the resulting sequences of metrics. We use the HMM representation to study phase transitions and identify latent "detour" states that slow down convergence.
  arXiv  Detail & Related papers  (2023-08-18T13:20:08Z)
• A Physics-Informed Low-Shot Learning For sEMG-Based Estimation of Muscle Force and Joint Kinematics [4.878073267556235]
  Muscle force and joint kinematics estimation from surface electromyography (sEMG) are essential for real-time biomechanical analysis. Recent advances in deep neural networks (DNNs) have shown the potential to improve biomechanical analysis in a fully automated and reproducible manner. This paper presents a novel physics-informed low-shot learning method for sEMG-based estimation of muscle force and joint kinematics.
  arXiv  Detail & Related papers  (2023-07-08T23:01:12Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• Contrastive-Signal-Dependent Plasticity: Forward-Forward Learning of Spiking Neural Systems [73.18020682258606]
  We develop a neuro-mimetic architecture, composed of spiking neuronal units, where individual layers of neurons operate in parallel. We propose an event-based generalization of forward-forward learning, which we call contrastive-signal-dependent plasticity (CSDP) Our experimental results on several pattern datasets demonstrate that the CSDP process works well for training a dynamic recurrent spiking network capable of both classification and reconstruction.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• DriPP: Driven Point Processes to Model Stimuli Induced Patterns in M/EEG Signals [62.997667081978825]
  We develop a novel statistical point process model-called driven temporal point processes (DriPP) We derive a fast and principled expectation-maximization (EM) algorithm to estimate the parameters of this model. Results on standard MEG datasets demonstrate that our methodology reveals event-related neural responses.
  arXiv  Detail & Related papers  (2021-12-08T13:07:21Z)
• Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition [67.95996816744251]
  State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Current quantization methods are based on uniform precision and fail to account for the varying performance sensitivity at different parts of LMs to quantization errors. Novel mixed precision neural network LM quantization methods are proposed in this paper.
  arXiv  Detail & Related papers  (2021-11-29T12:24:02Z)
• A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer [4.80427355202687]
  Recently successful examples on learning slow dynamics by LSTM are given with simulation data of low dimensional reaction coordinate. We show that the following three key factors significantly affect the performance of language model learning, namely dimensionality of reaction coordinates, temporal resolution and state partition.
  arXiv  Detail & Related papers  (2021-07-14T09:26:36Z)
• Physics-informed neural networks for myocardial perfusion MRI quantification [3.318100528966778]
  This study introduces physics-informed neural networks (PINNs) as a means to perform myocardial perfusion MR quantification. PINNs can be trained to fit the observed perfusion MR data while respecting the underlying physical conservation laws.
  arXiv  Detail & Related papers  (2020-11-25T16:02:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.