Deep Real-Time Decoding of bimanual grip force from EEG & fNIRS

• URL: http://arxiv.org/abs/2103.05334v1
• Date: Tue, 9 Mar 2021 10:28:05 GMT
• Title: Deep Real-Time Decoding of bimanual grip force from EEG & fNIRS
• Authors: Pablo Ortega, Tong Zhao and Aldo Faisal
• Abstract summary: We show a way to achieve continuous hand force decoding using cortical signals obtained with non-invasive mobile brain imaging. Our results show a way to achieve continuous hand force decoding using cortical signals obtained with non-invasive mobile brain imaging has immediate impact for rehabilitation, restoration and consumer applications.
• Score: 3.0176686218359694
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Non-invasive cortical neural interfaces have only achieved modest performance in cortical decoding of limb movements and their forces, compared to invasive brain-computer interfaces (BCIs). While non-invasive methodologies are safer, cheaper and vastly more accessible technologies, signals suffer from either poor resolution in the space domain (EEG) or the temporal domain (BOLD signal of functional Near Infrared Spectroscopy, fNIRS). The non-invasive BCI decoding of bimanual force generation and the continuous force signal has not been realised before and so we introduce an isometric grip force tracking task to evaluate the decoding. We find that combining EEG and fNIRS using deep neural networks works better than linear models to decode continuous grip force modulations produced by the left and the right hand. Our multi-modal deep learning decoder achieves 55.2 FVAF[%] in force reconstruction and improves the decoding performance by at least 15% over each individual modality. Our results show a way to achieve continuous hand force decoding using cortical signals obtained with non-invasive mobile brain imaging has immediate impact for rehabilitation, restoration and consumer applications.

Related papers

• Hybrid Spiking Neural Networks for Low-Power Intra-Cortical Brain-Machine Interfaces [42.72938925647165]
  Intra-cortical brain-machine interfaces (iBMIs) have the potential to dramatically improve the lives of people with paraplegia. Current iBMIs suffer from scalability and mobility limitations due to bulky hardware and wiring. We are investigating hybrid spiking neural networks for embedded neural decoding in wireless iBMIs.
  arXiv  Detail & Related papers  (2024-09-06T17:48:44Z)
• Efficient and accurate neural field reconstruction using resistive memory [52.68088466453264]
  Traditional signal reconstruction methods on digital computers face both software and hardware challenges. We propose a systematic approach with software-hardware co-optimizations for signal reconstruction from sparse inputs. This work advances the AI-driven signal restoration technology and paves the way for future efficient and robust medical AI and 3D vision applications.
  arXiv  Detail & Related papers  (2024-04-15T09:33:09Z)
• Resistive Memory-based Neural Differential Equation Solver for Score-based Diffusion Model [55.116403765330084]
  Current AIGC methods, such as score-based diffusion, are still deficient in terms of rapidity and efficiency. We propose a time-continuous and analog in-memory neural differential equation solver for score-based diffusion. We experimentally validate our solution with 180 nm resistive memory in-memory computing macros.
  arXiv  Detail & Related papers  (2024-04-08T16:34:35Z)
• NEUROSEC: FPGA-Based Neuromorphic Audio Security [0.0]
  This paper highlights the robustness and precision of our FPGA-based neuromorphic system for audio processing. A standout feature of our framework is its detection rate of 94%, which underscores its greater capability in identifying and mitigating threats within 5.39 dB. Neuromorphic computing and hardware security serve many sensor domains in mission-critical and privacy-preserving applications.
  arXiv  Detail & Related papers  (2024-01-22T15:47:05Z)
• FingerFlex: Inferring Finger Trajectories from ECoG signals [68.8204255655161]
  FingerFlex model is a convolutional encoder-decoder architecture adapted for finger movement regression on electrocorticographic (ECoG) brain data. State-of-the-art performance was achieved on a publicly available BCI competition IV dataset 4 with a correlation coefficient between true and predicted trajectories up to 0.74.
  arXiv  Detail & Related papers  (2022-10-23T16:26:01Z)
• fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships [68.8204255655161]
  We present an interpretable domain grounded solution to recover the activity of several subcortical regions from multichannel EEG data. We recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei.
  arXiv  Detail & Related papers  (2022-10-23T15:11:37Z)
• Deep Metric Learning with Locality Sensitive Angular Loss for Self-Correcting Source Separation of Neural Spiking Signals [77.34726150561087]
  We propose a methodology based on deep metric learning to address the need for automated post-hoc cleaning and robust separation filters. We validate this method with an artificially corrupted label set based on source-separated high-density surface electromyography recordings. This approach enables a neural network to learn to accurately decode neurophysiological time series using any imperfect method of labelling the signal.
  arXiv  Detail & Related papers  (2021-10-13T21:51:56Z)
• Training Deep Spiking Auto-encoders without Bursting or Dying Neurons through Regularization [9.34612743192798]
  Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. We apply end-to-end learning with membrane potential-based backpropagation to a spiking convolutional auto-encoder. We show that applying regularization on membrane potential and spiking output successfully avoids both dead and bursting neurons.
  arXiv  Detail & Related papers  (2021-09-22T21:27:40Z)
• HemCNN: Deep Learning enables decoding of fNIRS cortical signals in hand grip motor tasks [0.0]
  We use a convolutional neural network architecture, the HemCNN, to solve the fNIRS left/right hand force decoding problem. HemCNN learned to detect which hand executed a grasp at a naturalistic hand action speed, outperforming standard methods.
  arXiv  Detail & Related papers  (2021-03-09T10:32:53Z)
• Learning Frequency Domain Approximation for Binary Neural Networks [68.79904499480025]
  We propose to estimate the gradient of sign function in the Fourier frequency domain using the combination of sine functions for training BNNs. The experiments on several benchmark datasets and neural architectures illustrate that the binary network learned using our method achieves the state-of-the-art accuracy.
  arXiv  Detail & Related papers  (2021-03-01T08:25:26Z)
• Continuous Gesture Recognition from sEMG Sensor Data with Recurrent Neural Networks and Adversarial Domain Adaptation [1.7205106391379026]
  We present empirical results on gesture recognition with both mobile and non-mobile wrists. We show that adding domain adaptation techniques to continuous gesture recognition with RNN improves the transfer ability between subjects.
  arXiv  Detail & Related papers  (2020-12-16T09:24:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.