Neurophysiologically Realistic Environment for Comparing Adaptive Deep Brain Stimulation Algorithms in Parkinson Disease

• URL: http://arxiv.org/abs/2505.09624v1
• Date: Sat, 26 Apr 2025 09:44:44 GMT
• Title: Neurophysiologically Realistic Environment for Comparing Adaptive Deep Brain Stimulation Algorithms in Parkinson Disease
• Authors: Ekaterina Kuzmina, Dmitrii Kriukov, Mikhail Lebedev, Dmitry V. Dylov,
• Abstract summary: In aDBS, a surgically placed electrode sends dynamically altered stimuli to the brain based on neurophysiological feedback.<n>We introduce the first neurophysiologically realistic benchmark for comparing said models.<n>We purposely built our framework as a structured environment for training and evaluating deep reinforcement learning (RL) algorithms.
• Score: 1.45543311565555
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Adaptive deep brain stimulation (aDBS) has emerged as a promising treatment for Parkinson disease (PD). In aDBS, a surgically placed electrode sends dynamically altered stimuli to the brain based on neurophysiological feedback: an invasive gadget that limits the amount of data one could collect for optimizing the control offline. As a consequence, a plethora of synthetic models of PD and those of the control algorithms have been proposed. Herein, we introduce the first neurophysiologically realistic benchmark for comparing said models. Specifically, our methodology covers not only conventional basal ganglia circuit dynamics and pathological oscillations, but also captures 15 previously dismissed physiological attributes, such as signal instabilities and noise, neural drift, electrode conductance changes and individual variability - all modeled as spatially distributed and temporally registered features via beta-band activity in the brain and a feedback. Furthermore, we purposely built our framework as a structured environment for training and evaluating deep reinforcement learning (RL) algorithms, opening new possibilities for optimizing aDBS control strategies and inviting the machine learning community to contribute to the emerging field of intelligent neurostimulation interfaces.

Related papers

• Sample-Efficient Reinforcement Learning Controller for Deep Brain Stimulation in Parkinson's Disease [6.443133356814665]
  We propose SEA-DBS, a sample-efficient actor-critic framework for RL-based adaptive neurostimulation.<n>SEA-DBS integrates a predictive reward model to reduce reliance on real-time feedback and employs Gumbel Softmax-based exploration for stable, differentiable policy updates.<n>Our results show that SEA-DBS offers a practical and effective RL-based aDBS framework for real-time, resource-constrained neuromodulation.
  arXiv  Detail & Related papers  (2025-07-08T18:30:26Z)
• NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models [68.89389652724378]
  NOBLE is a neural operator framework that learns a mapping from a continuous frequency-modulated embedding of interpretable neuron features to the somatic voltage response induced by current injection.<n>It predicts distributions of neural dynamics accounting for the intrinsic experimental variability.<n>NOBLE is the first scaled-up deep learning framework validated on real experimental data.
  arXiv  Detail & Related papers  (2025-06-05T01:01:18Z)
• Deep Learning Model Predictive Control for Deep Brain Stimulation in Parkinson's Disease [0.552480439325792]
  We present a data-driven computation algorithm for DBS for the treatment of Parkinson's disease (PD)<n>In tests using a simulated model of beta-band activity response, we achieve more than 20% in both tracking error and control activity.<n>The proposed control strategy provides a generalizable data-driven technique that can be applied to the treatment of PD and other diseases targeted by CLDBS.
  arXiv  Detail & Related papers  (2025-04-01T10:16:49Z)
• Spatiotemporal Learning of Brain Dynamics from fMRI Using Frequency-Specific Multi-Band Attention for Cognitive and Psychiatric Applications [5.199807441687141]
  We introduce Multi-Band Brain Net (MBBN), a transformer-based framework that models frequency-specific brain dynamics from fMRI.<n>Trained on three large-scale neuroimaging cohorts totaling 45,951 individuals, MBBN reveals previously undetectable frequency-dependent network interactions.<n>MBBN up to 30.59% higher predictive accuracy than state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-30T10:56:50Z)
• Contrastive Learning in Memristor-based Neuromorphic Systems [55.11642177631929]
  Spiking neural networks have become an important family of neuron-based models that sidestep many of the key limitations facing modern-day backpropagation-trained deep networks. In this work, we design and investigate a proof-of-concept instantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic form of forward-forward-based, backpropagation-free learning.
  arXiv  Detail & Related papers  (2024-09-17T04:48:45Z)
• Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
  In this study, we first construct the brain-effective network via the dynamic causal model. We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE) This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
  arXiv  Detail & Related papers  (2024-05-21T20:37:07Z)
• The Neuron as a Direct Data-Driven Controller [43.8450722109081]
  This study extends the current normative models, which primarily optimize prediction, by conceptualizing neurons as optimal feedback controllers. We model neurons as biologically feasible controllers which implicitly identify loop dynamics, infer latent states and optimize control. Our model presents a significant departure from the traditional, feedforward, instant-response McCulloch-Pitts-Rosenblatt neuron, offering a novel and biologically-informed fundamental unit for constructing neural networks.
  arXiv  Detail & Related papers  (2024-01-03T01:24:10Z)
• Learning Control Policies of Hodgkin-Huxley Neuronal Dynamics [1.629803445577911]
  We approximate the value function offline using a neural network to enable generating controls (stimuli) in real time via the feedback form. Our numerical experiments illustrate the accuracy of our approach for out-of-distribution samples and the robustness to moderate shocks and disturbances in the system.
  arXiv  Detail & Related papers  (2023-11-13T18:53:50Z)
• Personalized identification, prediction, and stimulation of neural oscillations via data-driven models of epileptic network dynamics [0.0]
  We develop a framework to extract predictive models of epileptic network dynamics directly from EEG data. We show that it is possible to build a direct correspondence between the models of brain-network dynamics under periodic driving. This suggests that periodic brain stimulation can drive pathological states of epileptic network dynamics towards a healthy functional brain state.
  arXiv  Detail & Related papers  (2023-10-20T13:21:31Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• Continuous Learning and Adaptation with Membrane Potential and Activation Threshold Homeostasis [91.3755431537592]
  This paper presents the Membrane Potential and Activation Threshold Homeostasis (MPATH) neuron model. The model allows neurons to maintain a form of dynamic equilibrium by automatically regulating their activity when presented with input. Experiments demonstrate the model's ability to adapt to and continually learn from its input.
  arXiv  Detail & Related papers  (2021-04-22T04:01:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.