In-Vivo Training for Deep Brain Stimulation

• URL: http://arxiv.org/abs/2510.03643v1
• Date: Sat, 04 Oct 2025 03:14:34 GMT
• Title: In-Vivo Training for Deep Brain Stimulation
• Authors: Nicholas Carter, Arkaprava Gupta, Prateek Ganguli, Benedikt Dietrich, Vibhor Krishna, Samarjit Chakraborty,
• Abstract summary: Deep Brain Stimulation (DBS) is a highly effective treatment for Parkinson's Disease (PD)<n>Recent research uses reinforcement learning (RL) for DBS, with RL agents modulating the stimulation frequency and amplitude.<n>We present an RL-based DBS approach that adapts these stimulation parameters according to brain activity measurable in vivo.
• Score: 0.9543943371833464
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep Brain Stimulation (DBS) is a highly effective treatment for Parkinson's Disease (PD). Recent research uses reinforcement learning (RL) for DBS, with RL agents modulating the stimulation frequency and amplitude. But, these models rely on biomarkers that are not measurable in patients and are only present in brain-on-chip (BoC) simulations. In this work, we present an RL-based DBS approach that adapts these stimulation parameters according to brain activity measurable in vivo. Using a TD3 based RL agent trained on a model of the basal ganglia region of the brain, we see a greater suppression of biomarkers correlated with PD severity compared to modern clinical DBS implementations. Our agent outperforms the standard clinical approaches in suppressing PD biomarkers while relying on information that can be measured in a real world environment, thereby opening up the possibility of training personalized RL agents specific to individual patient needs.

Related papers

• Resource-Conscious RL Algorithms for Deep Brain Stimulation [1.1242503819703258]
  Deep Brain Stimulation (DBS) has proven to be a promising treatment of Parkinson's Disease (PD)<n>DBS involves stimulating specific regions of the brain's Basal Ganglia (BG) using electric impulses to alleviate symptoms of PD such as tremors, rigidity, and bradykinesia.<n>Most clinical DBS approaches today use a fixed frequency and amplitude, they suffer from side effects (such as slurring of speech) and shortened battery life of the implant.<n>We propose a new Time & Threshold-Triggered Multi-Armed Bandit (T3P MAB) RL approach for DBS that is more effective than
  arXiv  Detail & Related papers  (2026-01-19T03:45:08Z)
• AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applications [52.91583053243446]
  Non-invasive Brain-Computer Interfaces (BCI) offer a safe and accessible means of connecting the human brain to external devices.<n>Recently, the adoption of self-supervised pre-training is transforming the landscape of non-invasive BCI research.<n>AdaBrain-Bench is a standardized benchmark to evaluate brain foundation models in widespread non-invasive BCI tasks.
  arXiv  Detail & Related papers  (2025-07-14T03:37:41Z)
• Sample-Efficient Reinforcement Learning Controller for Deep Brain Stimulation in Parkinson's Disease [6.443133356814665]
  We propose SEA-DBS, a sample-efficient actor-critic framework for RL-based adaptive neurostimulation.<n>SEA-DBS integrates a predictive reward model to reduce reliance on real-time feedback and employs Gumbel Softmax-based exploration for stable, differentiable policy updates.<n>Our results show that SEA-DBS offers a practical and effective RL-based aDBS framework for real-time, resource-constrained neuromodulation.
  arXiv  Detail & Related papers  (2025-07-08T18:30:26Z)
• Neurophysiologically Realistic Environment for Comparing Adaptive Deep Brain Stimulation Algorithms in Parkinson Disease [1.45543311565555]
  In aDBS, a surgically placed electrode sends dynamically altered stimuli to the brain based on neurophysiological feedback.<n>We introduce the first neurophysiologically realistic benchmark for comparing said models.<n>We purposely built our framework as a structured environment for training and evaluating deep reinforcement learning (RL) algorithms.
  arXiv  Detail & Related papers  (2025-04-26T09:44:44Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [53.2981100111204]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring.<n>Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors.<n>In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type.<n>Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Diffusion Boosted Trees [56.46631445688882]
  Diffusion Boosted Trees (DBT) can be viewed as both a new denoising diffusion generative model parameterized by decision trees. DBT combines the weak into a strong gradient of conditional distributions without making explicit assumptions on their density forms.
  arXiv  Detail & Related papers  (2024-06-03T22:11:38Z)
• {\epsilon}-Neural Thompson Sampling of Deep Brain Stimulation for Parkinson Disease Treatment [15.303196613362099]
  We propose a contextual multi-armed bandits (CMAB) solution for a Deep Brain Stimulation (DBS) device. We define the context as the signals capturing irregular neuronal firing activities in the basal ganglia (BG) regions. An epsilon-exploring strategy is introduced on top of the classic Thompson sampling method, leading to an algorithm called epsilon-NeuralTS.
  arXiv  Detail & Related papers  (2024-03-11T15:33:40Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• Offline Learning of Closed-Loop Deep Brain Stimulation Controllers for Parkinson Disease Treatment [6.576864734526406]
  Deep brain stimulation (DBS) has shown great promise toward treating motor symptoms caused by Parkinson's disease (PD) DBS devices approved by the U.S. Food and Drug Administration (FDA) can only deliver continuous DBS (cDBS) stimuli at a fixed amplitude. This energy inefficient operation reduces battery lifetime of the device, cannot adapt treatment dynamically for activity, and may cause significant side-effects.
  arXiv  Detail & Related papers  (2023-02-05T20:29:53Z)
• Pain level and pain-related behaviour classification using GRU-based sparsely-connected RNNs [61.080598804629375]
  People with chronic pain unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities. We proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour.
  arXiv  Detail & Related papers  (2022-12-20T12:56:28Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.