Model-Guided Microstimulation Steers Primate Visual Behavior

• URL: http://arxiv.org/abs/2510.03684v1
• Date: Sat, 04 Oct 2025 05:54:18 GMT
• Title: Model-Guided Microstimulation Steers Primate Visual Behavior
• Abstract summary: Initial visual prosthetics apply electric microstimulation to early visual cortex which can evoke percepts of simple symbols such as letters.<n>We introduce a computational framework to causally model and guide stimulation of high-level cortex.<n>Applying this framework in two macaque monkeys, model-predicted stimulation experiments produced significant in-vivo changes in perceptual choices.
• Score: 4.226816735935618
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Brain stimulation is a powerful tool for understanding cortical function and holds promise for therapeutic interventions in neuropsychiatric disorders. Initial visual prosthetics apply electric microstimulation to early visual cortex which can evoke percepts of simple symbols such as letters. However, these approaches are fundamentally limited by hardware constraints and the low-level representational properties of this cortical region. In contrast, higher-level visual areas encode more complex object representations and therefore constitute a promising target for stimulation - but determining representational targets that reliably evoke object-level percepts constitutes a major challenge. We here introduce a computational framework to causally model and guide stimulation of high-level cortex, comprising three key components: (1) a perturbation module that translates microstimulation parameters into spatial changes to neural activity, (2) topographic models that capture the spatial organization of cortical neurons and thus enable prototyping of stimulation experiments, and (3) a mapping procedure that links model-optimized stimulation sites back to primate cortex. Applying this framework in two macaque monkeys performing a visual recognition task, model-predicted stimulation experiments produced significant in-vivo changes in perceptual choices. Per-site model predictions and monkey behavior were strongly correlated, underscoring the promise of model-guided stimulation. Image generation further revealed a qualitative similarity between in-silico stimulation of face-selective sites and a patient's report of facephenes. This proof-of-principle establishes a foundation for model-guided microstimulation and points toward next-generation visual prosthetics capable of inducing more complex visual experiences.

Related papers

• Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction [5.732406989501624]
  We propose CHASMBrain, a novel hierarchical two-stage framework for image-to-fMRI encoding.<n>Our architecture leverages a dual-stream Mamba design to explicitly separate and process global semantic tokens and local spatial patches.<n>Our method achieves a Pearson correlation of 0.429 and an MSE of 0.261, outperforming all evaluated baselines.
  arXiv  Detail & Related papers  (2026-06-03T11:53:23Z)
• ViBE: Visual-to-M/EEG Brain Encoding via Spatio-Temporal VAE and Distribution-Aligned Projection [36.96202443284929]
  ViBE is a novel encoding framework for generating magnetoencephalography (MEG) and electroencephalography (EEG) signals from visual stimuli.<n>We propose a convolutional variational autoencoder (TS-CVAE) that captures thetemporal characteristics of M/EEG signals for effective neural response reconstruction.
  arXiv  Detail & Related papers  (2026-04-29T01:53:46Z)
• Moving Beyond Diffusion: Hierarchy-to-Hierarchy Autoregression for fMRI-to-Image Reconstruction [65.67001243986981]
  We propose MindHier, a coarse-to-fine fMRI-to-image reconstruction framework built on scale-wise autoregressive modeling.<n>MindHier achieves superior semantic fidelity, 4.67x faster inference, and more deterministic results than the diffusion-based baselines.
  arXiv  Detail & Related papers  (2025-10-25T15:40:07Z)
• Rest2Visual: Predicting Visually Evoked fMRI from Resting-State Scans [30.743554598059692]
  We introduce Rest2Visual, a conditional generative model that predicts visually evoked fMRI (ve-fMRI) from resting-state input and 2D visual stimuli.<n>Our results provide compelling evidence that individualized spontaneous neural activity can be transformed into stimulus-aligned representations.
  arXiv  Detail & Related papers  (2025-09-17T01:08:03Z)
• Integration of Calcium Imaging Traces via Deep Generative Modeling [0.0]
  We show how to learn single-neuron representations from calcium imaging fluorescence traces without relying on spike inference algorithms.<n>We find that this approach outperforms state-of-the-art models, preserving biological variability while mitigating batch effects.<n>This framework enables robust visualization, clustering, and interpretation of single-neuron dynamics.
  arXiv  Detail & Related papers  (2025-01-24T16:33:52Z)
• Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks [59.38765771221084]
  We present a physiologically inspired speech recognition architecture compatible and scalable with deep learning frameworks. We show end-to-end gradient descent training leads to the emergence of neural oscillations in the central spiking neural network. Our findings highlight the crucial inhibitory role of feedback mechanisms, such as spike frequency adaptation and recurrent connections, in regulating and synchronising neural activity to improve recognition performance.
  arXiv  Detail & Related papers  (2024-04-22T09:40:07Z)
• MindBridge: A Cross-Subject Brain Decoding Framework [60.58552697067837]
  Brain decoding aims to reconstruct stimuli from acquired brain signals. Currently, brain decoding is confined to a per-subject-per-model paradigm. We present MindBridge, that achieves cross-subject brain decoding by employing only one model.
  arXiv  Detail & Related papers  (2024-04-11T15:46:42Z)
• Modelling Human Visual Motion Processing with Trainable Motion Energy Sensing and a Self-attention Network [1.9458156037869137]
  We propose an image-computable model of human motion perception by bridging the gap between biological and computer vision models. This model architecture aims to capture the computations in V1-MT, the core structure for motion perception in the biological visual system. In silico neurophysiology reveals that our model's unit responses are similar to mammalian neural recordings regarding motion pooling and speed tuning.
  arXiv  Detail & Related papers  (2023-05-16T04:16:07Z)
• Adapting Brain-Like Neural Networks for Modeling Cortical Visual Prostheses [68.96380145211093]
  Cortical prostheses are devices implanted in the visual cortex that attempt to restore lost vision by electrically stimulating neurons. Currently, the vision provided by these devices is limited, and accurately predicting the visual percepts resulting from stimulation is an open challenge. We propose to address this challenge by utilizing 'brain-like' convolutional neural networks (CNNs), which have emerged as promising models of the visual system.
  arXiv  Detail & Related papers  (2022-09-27T17:33:19Z)
• The Sensorium competition on predicting large-scale mouse primary visual cortex activity [28.272130531998936]
  We propose the Sensorium benchmark competition to identify state-of-the-art models of the mouse visual system. We collected a large-scale dataset from mouse primary visual cortex containing the responses of more than 28,000 neurons. The benchmark challenge will rank models based on predictive performance for neuronal responses on a held-out test set.
  arXiv  Detail & Related papers  (2022-06-17T10:09:57Z)
• Brain Cortical Functional Gradients Predict Cortical Folding Patterns via Attention Mesh Convolution [51.333918985340425]
  We develop a novel attention mesh convolution model to predict cortical gyro-sulcal segmentation maps on individual brains. Experiments show that the prediction performance via our model outperforms other state-of-the-art models.
  arXiv  Detail & Related papers  (2022-05-21T14:08:53Z)
• Overcoming the Domain Gap in Contrastive Learning of Neural Action Representations [60.47807856873544]
  A fundamental goal in neuroscience is to understand the relationship between neural activity and behavior. We generated a new multimodal dataset consisting of the spontaneous behaviors generated by fruit flies. This dataset and our new set of augmentations promise to accelerate the application of self-supervised learning methods in neuroscience.
  arXiv  Detail & Related papers  (2021-11-29T15:27:51Z)
• Fooling the primate brain with minimal, targeted image manipulation [67.78919304747498]
  We propose an array of methods for creating minimal, targeted image perturbations that lead to changes in both neuronal activity and perception as reflected in behavior. Our work shares the same goal with adversarial attack, namely the manipulation of images with minimal, targeted noise that leads ANN models to misclassify the images.
  arXiv  Detail & Related papers  (2020-11-11T08:30:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.