Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Model

• URL: http://arxiv.org/abs/2606.09770v2
• Date: Tue, 16 Jun 2026 11:22:39 GMT
• Title: Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Model
• Abstract summary: Recent topographic models reproduce aspects of this structure but remain unimodal and spatially constrain each layer separately.<n>We introduce Topo- Omni, a multimodal model in which visual, auditory, and language/cognitive processing share a single contiguous in-silico sheet.
• Score: 5.945410696512368
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Nearby neurons in cortex share similar response profiles, producing systematic spatial organization across sensory and cognitive systems. Recent topographic models reproduce aspects of this structure but remain unimodal and spatially constrain each layer separately, yielding fragmented maps that capture neither the contiguity of cortical processing streams nor their integration across modalities. We introduce Topo-Omni, a topographic multimodal model in which visual, auditory, and language/cognitive processing share a single contiguous in-silico sheet. Built by fine-tuning a pretrained foundation model with a spatial smoothness objective, this architecture develops clusters across modalities that are consistent with human neuroimaging, from sensory to cognitive systems. Driving or suppressing a cluster selectively biases or impairs perception, paralleling human intervention studies. Finally, we use our model to screen for novel clusters in-silico and discover new natural landscape and animal networks which we validate in human data. A single spatial principle thus organizes representations across modalities and processing stages, yielding testable hypotheses about cortical organization.

Related papers

• Cross-Subject Semantic Decoding with Shared-Space Alignment for Generalized Neural Representation Learning [80.18561652862725]
  Generalizing across subjects remains challenging in invasive neural recordings.<n>We propose a cross-subject semantic decoding framework that aligns neural responses to speech perception from multiple subjects into a shared latent space.
  arXiv  Detail & Related papers  (2026-07-03T03:59:16Z)
• Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics [0.0]
  We propose a per-timestep conditioned diffusion transformer for generating realistic fMRI brain dynamics during unseen cognitive tasks.<n>We evaluate across hundreds of held-out task conditions and characterize predictive performance in relation to the training manifold.<n>This is the first generative model of whole-cortex fMRI dynamics for unseen cognitive tasks.
  arXiv  Detail & Related papers  (2026-06-10T09:15:33Z)
• NeuroVolve: Evolving Visual Stimuli toward Programmable Neural Objectives [4.586830141349792]
  NeuroVolve is a generative framework that provides brain-guided image synthesis.<n>We show that NeuroVolve can generate both low-level and semantic feature-specific stimuli for single ROIs.
  arXiv  Detail & Related papers  (2025-11-29T16:57:59Z)
• Uncovering Semantic Selectivity of Latent Groups in Higher Visual Cortex with Mutual Information-Guided Diffusion [19.983291706164923]
  We present MIG-Vis, a method to visualize and validate the visual-semantic attributes encoded in neural latent subspaces.<n>We validate MIG-Vis on multi-session neural spiking datasets from the inferior temporal (IT) cortex of two macaques.
  arXiv  Detail & Related papers  (2025-10-02T16:33:40Z)
• Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective [53.556348738917166]
  Recent advances in agentic AI have led to systems capable of autonomous task execution and language-based reasoning.<n>Human spatial intelligence, rooted in integrated multisensory perception, spatial memory, and cognitive maps, enables flexible, context-aware decision-making in unstructured environments.
  arXiv  Detail & Related papers  (2025-09-11T05:23:22Z)
• Mapping minds not averages: a scalable subject-specific manifold learning framework for neuroimaging data [0.0]
  We introduce a manifold learning framework that can capture subject-specific spatial variations across both structured and temporally unstructured data.<n>We show that the framework scales efficiently to large datasets and generalizes well to new subjects.<n>These findings suggest that our framework can uncover clinically relevant subject-specific brain activity patterns.
  arXiv  Detail & Related papers  (2025-04-30T21:40:54Z)
• The Cooperative Network Architecture: Learning Structured Networks as Representation of Sensory Patterns [3.9848584845601014]
  We introduce the Cooperative Network Architecture (CNA), a model that represents sensory signals using structured, recurrently connected networks of neurons, termed "nets"<n>We demonstrate that net fragments can be learned without supervision and flexibly recombined to encode novel patterns, enabling figure completion and resilience to noise.
  arXiv  Detail & Related papers  (2024-07-08T06:22:10Z)
• Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
  In this study, we first construct the brain-effective network via the dynamic causal model. We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE) This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
  arXiv  Detail & Related papers  (2024-05-21T20:37:07Z)
• DSAM: A Deep Learning Framework for Analyzing Temporal and Spatial Dynamics in Brain Networks [4.041732967881764]
  Most rs-fMRI studies compute a single static functional connectivity matrix across brain regions of interest. These approaches are at risk of oversimplifying brain dynamics and lack proper consideration of the goal at hand. We propose a novel interpretable deep learning framework that learns goal-specific functional connectivity matrix directly from time series.
  arXiv  Detail & Related papers  (2024-05-19T23:35:06Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• Brain Cortical Functional Gradients Predict Cortical Folding Patterns via Attention Mesh Convolution [51.333918985340425]
  We develop a novel attention mesh convolution model to predict cortical gyro-sulcal segmentation maps on individual brains. Experiments show that the prediction performance via our model outperforms other state-of-the-art models.
  arXiv  Detail & Related papers  (2022-05-21T14:08:53Z)
• Data-driven emergence of convolutional structure in neural networks [83.4920717252233]
  We show how fully-connected neural networks solving a discrimination task can learn a convolutional structure directly from their inputs. By carefully designing data models, we show that the emergence of this pattern is triggered by the non-Gaussian, higher-order local structure of the inputs.
  arXiv  Detail & Related papers  (2022-02-01T17:11:13Z)
• Modeling Category-Selective Cortical Regions with Topographic Variational Autoencoders [72.15087604017441]
  Category-selectivity describes the observation that certain spatially localized areas of the cerebral cortex tend to respond robustly and selectively to stimuli from specific limited categories. We leverage the newly introduced Topographic Variational Autoencoder to model of the emergence of such localized category-selectivity in an unsupervised manner. We show preliminary results suggesting that our model yields a nested spatial hierarchy of increasingly abstract categories, analogous to observations from the human ventral temporal cortex.
  arXiv  Detail & Related papers  (2021-10-25T11:37:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.