NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity

• URL: http://arxiv.org/abs/2607.02317v1
• Date: Thu, 02 Jul 2026 15:27:39 GMT
• Title: NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity
• Abstract summary: We introduce a novel neural-guided video synthesis framework that generates stimuli optimized for target brain regions across visual cortex.<n>Our method performs evolutionary search over a structured prompt space, guided by a dynamic encoding model that predicts voxel-level responses to video inputs.
• Score: 14.183961200413435
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The human brain processes dynamic visual input through hierarchically organized, functionally specialized regions. While recent in silico brain encoding models can synthesize optimal stimuli to probe selectivity in different brain regions, prior work has been largely limited to static images, leaving dynamic visual processing underexplored. We introduce a novel neural-guided video synthesis framework that generates stimuli optimized for target brain regions across visual cortex. Our method performs evolutionary search over a structured prompt space, guided by a dynamic encoding model that predicts voxel-level responses to video inputs. By maximizing predicted activity for a target ROI, the framework efficiently discovers hyper-activating dynamic stimuli that consistently surpass handcrafted localizer videos. The synthesized videos recover known selectivities across ventral, dorsal, and lateral pathways, and further reveal systematic differences in sensitivity to temporal dynamics. A searchlight analysis provides new insight into the progression toward increasingly complex social-dynamic features along the lateral stream, further supported by probing with synthesized abstract, non-naturalistic stimuli. Taken together, our framework enables in silico exploration of dynamic visual selectivity, with new predictions for in vivo experiments

Related papers

• NeuroVolve: Evolving Visual Stimuli toward Programmable Neural Objectives [4.586830141349792]
  NeuroVolve is a generative framework that provides brain-guided image synthesis.<n>We show that NeuroVolve can generate both low-level and semantic feature-specific stimuli for single ROIs.
  arXiv  Detail & Related papers  (2025-11-29T16:57:59Z)
• SynBrain: Enhancing Visual-to-fMRI Synthesis via Probabilistic Representation Learning [54.390403684665834]
  Deciphering how visual stimuli are transformed into cortical responses is a fundamental challenge in computational neuroscience.<n>We propose SynBrain, a generative framework that simulates the transformation from visual semantics to neural responses in a probabilistic and biologically interpretable manner.<n> Experimental results demonstrate that SynBrain surpasses state-of-the-art methods in subject-specific visual-to-fMRI encoding performance.
  arXiv  Detail & Related papers  (2025-08-14T03:01:05Z)
• Visualizing and Controlling Cortical Responses Using Voxel-Weighted Activation Maximization [0.0]
  Deep neural networks (DNNs) are trained on visual representations that resemble those in the human visual system.<n>We show that activation can be applied to DNN-based encoding models.<n>We generate images optimized for predicted responses in individual voxels.
  arXiv  Detail & Related papers  (2025-06-04T18:48:08Z)
• Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field [85.12359852781216]
  This survey presents a systematic analysis of over 200 papers focused on dynamic scene representation using radiance field.<n>We organize diverse methodological approaches under a unified representational framework, concluding with a critical examination of persistent challenges and promising research directions.
  arXiv  Detail & Related papers  (2025-05-15T07:51:08Z)
• Brain-like Functional Organization within Large Language Models [58.93629121400745]
  The human brain has long inspired the pursuit of artificial intelligence (AI) Recent neuroimaging studies provide compelling evidence of alignment between the computational representation of artificial neural networks (ANNs) and the neural responses of the human brain to stimuli. In this study, we bridge this gap by directly coupling sub-groups of artificial neurons with functional brain networks (FBNs) This framework links the AN sub-groups to FBNs, enabling the delineation of brain-like functional organization within large language models (LLMs)
  arXiv  Detail & Related papers  (2024-10-25T13:15:17Z)
• Time-Evolving Dynamical System for Learning Latent Representations of Mouse Visual Neural Activity [35.763262404864996]
  Time-Evolving Visual Dynamical System (TE-ViDS) is a sequential latent variable model.<n>It decomposes neural activity into low-dimensional latent representations that evolve over time.<n>Experiments show TE-ViDS achieves the best decoding performance on naturalistic scenes/movies.
  arXiv  Detail & Related papers  (2024-08-15T03:27:23Z)
• Reanimating Images using Neural Representations of Dynamic Stimuli [36.04425924379253]
  BrainNRDS (Brain-Neural Representations of Dynamic Stimuli) advances our understanding of how the brain represents spatial and temporal information in dynamic visual scenes.<n>We utilize fMRI brain activity for a deeper understanding of human responses to dynamic visual stimuli.<n>Our findings demonstrate the potential of combining brain imaging with video diffusion models for developing more robust and biologically-inspired computer vision systems.
  arXiv  Detail & Related papers  (2024-06-04T17:59:49Z)
• A spatiotemporal style transfer algorithm for dynamic visual stimulus generation [0.0]
  We introduce the Spatiotemporal Style Transfer (STST) algorithm, a dynamic visual stimulus generation framework. It is based on a two-stream deep neural network model that factorizes spatial and temporal features to generate dynamic visual stimuli. We show that our algorithm enables the generation of model metamers, dynamic stimuli whose layer activations are matched to those of natural videos.
  arXiv  Detail & Related papers  (2024-03-07T23:07:46Z)
• Diffusion Priors for Dynamic View Synthesis from Monocular Videos [59.42406064983643]
  Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. We first finetune a pretrained RGB-D diffusion model on the video frames using a customization technique. We distill the knowledge from the finetuned model to a 4D representations encompassing both dynamic and static Neural Radiance Fields.
  arXiv  Detail & Related papers  (2024-01-10T23:26:41Z)
• On the Trade-off Between Efficiency and Precision of Neural Abstraction [62.046646433536104]
  Neural abstractions have been recently introduced as formal approximations of complex, nonlinear dynamical models. We employ formal inductive synthesis procedures to generate neural abstractions that result in dynamical models with these semantics.
  arXiv  Detail & Related papers  (2023-07-28T13:22:32Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)
• Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes [70.76742458931935]
  We introduce a new representation that models the dynamic scene as a time-variant continuous function of appearance, geometry, and 3D scene motion. Our representation is optimized through a neural network to fit the observed input views. We show that our representation can be used for complex dynamic scenes, including thin structures, view-dependent effects, and natural degrees of motion.
  arXiv  Detail & Related papers  (2020-11-26T01:23:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.