Finding Culture-Sensitive Neurons in Vision-Language Models

• URL: http://arxiv.org/abs/2510.24942v1
• Date: Tue, 28 Oct 2025 20:14:37 GMT
• Title: Finding Culture-Sensitive Neurons in Vision-Language Models
• Abstract summary: We study the presence of culture-sensitive neurons in vision-language models (VLMs)<n>We identify neurons of culture selectivity and perform causal tests by deactivating the neurons flagged by different identification methods.<n>Our findings shed new light on the internal organization of multimodal representations.
• Score: 20.13200214439683
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite their impressive performance, vision-language models (VLMs) still struggle on culturally situated inputs. To understand how VLMs process culturally grounded information, we study the presence of culture-sensitive neurons, i.e. neurons whose activations show preferential sensitivity to inputs associated with particular cultural contexts. We examine whether such neurons are important for culturally diverse visual question answering and where they are located. Using the CVQA benchmark, we identify neurons of culture selectivity and perform causal tests by deactivating the neurons flagged by different identification methods. Experiments on three VLMs across 25 cultural groups demonstrate the existence of neurons whose ablation disproportionately harms performance on questions about the corresponding cultures, while having minimal effects on others. Moreover, we propose a new margin-based selector - Contrastive Activation Selection (CAS), and show that it outperforms existing probability- and entropy-based methods in identifying culture-sensitive neurons. Finally, our layer-wise analyses reveals that such neurons tend to cluster in certain decoder layers. Overall, our findings shed new light on the internal organization of multimodal representations.

Related papers

• Neuron-Level Analysis of Cultural Understanding in Large Language Models [34.65197313327234]
  Large language models (LLMs) are increasingly deployed worldwide, ensuring their fair and comprehensive cultural understanding.<n>We conduct a neuron-level analysis to identify neurons that drive cultural behavior.<n>We identify both culture-general neurons contributing to cultural understanding regardless of cultures, and culture-specific neurons tied to an individual culture.
  arXiv  Detail & Related papers  (2025-10-09T14:35:00Z)
• Isolating Culture Neurons in Multilingual Large Language Models [4.14360329494344]
  We identify language-specific neurons and extend it to localize and isolate culture-specific neurons.<n>To facilitate our experiments, we introduce MUREL, a curated dataset of 85.2 million tokens spanning six different cultures.<n>Our localization and intervention experiments show that LLMs encode different cultures in distinct neuron populations, predominantly in upper layers.
  arXiv  Detail & Related papers  (2025-08-04T09:41:10Z)
• NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models [63.592664795493725]
  NOBLE is a neural operator framework that learns a mapping from a continuous frequency-modulated embedding of interpretable neuron features to the somatic voltage response induced by current injection.<n>It predicts distributions of neural dynamics accounting for the intrinsic experimental variability.<n>NOBLE is the first scaled-up deep learning framework that validates its generalization with real experimental data.
  arXiv  Detail & Related papers  (2025-06-05T01:01:18Z)
• Understanding Gated Neurons in Transformers from Their Input-Output Functionality [48.91500104957796]
  We look at the cosine similarity between input and output weights of a neuron.<n>We find that enrichment neurons dominate in early-middle layers whereas later layers tend more towards depletion.
  arXiv  Detail & Related papers  (2025-05-23T14:14:17Z)
• Deciphering Functions of Neurons in Vision-Language Models [38.978287253624565]
  This study aims to delve into the internals of vision-language models (VLMs) to interpret the functions of individual neurons.<n>We observe the activations of neurons with respects to the input visual tokens and text tokens, and reveal some interesting findings.<n>We build a framework that automates the explanation of neurons with the assistant of GPT-4o.<n>For visual neurons, we propose an activation simulator to assess the reliability of the explanations for visual neurons.
  arXiv  Detail & Related papers  (2025-02-10T10:00:06Z)
• Neuron Empirical Gradient: Discovering and Quantifying Neurons Global Linear Controllability [14.693407823048478]
  We show that the neuron empirical gradient (NEG) captures how changes in activations affect predictions.<n>We also show that NEG effectively captures language skills across diverse prompts through skill neuron probing.<n>Further analysis highlights the key properties of NEG-based skill representation: efficiency, robustness, flexibility, and interdependency.
  arXiv  Detail & Related papers  (2024-12-24T00:01:24Z)
• Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs [85.0284555835015]
  Large language models (LLMs) have revolutionized the field of natural language processing (NLP)<n>Few studies have attempted to explore the internal workings of LLMs in multilingual settings.<n>We classify neurons into four distinct categories based on their responses to a specific input across different languages.
  arXiv  Detail & Related papers  (2024-06-13T16:04:11Z)
• Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps [75.84770193489639]
  We examine the impact of test loss, training corpus and model architecture on the prediction of functional Magnetic Resonance Imaging timecourses of participants listening to an audiobook. We find that untrained versions of each model already explain significant amount of signal in the brain by capturing similarity in brain responses across identical words. We suggest good practices for future studies aiming at explaining the human language system using neural language models.
  arXiv  Detail & Related papers  (2022-07-07T15:37:17Z)
• Discovering Salient Neurons in Deep NLP Models [31.18937787704794]
  We present a technique called as Linguistic Correlation Analysis to extract salient neurons in the model. Our data-driven, quantitative analysis illuminates interesting findings. Our code is publicly available as part of the NeuroX toolkit.
  arXiv  Detail & Related papers  (2022-06-27T13:31:49Z)
• Overcoming the Domain Gap in Contrastive Learning of Neural Action Representations [60.47807856873544]
  A fundamental goal in neuroscience is to understand the relationship between neural activity and behavior. We generated a new multimodal dataset consisting of the spontaneous behaviors generated by fruit flies. This dataset and our new set of augmentations promise to accelerate the application of self-supervised learning methods in neuroscience.
  arXiv  Detail & Related papers  (2021-11-29T15:27:51Z)
• Compositional Explanations of Neurons [52.71742655312625]
  We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts. We use this procedure to answer several questions on interpretability in models for vision and natural language processing.
  arXiv  Detail & Related papers  (2020-06-24T20:37:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.