HINT: Hierarchical Neuron Concept Explainer
- URL: http://arxiv.org/abs/2203.14196v1
- Date: Sun, 27 Mar 2022 03:25:36 GMT
- Title: HINT: Hierarchical Neuron Concept Explainer
- Authors: Andong Wang, Wei-Ning Lee, Xiaojuan Qi
- Abstract summary: We study hierarchical concepts inspired by the hierarchical cognition process of human beings.
We propose HIerarchical Neuron concepT explainer (HINT) to effectively build bidirectional associations between neurons and hierarchical concepts.
HINT enables us to systematically and quantitatively study whether and how the implicit hierarchical relationships of concepts are embedded into neurons.
- Score: 35.07575535848492
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: To interpret deep networks, one main approach is to associate neurons with
human-understandable concepts. However, existing methods often ignore the
inherent relationships of different concepts (e.g., dog and cat both belong to
animals), and thus lose the chance to explain neurons responsible for
higher-level concepts (e.g., animal). In this paper, we study hierarchical
concepts inspired by the hierarchical cognition process of human beings. To
this end, we propose HIerarchical Neuron concepT explainer (HINT) to
effectively build bidirectional associations between neurons and hierarchical
concepts in a low-cost and scalable manner. HINT enables us to systematically
and quantitatively study whether and how the implicit hierarchical
relationships of concepts are embedded into neurons, such as identifying
collaborative neurons responsible to one concept and multimodal neurons for
different concepts, at different semantic levels from concrete concepts (e.g.,
dog) to more abstract ones (e.g., animal). Finally, we verify the faithfulness
of the associations using Weakly Supervised Object Localization, and
demonstrate its applicability in various tasks such as discovering saliency
regions and explaining adversarial attacks. Code is available on
https://github.com/AntonotnaWang/HINT.
Related papers
- Artificial Kuramoto Oscillatory Neurons [65.16453738828672]
We introduce Artificial Kuramotoy Neurons (AKOrN) as a dynamical alternative to threshold units.
We show that this idea provides performance improvements across a wide spectrum of tasks.
We believe that these empirical results show the importance of our assumptions at the most basic neuronal level of neural representation.
arXiv Detail & Related papers (2024-10-17T17:47:54Z) - From Neural Activations to Concepts: A Survey on Explaining Concepts in Neural Networks [15.837316393474403]
Concepts can act as a natural link between learning and reasoning.
Knowledge can not only be extracted from neural networks but concept knowledge can also be inserted into neural network architectures.
arXiv Detail & Related papers (2023-10-18T11:08:02Z) - Cones: Concept Neurons in Diffusion Models for Customized Generation [41.212255848052514]
This paper finds a small cluster of neurons in a diffusion model corresponding to a particular subject.
The concept neurons demonstrate magnetic properties in interpreting and manipulating generation results.
For large-scale applications, the concept neurons are environmentally friendly as we only need to store a sparse cluster of int index instead of dense float32 values.
arXiv Detail & Related papers (2023-03-09T09:16:04Z) - Cognitive modelling with multilayer networks: Insights, advancements and
future challenges [0.6067748036747219]
The mental lexicon is a cognitive system representing information about the words/concepts that one knows.
How can semantic, phonological, syntactic, and other types of conceptual associations be mapped within a coherent mathematical framework to study how the mental lexicon works?
Cognitive multilayer networks can map multiple types of information at once, thus capturing how different layers of associations might co-exist within the mental lexicon.
arXiv Detail & Related papers (2022-10-02T12:22:53Z) - NeuroCartography: Scalable Automatic Visual Summarization of Concepts in
Deep Neural Networks [18.62960153659548]
NeuroCartography is an interactive system that summarizes and visualizes concepts learned by neural networks.
It automatically discovers and groups neurons that detect the same concepts.
It describes how such neuron groups interact to form higher-level concepts and the subsequent predictions.
arXiv Detail & Related papers (2021-08-29T22:43:52Z) - HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem
Solving [104.79156980475686]
Humans learn compositional and causal abstraction, ie, knowledge, in response to the structure of naturalistic tasks.
We argue there shall be three levels of generalization in how an agent represents its knowledge: perceptual, conceptual, and algorithmic.
This benchmark is centered around a novel task domain, HALMA, for visual concept development and rapid problem-solving.
arXiv Detail & Related papers (2021-02-22T20:37:01Z) - Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and
Reasoning [78.13740873213223]
Bongard problems (BPs) were introduced as an inspirational challenge for visual cognition in intelligent systems.
We propose a new benchmark Bongard-LOGO for human-level concept learning and reasoning.
arXiv Detail & Related papers (2020-10-02T03:19:46Z) - Compositional Explanations of Neurons [52.71742655312625]
We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts.
We use this procedure to answer several questions on interpretability in models for vision and natural language processing.
arXiv Detail & Related papers (2020-06-24T20:37:05Z) - Towards a Neural Model for Serial Order in Frontal Cortex: a Brain
Theory from Memory Development to Higher-Level Cognition [53.816853325427424]
We propose that the immature prefrontal cortex (PFC) use its primary functionality of detecting hierarchical patterns in temporal signals.
Our hypothesis is that the PFC detects the hierarchical structure in temporal sequences in the form of ordinal patterns and use them to index information hierarchically in different parts of the brain.
By doing so, it gives the tools to the language-ready brain for manipulating abstract knowledge and planning temporally ordered information.
arXiv Detail & Related papers (2020-05-22T14:29:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.