The Conceptual VAE
- URL: http://arxiv.org/abs/2203.11216v1
- Date: Mon, 21 Mar 2022 17:27:28 GMT
- Title: The Conceptual VAE
- Authors: Razin A. Shaikh, Sara Sabrina Zemljic, Sean Tull and Stephen Clark
- Abstract summary: We present a new model of concepts, based on the framework of variational autoencoders.
The model is inspired by, and closely related to, the Beta-VAE model of concepts.
We show how the model can be used as a concept classifier, and how it can be adapted to learn from fewer labels per instance.
- Score: 7.15767183672057
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this report we present a new model of concepts, based on the framework of
variational autoencoders, which is designed to have attractive properties such
as factored conceptual domains, and at the same time be learnable from data.
The model is inspired by, and closely related to, the Beta-VAE model of
concepts, but is designed to be more closely connected with language, so that
the names of concepts form part of the graphical model. We provide evidence
that our model -- which we call the Conceptual VAE -- is able to learn
interpretable conceptual representations from simple images of coloured shapes
together with the corresponding concept labels. We also show how the model can
be used as a concept classifier, and how it can be adapted to learn from fewer
labels per instance. Finally, we formally relate our model to Gardenfors'
theory of conceptual spaces, showing how the Gaussians we use to represent
concepts can be formalised in terms of "fuzzy concepts" in such a space.
Related papers
- Knowledge graphs for empirical concept retrieval [1.06378109904813]
Concept-based explainable AI is promising as a tool to improve the understanding of complex models at the premises of a given user.
Here, we present a workflow for user-driven data collection in both text and image domains.
We test the retrieved concept datasets on two concept-based explainability methods, namely concept activation vectors (CAVs) and concept activation regions (CARs)
arXiv Detail & Related papers (2024-04-10T13:47:22Z) - An Axiomatic Approach to Model-Agnostic Concept Explanations [67.84000759813435]
We propose an approach to concept explanations that satisfy three natural axioms: linearity, recursivity, and similarity.
We then establish connections with previous concept explanation methods, offering insight into their varying semantic meanings.
arXiv Detail & Related papers (2024-01-12T20:53:35Z) - From Conceptual Spaces to Quantum Concepts: Formalising and Learning
Structured Conceptual Models [3.430966345969155]
We present a new modelling framework for structured concepts using a category-theoretic generalisation of conceptual spaces.
We show how concepts can be learned automatically from data, using two very different instantiations: one classical and one quantum.
arXiv Detail & Related papers (2023-11-06T15:08:22Z) - Concept Gradient: Concept-based Interpretation Without Linear Assumption [77.96338722483226]
Concept Activation Vector (CAV) relies on learning a linear relation between some latent representation of a given model and concepts.
We proposed Concept Gradient (CG), extending concept-based interpretation beyond linear concept functions.
We demonstrated CG outperforms CAV in both toy examples and real world datasets.
arXiv Detail & Related papers (2022-08-31T17:06:46Z) - Analyzing Encoded Concepts in Transformer Language Models [21.76062029833023]
ConceptX analyses how latent concepts are encoded in representations learned within pre-trained language models.
It uses clustering to discover the encoded concepts and explains them by aligning with a large set of human-defined concepts.
arXiv Detail & Related papers (2022-06-27T13:32:10Z) - Automatic Concept Extraction for Concept Bottleneck-based Video
Classification [58.11884357803544]
We present an automatic Concept Discovery and Extraction module that rigorously composes a necessary and sufficient set of concept abstractions for concept-based video classification.
Our method elicits inherent complex concept abstractions in natural language to generalize concept-bottleneck methods to complex tasks.
arXiv Detail & Related papers (2022-06-21T06:22:35Z) - ConceptDistil: Model-Agnostic Distillation of Concept Explanations [4.462334751640166]
Concept-based explanations aims to fill the model interpretability gap for non-technical humans-in-the-loop.
We propose ConceptDistil, a method to bring concept explanations to any black-box classifier using knowledge distillation.
We validate ConceptDistil in a real world use-case, showing that it is able to optimize both tasks.
arXiv Detail & Related papers (2022-05-07T08:58:54Z) - FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic
descriptions, and Conceptual Relations [99.54048050189971]
We present a framework for learning new visual concepts quickly, guided by multiple naturally occurring data streams.
The learned concepts support downstream applications, such as answering questions by reasoning about unseen images.
We demonstrate the effectiveness of our model on both synthetic and real-world datasets.
arXiv Detail & Related papers (2022-03-30T19:45:00Z) - Human-Centered Concept Explanations for Neural Networks [47.71169918421306]
We introduce concept explanations including the class of Concept Activation Vectors (CAV)
We then discuss approaches to automatically extract concepts, and approaches to address some of their caveats.
Finally, we discuss some case studies that showcase the utility of such concept-based explanations in synthetic settings and real world applications.
arXiv Detail & Related papers (2022-02-25T01:27:31Z) - Formalising Concepts as Grounded Abstractions [68.24080871981869]
This report shows how representation learning can be used to induce concepts from raw data.
The main technical goal of this report is to show how techniques from representation learning can be married with a lattice-theoretic formulation of conceptual spaces.
arXiv Detail & Related papers (2021-01-13T15:22:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.