A Survey on Self-Supervised Representation Learning
- URL: http://arxiv.org/abs/2308.11455v1
- Date: Tue, 22 Aug 2023 14:05:37 GMT
- Title: A Survey on Self-Supervised Representation Learning
- Authors: Tobias Uelwer, Jan Robine, Stefan Sylvius Wagner, Marc H\"oftmann,
Eric Upschulte, Sebastian Konietzny, Maike Behrendt, Stefan Harmeling
- Abstract summary: A lot of methods were introduced that allow learning of image representations without supervision.
The quality of these representations is close to supervised learning, while no labeled images are needed.
This survey paper provides a comprehensive review of these methods in a unified notation, points out similarities and differences of these methods, and proposes a taxonomy which sets these methods in relation to each other.
- Score: 2.5442795971328307
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Learning meaningful representations is at the heart of many tasks in the
field of modern machine learning. Recently, a lot of methods were introduced
that allow learning of image representations without supervision. These
representations can then be used in downstream tasks like classification or
object detection. The quality of these representations is close to supervised
learning, while no labeled images are needed. This survey paper provides a
comprehensive review of these methods in a unified notation, points out
similarities and differences of these methods, and proposes a taxonomy which
sets these methods in relation to each other. Furthermore, our survey
summarizes the most-recent experimental results reported in the literature in
form of a meta-study. Our survey is intended as a starting point for
researchers and practitioners who want to dive into the field of representation
learning.
Related papers
- Revisiting Self-supervised Learning of Speech Representation from a
Mutual Information Perspective [68.20531518525273]
We take a closer look into existing self-supervised methods of speech from an information-theoretic perspective.
We use linear probes to estimate the mutual information between the target information and learned representations.
We explore the potential of evaluating representations in a self-supervised fashion, where we estimate the mutual information between different parts of the data without using any labels.
arXiv Detail & Related papers (2024-01-16T21:13:22Z) - A Comprehensive Review of Image Line Segment Detection and Description: Taxonomies, Comparisons, and Challenges [36.888654238348416]
This study comprehensively reviews related studies on detecting and describing two-dimensional image line segments.
The key issues, core ideas, advantages and disadvantages of existing methods, and their potential applications are analyzed.
Some state-of-the-art line segment detection and description algorithms are evaluated without bias, and the evaluation code will be publicly available.
arXiv Detail & Related papers (2023-04-29T13:59:50Z) - Visualizing and Understanding Contrastive Learning [22.553990823550784]
We design visual explanation methods that contribute towards understanding similarity learning tasks from pairs of images.
We also adapt existing metrics, used to evaluate visual explanations of image classification systems, to suit pairs of explanations.
arXiv Detail & Related papers (2022-06-20T13:01:46Z) - An Empirical Investigation of Representation Learning for Imitation [76.48784376425911]
Recent work in vision, reinforcement learning, and NLP has shown that auxiliary representation learning objectives can reduce the need for large amounts of expensive, task-specific data.
We propose a modular framework for constructing representation learning algorithms, then use our framework to evaluate the utility of representation learning for imitation.
arXiv Detail & Related papers (2022-05-16T11:23:42Z) - Empirical Evaluation and Theoretical Analysis for Representation
Learning: A Survey [25.5633960013493]
representation learning enables us to automatically extract generic feature representations from a dataset to solve another machine learning task.
Recently, extracted feature representations by a representation learning algorithm and a simple predictor have exhibited state-of-the-art performance on several machine learning tasks.
arXiv Detail & Related papers (2022-04-18T09:18:47Z) - Do Self-Supervised and Supervised Methods Learn Similar Visual
Representations? [3.1594831736896025]
We compare a constrastive self-supervised algorithm (SimCLR) to supervision for simple image data in a common architecture.
We find that the methods learn similar intermediate representations through dissimilar means, and that the representations diverge rapidly in the final few layers.
Our work particularly highlights the importance of the learned intermediate representations, and raises important questions for auxiliary task design.
arXiv Detail & Related papers (2021-10-01T16:51:29Z) - Co$^2$L: Contrastive Continual Learning [69.46643497220586]
Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks.
We propose a rehearsal-based continual learning algorithm that focuses on continually learning and maintaining transferable representations.
arXiv Detail & Related papers (2021-06-28T06:14:38Z) - Reinforcement Learning with Prototypical Representations [114.35801511501639]
Proto-RL is a self-supervised framework that ties representation learning with exploration through prototypical representations.
These prototypes simultaneously serve as a summarization of the exploratory experience of an agent as well as a basis for representing observations.
This enables state-of-the-art downstream policy learning on a set of difficult continuous control tasks.
arXiv Detail & Related papers (2021-02-22T18:56:34Z) - Recent Progress in Appearance-based Action Recognition [73.6405863243707]
Action recognition is a task to identify various human actions in a video.
Recent appearance-based methods have achieved promising progress towards accurate action recognition.
arXiv Detail & Related papers (2020-11-25T10:18:12Z) - Region Comparison Network for Interpretable Few-shot Image
Classification [97.97902360117368]
Few-shot image classification has been proposed to effectively use only a limited number of labeled examples to train models for new classes.
We propose a metric learning based method named Region Comparison Network (RCN), which is able to reveal how few-shot learning works.
We also present a new way to generalize the interpretability from the level of tasks to categories.
arXiv Detail & Related papers (2020-09-08T07:29:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.