Adaptive Prototypical Networks
- URL: http://arxiv.org/abs/2211.12479v1
- Date: Tue, 22 Nov 2022 18:45:58 GMT
- Title: Adaptive Prototypical Networks
- Authors: Manas Gogoi, Sambhavi Tiwari and Shekhar Verma
- Abstract summary: Prototypical network for Few shot learning tries to learn an embedding function in the encoder that embeds images with similar features close to one another.
We propose an approach that intuitively pushes the embeddings of each of the classes away from the others in the meta-testing phase.
This is achieved by training the encoder network for classification using the support set samples and labels of the new task.
- Score: 2.964978357715084
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Prototypical network for Few shot learning tries to learn an embedding
function in the encoder that embeds images with similar features close to one
another in the embedding space. However, in this process, the support set
samples for a task are embedded independently of one other, and hence, the
inter-class closeness is not taken into account. Thus, in the presence of
similar-looking classes in a task, the embeddings will tend to be close to each
other in the embedding space and even possibly overlap in some regions, which
is not desirable for classification. In this paper, we propose an approach that
intuitively pushes the embeddings of each of the classes away from the others
in the meta-testing phase, thereby grouping them closely based on the distinct
class labels rather than only the similarity of spatial features. This is
achieved by training the encoder network for classification using the support
set samples and labels of the new task. Extensive experiments conducted on
benchmark data sets show improvements in meta-testing accuracy when compared
with Prototypical Networks and also other standard few-shot learning models.
Related papers
- CoNe: Contrast Your Neighbours for Supervised Image Classification [62.12074282211957]
Contrast Your Neighbours (CoNe) is a learning framework for supervised image classification.
CoNe employs the features of its similar neighbors as anchors to generate more adaptive and refined targets.
Our CoNe achieves 80.8% Top-1 accuracy on ImageNet with ResNet-50, which surpasses the recent Timm training recipe.
arXiv Detail & Related papers (2023-08-21T14:49:37Z) - Deep Metric Learning Assisted by Intra-variance in A Semi-supervised
View of Learning [0.0]
Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other.
This paper designs a self-supervised generative assisted ranking framework that provides a semi-supervised view of intra-class variance learning scheme for typical supervised deep metric learning.
arXiv Detail & Related papers (2023-04-21T13:30:32Z) - Episode Adaptive Embedding Networks for Few-shot Learning [4.328767711595871]
We propose emphEpisode Adaptive Embedding Network (EAEN) to learn episode-specific embeddings of instances.
EAEN significantly improves classification accuracy about $10%$ to $20%$ in different settings over the state-of-the-art methods.
arXiv Detail & Related papers (2021-06-17T11:29:33Z) - Conditional Variational Capsule Network for Open Set Recognition [64.18600886936557]
In open set recognition, a classifier has to detect unknown classes that are not known at training time.
Recently proposed Capsule Networks have shown to outperform alternatives in many fields, particularly in image recognition.
In our proposal, during training, capsules features of the same known class are encouraged to match a pre-defined gaussian, one for each class.
arXiv Detail & Related papers (2021-04-19T09:39:30Z) - Adaptive Prototypical Networks with Label Words and Joint Representation
Learning for Few-Shot Relation Classification [17.237331828747006]
This work focuses on few-shot relation classification (FSRC)
We propose an adaptive mixture mechanism to add label words to the representation of the class prototype.
Experiments have been conducted on FewRel under different few-shot (FS) settings.
arXiv Detail & Related papers (2021-01-10T11:25:42Z) - Dynamic Semantic Matching and Aggregation Network for Few-shot Intent
Detection [69.2370349274216]
Few-shot Intent Detection is challenging due to the scarcity of available annotated utterances.
Semantic components are distilled from utterances via multi-head self-attention.
Our method provides a comprehensive matching measure to enhance representations of both labeled and unlabeled instances.
arXiv Detail & Related papers (2020-10-06T05:16:38Z) - CSI: Novelty Detection via Contrastive Learning on Distributionally
Shifted Instances [77.28192419848901]
We propose a simple, yet effective method named contrasting shifted instances (CSI)
In addition to contrasting a given sample with other instances as in conventional contrastive learning methods, our training scheme contrasts the sample with distributionally-shifted augmentations of itself.
Our experiments demonstrate the superiority of our method under various novelty detection scenarios.
arXiv Detail & Related papers (2020-07-16T08:32:56Z) - Towards Cross-Granularity Few-Shot Learning: Coarse-to-Fine
Pseudo-Labeling with Visual-Semantic Meta-Embedding [13.063136901934865]
Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time.
In this paper, we advance the few-shot classification paradigm towards a more challenging scenario, i.e., cross-granularity few-shot classification.
We approximate the fine-grained data distribution by greedy clustering of each coarse-class into pseudo-fine-classes according to the similarity of image embeddings.
arXiv Detail & Related papers (2020-07-11T03:44:21Z) - ReMarNet: Conjoint Relation and Margin Learning for Small-Sample Image
Classification [49.87503122462432]
We introduce a novel neural network termed Relation-and-Margin learning Network (ReMarNet)
Our method assembles two networks of different backbones so as to learn the features that can perform excellently in both of the aforementioned two classification mechanisms.
Experiments on four image datasets demonstrate that our approach is effective in learning discriminative features from a small set of labeled samples.
arXiv Detail & Related papers (2020-06-27T13:50:20Z) - UniT: Unified Knowledge Transfer for Any-shot Object Detection and
Segmentation [52.487469544343305]
Methods for object detection and segmentation rely on large scale instance-level annotations for training.
We propose an intuitive and unified semi-supervised model that is applicable to a range of supervision.
arXiv Detail & Related papers (2020-06-12T22:45:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.