SENet: A Spectral Filtering Approach to Represent Exemplars for Few-shot Learning

• URL: http://arxiv.org/abs/2305.18970v2
• Date: Thu, 22 Feb 2024 14:26:31 GMT
• Title: SENet: A Spectral Filtering Approach to Represent Exemplars for Few-shot Learning
• Authors: Tao Zhang and Wu Huang
• Abstract summary: We propose Shrinkage Exemplar Networks (SENet) for few-shot classification. In SENet, categories are represented by the embedding of samples that shrink towards their mean via spectral filtering. A shrinkage exemplar loss is proposed to replace the widely used cross entropy loss for capturing the information of individual shrinkage samples.
• Score: 5.601374466082551
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Prototype is widely used to represent internal structure of category for few-shot learning, which was proposed as a simple inductive bias to address the issue of overfitting. However, since prototype representation is normally averaged from individual samples, it can appropriately to represent some classes but with underfitting to represent some others that can be batter represented by exemplars. To address this problem, in this work, we propose Shrinkage Exemplar Networks (SENet) for few-shot classification. In SENet, categories are represented by the embedding of samples that shrink towards their mean via spectral filtering. Furthermore, a shrinkage exemplar loss is proposed to replace the widely used cross entropy loss for capturing the information of individual shrinkage samples. Several experiments were conducted on miniImageNet, tiered-ImageNet and CIFAR-FS datasets. The experimental results demonstrate the effectiveness of our proposed method.

Related papers

• Dual-View Data Hallucination with Semantic Relation Guidance for Few-Shot Image Recognition [49.26065739704278]
  We propose a framework that exploits semantic relations to guide dual-view data hallucination for few-shot image recognition. An instance-view data hallucination module hallucinates each sample of a novel class to generate new data. A prototype-view data hallucination module exploits semantic-aware measure to estimate the prototype of a novel class.
  arXiv  Detail & Related papers  (2024-01-13T12:32:29Z)
• Reflection Invariance Learning for Few-shot Semantic Segmentation [53.20466630330429]
  Few-shot semantic segmentation (FSS) aims to segment objects of unseen classes in query images with only a few annotated support images. This paper proposes a fresh few-shot segmentation framework to mine the reflection invariance in a multi-view matching manner. Experiments on both PASCAL-$5textiti$ and COCO-$20textiti$ datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-01T15:14:58Z)
• Not All Instances Contribute Equally: Instance-adaptive Class Representation Learning for Few-Shot Visual Recognition [94.04041301504567]
  Few-shot visual recognition refers to recognize novel visual concepts from a few labeled instances. We propose a novel metric-based meta-learning framework termed instance-adaptive class representation learning network (ICRL-Net) for few-shot visual recognition.
  arXiv  Detail & Related papers  (2022-09-07T10:00:18Z)
• Fine-grained Retrieval Prompt Tuning [149.9071858259279]
  Fine-grained Retrieval Prompt Tuning steers a frozen pre-trained model to perform the fine-grained retrieval task from the perspectives of sample prompt and feature adaptation. Our FRPT with fewer learnable parameters achieves the state-of-the-art performance on three widely-used fine-grained datasets.
  arXiv  Detail & Related papers  (2022-07-29T04:10:04Z)
• Kernel Relative-prototype Spectral Filtering for Few-shot Learning [3.2091741098687696]
  Few-shot learning performs classification tasks and regression tasks on scarce samples. In this paper, we propose a framework of spectral filtering (shrinkage) for measuring the difference between query samples and prototypes.
  arXiv  Detail & Related papers  (2022-07-24T07:53:27Z)
• Generating Representative Samples for Few-Shot Classification [8.62483598990205]
  Few-shot learning aims to learn new categories with a few visual samples per class. Few-shot class representations are often biased due to data scarcity. We generate visual samples based on semantic embeddings using a conditional variational autoencoder model.
  arXiv  Detail & Related papers  (2022-05-05T20:58:33Z)
• Experience feedback using Representation Learning for Few-Shot Object Detection on Aerial Images [2.8560476609689185]
  The performance of our method is assessed on DOTA, a large-scale remote sensing images dataset. It highlights in particular some intrinsic weaknesses for the few-shot object detection task.
  arXiv  Detail & Related papers  (2021-09-27T13:04:53Z)
• NDPNet: A novel non-linear data projection network for few-shot fine-grained image classification [33.71025164816078]
  We introduce the non-linear data projection concept into the design of metric-based fine-grained image classification architecture. Our proposed architecture can be easily embedded into any episodic training mechanisms for end-to-end training from scratch.
  arXiv  Detail & Related papers  (2021-06-13T13:33:09Z)
• Multi-Scale Positive Sample Refinement for Few-Shot Object Detection [61.60255654558682]
  Few-shot object detection (FSOD) helps detectors adapt to unseen classes with few training instances. We propose a Multi-scale Positive Sample Refinement (MPSR) approach to enrich object scales in FSOD. MPSR generates multi-scale positive samples as object pyramids and refines the prediction at various scales.
  arXiv  Detail & Related papers  (2020-07-18T09:48:29Z)
• LFD-ProtoNet: Prototypical Network Based on Local Fisher Discriminant Analysis for Few-shot Learning [98.64231310584614]
  The prototypical network (ProtoNet) is a few-shot learning framework that performs metric learning and classification using the distance to prototype representations of each class. We show the usefulness of the proposed method by theoretically providing an expected risk bound and empirically demonstrating its superior classification accuracy on miniImageNet and tieredImageNet.
  arXiv  Detail & Related papers  (2020-06-15T11:56:30Z)
• Interpretable Time-series Classification on Few-shot Samples [27.05851877375113]
  This paper proposes an interpretable neural-based framework, namely textitDual Prototypical Shapelet Networks (DPSN) for few-shot time-series classification. DPSN interprets the model from dual granularity: 1) global overview using representative time series samples, and 2) local highlights using discriminative shapelets. We have derived 18 few-shot TSC datasets from public benchmark datasets and evaluated the proposed method by comparing with baselines.
  arXiv  Detail & Related papers  (2020-06-03T03:47:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.