Contrastive Embedding for Generalized Zero-Shot Learning

• URL: http://arxiv.org/abs/2103.16173v1
• Date: Tue, 30 Mar 2021 08:54:03 GMT
• Title: Contrastive Embedding for Generalized Zero-Shot Learning
• Authors: Zongyan Han, Zhenyong Fu, Shuo Chen and Jian Yang
• Abstract summary: Generalized zero-shot learning (GZSL) aims to recognize objects from both seen and unseen classes. Recent feature generation methods learn a generative model that can synthesize the missing visual features of unseen classes. We propose to integrate the generation model with the embedding model, yielding a hybrid GZSL framework.
• Score: 22.050109158293402
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generalized zero-shot learning (GZSL) aims to recognize objects from both seen and unseen classes, when only the labeled examples from seen classes are provided. Recent feature generation methods learn a generative model that can synthesize the missing visual features of unseen classes to mitigate the data-imbalance problem in GZSL. However, the original visual feature space is suboptimal for GZSL classification since it lacks discriminative information. To tackle this issue, we propose to integrate the generation model with the embedding model, yielding a hybrid GZSL framework. The hybrid GZSL approach maps both the real and the synthetic samples produced by the generation model into an embedding space, where we perform the final GZSL classification. Specifically, we propose a contrastive embedding (CE) for our hybrid GZSL framework. The proposed contrastive embedding can leverage not only the class-wise supervision but also the instance-wise supervision, where the latter is usually neglected by existing GZSL researches. We evaluate our proposed hybrid GZSL framework with contrastive embedding, named CE-GZSL, on five benchmark datasets. The results show that our CEGZSL method can outperform the state-of-the-arts by a significant margin on three datasets. Our codes are available on https://github.com/Hanzy1996/CE-GZSL.

Related papers

• Zero-Shot Learning by Harnessing Adversarial Samples [52.09717785644816]
  We propose a novel Zero-Shot Learning (ZSL) approach by Harnessing Adversarial Samples (HAS) HAS advances ZSL through adversarial training which takes into account three crucial aspects. We demonstrate the effectiveness of our adversarial samples approach in both ZSL and Generalized Zero-Shot Learning (GZSL) scenarios.
  arXiv  Detail & Related papers  (2023-08-01T06:19:13Z)
• From Zero-Shot to Few-Shot Learning: A Step of Embedding-Aware Generative Models [21.603519845525483]
  Embedding-aware generative model (EAGM) addresses the data insufficiency problem for zero-shot learning (ZSL) by constructing a generator between semantic and visual embedding spaces. We argue that it is time to take a step back and reconsider the embedding-aware generative paradigm.
  arXiv  Detail & Related papers  (2023-02-08T13:53:18Z)
• LETS-GZSL: A Latent Embedding Model for Time Series Generalized Zero Shot Learning [1.4665304971699262]
  We propose a Latent Embedding for Time Series - GZSL (LETS-GZSL) model that can solve the problem of GZSL for time series classification (TSC) Our framework is able to achieve a harmonic mean value of at least 55% on most datasets except when the number of unseen classes is greater than 3.
  arXiv  Detail & Related papers  (2022-07-25T09:31:22Z)
• Disentangled Ontology Embedding for Zero-shot Learning [39.014714187825646]
  Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL) Existing ZSL methods that utilize KGs all neglect the complexity of inter-class relationships represented in KGs. In this paper, we focus on for augmenting ZSL, and propose to learn disentangled ontology embeddings guided by semantic properties. We also contribute a new ZSL framework named DOZSL, which contains two new ZSL solutions based on generative models and graph propagation models.
  arXiv  Detail & Related papers  (2022-06-08T08:29:30Z)
• Zero-Shot Logit Adjustment [89.68803484284408]
  Generalized Zero-Shot Learning (GZSL) is a semantic-descriptor-based learning technique. In this paper, we propose a new generation-based technique to enhance the generator's effect while neglecting the improvement of the classifier. Our experiments demonstrate that the proposed technique achieves state-of-the-art when combined with the basic generator, and it can improve various generative zero-shot learning frameworks.
  arXiv  Detail & Related papers  (2022-04-25T17:54:55Z)
• Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloud [79.99653758293277]
  We present the first generative approach for both Zero-Shot Learning (ZSL) and Generalized ZSL (GZSL) on 3D data. We show that it reaches or outperforms the state of the art on ModelNet40 classification for both inductive ZSL and inductive GZSL. Our experiments show that our method outperforms strong baselines, which we additionally propose for this task.
  arXiv  Detail & Related papers  (2021-08-13T13:29:27Z)
• FREE: Feature Refinement for Generalized Zero-Shot Learning [86.41074134041394]
  Generalized zero-shot learning (GZSL) has achieved significant progress, with many efforts dedicated to overcoming the problems of visual-semantic domain gap and seen-unseen bias. Most existing methods directly use feature extraction models trained on ImageNet alone, ignoring the cross-dataset bias between ImageNet and GZSL benchmarks. We propose a simple yet effective GZSL method, termed feature refinement for generalized zero-shot learning (FREE) to tackle the above problem.
  arXiv  Detail & Related papers  (2021-07-29T08:11:01Z)
• Learning without Seeing nor Knowing: Towards Open Zero-Shot Learning [27.283748476678117]
  In Generalized Zero-Shot Learning (GZSL) unseen categories can be predicted by leveraging their class embeddings. We propose Open Zero-Shot Learning (OZSL) to extend GZSL towards the open-world settings. We formalize OZSL as the problem of recognizing seen and unseen classes while also rejecting instances from unknown categories.
  arXiv  Detail & Related papers  (2021-03-23T10:30:50Z)
• End-to-end Generative Zero-shot Learning via Few-shot Learning [76.9964261884635]
  State-of-the-art approaches to Zero-Shot Learning (ZSL) train generative nets to synthesize examples conditioned on the provided metadata. We introduce an end-to-end generative ZSL framework that uses such an approach as a backbone and feeds its synthesized output to a Few-Shot Learning algorithm.
  arXiv  Detail & Related papers  (2021-02-08T17:35:37Z)
• A Review of Generalized Zero-Shot Learning Methods [31.539434340951786]
  Generalized zero-shot learning (GZSL) aims to train a model for classifying data samples under the condition that some output classes are unknown during supervised learning. GZSL leverages semantic information of the seen (source) and unseen (target) classes to bridge the gap between both seen and unseen classes.
  arXiv  Detail & Related papers  (2020-11-17T14:00:30Z)
• Information Bottleneck Constrained Latent Bidirectional Embedding for Zero-Shot Learning [59.58381904522967]
  We propose a novel embedding based generative model with a tight visual-semantic coupling constraint. We learn a unified latent space that calibrates the embedded parametric distributions of both visual and semantic spaces. Our method can be easily extended to transductive ZSL setting by generating labels for unseen images.
  arXiv  Detail & Related papers  (2020-09-16T03:54:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.