GenZSL: Generative Zero-Shot Learning Via Inductive Variational Autoencoder

• URL: http://arxiv.org/abs/2505.11882v1
• Date: Sat, 17 May 2025 07:24:13 GMT
• Title: GenZSL: Generative Zero-Shot Learning Via Inductive Variational Autoencoder
• Authors: Shiming Chen, Dingjie Fu, Salman Khan, Fahad Shahbaz Khan,
• Abstract summary: We propose an inductive variational autoencoder for generative zero-shot learning, dubbed GenZSL.<n>Our GenZSL operates by inducting new class samples from similar seen classes using weak class semantic vectors.<n>Experiments conducted on three popular benchmark datasets showcase the superiority and potential of our GenZSL.
• Score: 56.573203512455706
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Remarkable progress in zero-shot learning (ZSL) has been achieved using generative models. However, existing generative ZSL methods merely generate (imagine) the visual features from scratch guided by the strong class semantic vectors annotated by experts, resulting in suboptimal generative performance and limited scene generalization. To address these and advance ZSL, we propose an inductive variational autoencoder for generative zero-shot learning, dubbed GenZSL. Mimicking human-level concept learning, GenZSL operates by inducting new class samples from similar seen classes using weak class semantic vectors derived from target class names (i.e., CLIP text embedding). To ensure the generation of informative samples for training an effective ZSL classifier, our GenZSL incorporates two key strategies. Firstly, it employs class diversity promotion to enhance the diversity of class semantic vectors. Secondly, it utilizes target class-guided information boosting criteria to optimize the model. Extensive experiments conducted on three popular benchmark datasets showcase the superiority and potential of our GenZSL with significant efficacy and efficiency over f-VAEGAN, e.g., 24.7% performance gains and more than $60\times$ faster training speed on AWA2. Codes are available at https://github.com/shiming-chen/GenZSL.

Related papers

• From Zero-Shot to Few-Shot Learning: A Step of Embedding-Aware Generative Models [21.603519845525483]
  Embedding-aware generative model (EAGM) addresses the data insufficiency problem for zero-shot learning (ZSL) by constructing a generator between semantic and visual embedding spaces. We argue that it is time to take a step back and reconsider the embedding-aware generative paradigm.
  arXiv  Detail & Related papers  (2023-02-08T13:53:18Z)
• On the Transferability of Visual Features in Generalized Zero-Shot Learning [28.120004119724577]
  Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes. In this work, we investigate the utility of different GZSL methods when using different feature extractors. We also examine how these models' pre-training objectives, datasets, and architecture design affect their feature representation ability.
  arXiv  Detail & Related papers  (2022-11-22T18:59:09Z)
• Zero-Shot Logit Adjustment [89.68803484284408]
  Generalized Zero-Shot Learning (GZSL) is a semantic-descriptor-based learning technique. In this paper, we propose a new generation-based technique to enhance the generator's effect while neglecting the improvement of the classifier. Our experiments demonstrate that the proposed technique achieves state-of-the-art when combined with the basic generator, and it can improve various generative zero-shot learning frameworks.
  arXiv  Detail & Related papers  (2022-04-25T17:54:55Z)
• Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloud [79.99653758293277]
  We present the first generative approach for both Zero-Shot Learning (ZSL) and Generalized ZSL (GZSL) on 3D data. We show that it reaches or outperforms the state of the art on ModelNet40 classification for both inductive ZSL and inductive GZSL. Our experiments show that our method outperforms strong baselines, which we additionally propose for this task.
  arXiv  Detail & Related papers  (2021-08-13T13:29:27Z)
• Attribute-Modulated Generative Meta Learning for Zero-Shot Classification [52.64680991682722]
  We present the Attribute-Modulated generAtive meta-model for Zero-shot learning (AMAZ) Our model consists of an attribute-aware modulation network and an attribute-augmented generative network. Our empirical evaluations show that AMAZ improves state-of-the-art methods by 3.8% and 5.1% in ZSL and generalized ZSL settings, respectively.
  arXiv  Detail & Related papers  (2021-04-22T04:16:43Z)
• Contrastive Embedding for Generalized Zero-Shot Learning [22.050109158293402]
  Generalized zero-shot learning (GZSL) aims to recognize objects from both seen and unseen classes. Recent feature generation methods learn a generative model that can synthesize the missing visual features of unseen classes. We propose to integrate the generation model with the embedding model, yielding a hybrid GZSL framework.
  arXiv  Detail & Related papers  (2021-03-30T08:54:03Z)
• Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot Learning [82.07273754143547]
  We propose a meta-continual zero-shot learning (MCZSL) approach to generalizing a model to categories unseen during training. By pairing self-gating of attributes and scaled class normalization with meta-learning based training, we are able to outperform state-of-the-art results.
  arXiv  Detail & Related papers  (2021-02-23T18:36:14Z)
• End-to-end Generative Zero-shot Learning via Few-shot Learning [76.9964261884635]
  State-of-the-art approaches to Zero-Shot Learning (ZSL) train generative nets to synthesize examples conditioned on the provided metadata. We introduce an end-to-end generative ZSL framework that uses such an approach as a backbone and feeds its synthesized output to a Few-Shot Learning algorithm.
  arXiv  Detail & Related papers  (2021-02-08T17:35:37Z)
• Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learning [14.277015352910674]
  We propose a generative model that explicitly performs knowledge transfer by incorporating a novel Semantic Regularized Loss (SR-Loss) Experiments on seven benchmark datasets demonstrate the superiority of the LsrGAN compared to previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-07-19T01:25:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.