A Complete Survey on Contemporary Methods, Emerging Paradigms and Hybrid Approaches for Few-Shot Learning

• URL: http://arxiv.org/abs/2402.03017v3
• Date: Fri, 24 Jan 2025 13:36:52 GMT
• Title: A Complete Survey on Contemporary Methods, Emerging Paradigms and Hybrid Approaches for Few-Shot Learning
• Authors: Georgios Tsoumplekas, Vladislav Li, Panagiotis Sarigiannidis, Vasileios Argyriou,
• Abstract summary: Few-Shot Learning aims to enable rapid adaptation to novel learning tasks.<n>Recent trends shaping the field, outstanding challenges, and promising future research directions are discussed.
• Score: 5.8497833718980345
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the widespread success of deep learning, its intense requirements for vast amounts of data and extensive training make it impractical for various real-world applications where data is scarce. In recent years, Few-Shot Learning (FSL) has emerged as a learning paradigm that aims to address these limitations by leveraging prior knowledge to enable rapid adaptation to novel learning tasks. Due to its properties that highly complement deep learning's data-intensive needs, FSL has seen significant growth in the past few years. This survey provides a comprehensive overview of both well-established methods as well as recent advancements in the FSL field. The presented taxonomy extends previously proposed ones by incorporating emerging FSL paradigms, such as in-context learning, along with novel categories within the meta-learning paradigm for FSL, including neural processes and probabilistic meta-learning. Furthermore, a holistic overview of FSL is provided by discussing hybrid FSL approaches that extend FSL beyond the typically examined supervised learning setting. The survey also explores FSL's diverse applications across various domains. Finally, recent trends shaping the field, outstanding challenges, and promising future research directions are discussed.

Related papers

• LLM Post-Training: A Deep Dive into Reasoning Large Language Models [131.10969986056]
  Large Language Models (LLMs) have transformed the natural language processing landscape and brought to life diverse applications. Post-training methods enable LLMs to refine their knowledge, improve reasoning, enhance factual accuracy, and align more effectively with user intents and ethical considerations.
  arXiv  Detail & Related papers  (2025-02-28T18:59:54Z)
• Latest Advancements Towards Catastrophic Forgetting under Data Scarcity: A Comprehensive Survey on Few-Shot Class Incremental Learning [13.604908618597944]
  Data scarcity significantly complicates the continual learning problem. Recent progress of few-shot class incremental learning methods show insightful knowledge on how to tackle the problem. Our extensive discussion presents the open challenges, potential solutions, and future directions of FSCIL.
  arXiv  Detail & Related papers  (2025-02-12T07:39:44Z)
• Federated Large Language Models: Current Progress and Future Directions [63.68614548512534]
  This paper surveys Federated learning for LLMs (FedLLM), highlighting recent advances and future directions. We focus on two key aspects: fine-tuning and prompt learning in a federated setting, discussing existing work and associated research challenges.
  arXiv  Detail & Related papers  (2024-09-24T04:14:33Z)
• Towards Few-Shot Learning in the Open World: A Review and Beyond [52.41344813375177]
  Few-shot learning aims to mimic human intelligence by enabling significant generalizations and transferability. This paper presents a review of recent advancements designed to adapt FSL for use in open-world settings. We categorize existing methods into three distinct types of open-world few-shot learning: those involving varying instances, varying classes, and varying distributions.
  arXiv  Detail & Related papers  (2024-08-19T06:23:21Z)
• Deep Learning-Based Object Pose Estimation: A Comprehensive Survey [73.74933379151419]
  We discuss the recent advances in deep learning-based object pose estimation. Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks.
  arXiv  Detail & Related papers  (2024-05-13T14:44:22Z)
• A Survey on Deep Active Learning: Recent Advances and New Frontiers [27.07154361976248]
  This work aims to serve as a useful and quick guide for researchers in overcoming difficulties in deep learning-based active learning (DAL) This technique has gained increasing popularity due to its broad applicability, yet its survey papers, especially for deep learning-based active learning (DAL), remain scarce.
  arXiv  Detail & Related papers  (2024-05-01T05:54:33Z)
• ChatGPT Alternative Solutions: Large Language Models Survey [0.0]
  Large Language Models (LLMs) have ignited a surge in research contributions within this domain. Recent years have witnessed a dynamic synergy between academia and industry, propelling the field of LLM research to new heights. This survey furnishes a well-rounded perspective on the current state of generative AI, shedding light on opportunities for further exploration, enhancement, and innovation.
  arXiv  Detail & Related papers  (2024-03-21T15:16:50Z)
• Fine-Grained Zero-Shot Learning: Advances, Challenges, and Prospects [84.36935309169567]
  We present a broad review of recent advances for fine-grained analysis in zero-shot learning (ZSL) We first provide a taxonomy of existing methods and techniques with a thorough analysis of each category. Then, we summarize the benchmark, covering publicly available datasets, models, implementations, and some more details as a library.
  arXiv  Detail & Related papers  (2024-01-31T11:51:24Z)
• LSFSL: Leveraging Shape Information in Few-shot Learning [11.145085584637746]
  Few-shot learning techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks, such as shortcut learning and texture bias behaviors, are further exacerbated. We propose LSFSL, which enforces the model to learn more generalizable features utilizing the implicit prior information present in the data.
  arXiv  Detail & Related papers  (2023-04-13T16:59:22Z)
• Semi-Supervised and Unsupervised Deep Visual Learning: A Survey [76.2650734930974]
  Semi-supervised learning and unsupervised learning offer promising paradigms to learn from an abundance of unlabeled visual data. We review the recent advanced deep learning algorithms on semi-supervised learning (SSL) and unsupervised learning (UL) for visual recognition from a unified perspective.
  arXiv  Detail & Related papers  (2022-08-24T04:26:21Z)
• A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities [5.809416101410813]
  Few-shot learning has emerged as an effective learning method and shows great potential. We extensively investigated 200+ latest papers on FSL published in the past three years. We propose a novel taxonomy to classify the existing work according to the level of abstraction of knowledge.
  arXiv  Detail & Related papers  (2022-05-13T16:24:35Z)
• A Framework of Meta Functional Learning for Regularising Knowledge Transfer [89.74127682599898]
  This work proposes a novel framework of Meta Functional Learning (MFL) by meta-learning a generalisable functional model from data-rich tasks. The MFL computes meta-knowledge on functional regularisation generalisable to different learning tasks by which functional training on limited labelled data promotes more discriminative functions to be learned.
  arXiv  Detail & Related papers  (2022-03-28T15:24:09Z)
• Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparison [54.357707168883024]
  Few-Shot Object Detection (FSOD) mimics the humans' ability of learning to learn. FSOD intelligently transfers the learned generic object knowledge from the common heavy-tailed, to the novel long-tailed object classes. We give an overview of FSOD, including the problem definition, common datasets, and evaluation protocols.
  arXiv  Detail & Related papers  (2022-03-27T04:11:28Z)
• Deep Learning meets Liveness Detection: Recent Advancements and Challenges [3.2011056280404637]
  We present a comprehensive survey on the literature related to deep-feature-based FAS methods since 2017. We cover predominant public datasets for FAS in chronological order, their evolutional progress, and the evaluation criteria.
  arXiv  Detail & Related papers  (2021-12-29T19:24:58Z)
• A Strong Baseline for Semi-Supervised Incremental Few-Shot Learning [54.617688468341704]
  Few-shot learning aims to learn models that generalize to novel classes with limited training samples. We propose a novel paradigm containing two parts: (1) a well-designed meta-training algorithm for mitigating ambiguity between base and novel classes caused by unreliable pseudo labels and (2) a model adaptation mechanism to learn discriminative features for novel classes while preserving base knowledge using few labeled and all the unlabeled data.
  arXiv  Detail & Related papers  (2021-10-21T13:25:52Z)
• Learning from Very Few Samples: A Survey [80.06120185496403]
  Few sample learning is significant and challenging in the field of machine learning. Few sample learning algorithms typically entail hundreds or thousands of supervised samples to guarantee generalization ability.
  arXiv  Detail & Related papers  (2020-09-06T06:13:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.