Active Few-Shot Learning for Text Classification

• URL: http://arxiv.org/abs/2502.18782v1
• Date: Wed, 26 Feb 2025 03:30:13 GMT
• Title: Active Few-Shot Learning for Text Classification
• Authors: Saeed Ahmadnia, Arash Yousefi Jordehi, Mahsa Hosseini Khasheh Heyran, Seyed Abolghasem Mirroshandel, Owen Rambow, Cornelia Caragea,
• Abstract summary: The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing.<n>We propose an active learning-based instance selection mechanism that identifies effective support instances from the unlabeled pool.
• Score: 43.58047311582709
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively utilize a small number of annotated samples in the learning process. However, the performance of FSL suffers when unsuitable support samples are chosen. This problem arises due to the heavy reliance on a limited number of support samples, which hampers consistent performance improvement even when more support samples are added. To address this challenge, we propose an active learning-based instance selection mechanism that identifies effective support instances from the unlabeled pool and can work with different LLMs. Our experiments on five tasks show that our method frequently improves the performance of FSL. We make our implementation available on GitHub.

Related papers

• On Many-Shot In-Context Learning for Long-Context Evaluation [10.500629810624769]
  This paper delves into long-context language model evaluation through many-shot ICL. We develop metrics to categorize ICL tasks into two groups: similar-sample learning (SSL) and all-sample learning (ASL) We find that while state-of-the-art models demonstrate good performance up to 64k tokens in SSL tasks, many models experience significant performance drops at only 16k tokens in ASL tasks.
  arXiv  Detail & Related papers  (2024-11-11T17:00:59Z)
• Gradient Boosting Trees and Large Language Models for Tabular Data Few-Shot Learning [0.0]
  Large Language Models (LLM) have brought numerous of new applications to Machine Learning (ML) In this work we demonstrate that although LLMs are a viable alternative, the evidence suggests that baselines used to gauge performance can be improved.
  arXiv  Detail & Related papers  (2024-11-06T23:54:09Z)
• Large Language Models Know What Makes Exemplary Contexts [42.90814615222177]
  In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs) This paper presents a unified framework for LLMs that allows them to self-select influential in-context examples to compose their contexts.
  arXiv  Detail & Related papers  (2024-08-14T12:32:41Z)
• ParaICL: Towards Robust Parallel In-Context Learning [74.38022919598443]
  Large language models (LLMs) have become the norm in natural language processing. Few-shot in-context learning (ICL) relies on the choice of few-shot demonstration examples. We propose a novel method named parallel in-context learning (ParaICL)
  arXiv  Detail & Related papers  (2024-03-31T05:56:15Z)
• FSL-Rectifier: Rectify Outliers in Few-Shot Learning via Test-Time Augmentation [7.477118370563593]
  Few-shot learning (FSL) commonly requires a model to identify images (queries) that belong to classes unseen during training.<n>We generate additional test-class samples by combining original samples with suitable train-class samples via a generative image combiner.<n>We obtain averaged features via an augmentor, which leads to more typical representations through the averaging.
  arXiv  Detail & Related papers  (2024-02-28T12:37:30Z)
• Adversarial Robustness of Prompt-based Few-Shot Learning for Natural Language Understanding [23.458843951563978]
  State-of-the-art few-shot learning methods leverage prompt-based fine-tuning to obtain remarkable results for natural language understanding (NLU) tasks. We conduct an extensive study of several state-of-the-art FSL methods to assess their robustness to adversarial perturbations.
  arXiv  Detail & Related papers  (2023-06-19T17:01:13Z)
• OverPrompt: Enhancing ChatGPT through Efficient In-Context Learning [49.38867353135258]
  We propose OverPrompt, leveraging the in-context learning capability of LLMs to handle multiple task inputs. Our experiments show that OverPrompt can achieve cost-efficient zero-shot classification without causing significant detriment to task performance.
  arXiv  Detail & Related papers  (2023-05-24T10:08:04Z)
• Alleviating Over-smoothing for Unsupervised Sentence Representation [96.19497378628594]
  We present a Simple method named Self-Contrastive Learning (SSCL) to alleviate this issue. Our proposed method is quite simple and can be easily extended to various state-of-the-art models for performance boosting.
  arXiv  Detail & Related papers  (2023-05-09T11:00:02Z)
• A Strong Baseline for Semi-Supervised Incremental Few-Shot Learning [54.617688468341704]
  Few-shot learning aims to learn models that generalize to novel classes with limited training samples. We propose a novel paradigm containing two parts: (1) a well-designed meta-training algorithm for mitigating ambiguity between base and novel classes caused by unreliable pseudo labels and (2) a model adaptation mechanism to learn discriminative features for novel classes while preserving base knowledge using few labeled and all the unlabeled data.
  arXiv  Detail & Related papers  (2021-10-21T13:25:52Z)
• TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification [50.358839666165764]
  We show that the Task-Adaptive Feature Sub-Space Learning (TAFSSL) can significantly boost the performance in Few-Shot Learning scenarios. Specifically, we show that on the challenging miniImageNet and tieredImageNet benchmarks, TAFSSL can improve the current state-of-the-art in both transductive and semi-supervised FSL settings by more than $5%$.
  arXiv  Detail & Related papers  (2020-03-14T16:59:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.