Addressing Imbalance in Multi-Label Data via Label-Specific Distance-based Oversampling

• URL: http://arxiv.org/abs/2606.05927v1
• Date: Thu, 04 Jun 2026 09:30:21 GMT
• Title: Addressing Imbalance in Multi-Label Data via Label-Specific Distance-based Oversampling
• Abstract summary: We propose a novel sampling approach called Label-Specific Distance-based Multi-Label Oversampling (LSDMLO) to address the imbalance in multi-label datasets.<n>LSDMLO derives the label-specific distance to identify label-consistent neighbors based on the weighted pertinent feature space.<n>The proposed LSDMLO outperforms the state-of-the-art multi-label sampling approaches under various bases.
• Score: 11.772739318850752
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: The complex imbalanced label distribution poses a crucial challenge to multi-label classification, as most classifiers are biased towards the majority class and high-frequent labels. Oversampling is an efficient and flexible solution that augments instances to provide a more balanced training dataset for multi-label classifiers. Most existing oversampling methods create synthetic instances in a heuristic way that essentially relies on neighborhood information retrieved using Euclidean distance within the entire feature space. However, they fail to consider the varying semantic relevance of features to different labels, leading to label inconsistency among proximate neighbors and further introducing label confusion and overfitting to synthetic instances. To overcome the above issue, we propose a novel sampling approach called Label-Specific Distance-based Multi-Label Oversampling (LSDMLO) that creates more useful and well-labeled synthetic instances to address the imbalance in multi-label datasets. LSDMLO derives the label-specific distance to identify label-consistent neighbors based on the weighted pertinent feature space, which facilitates selecting seed instances that express more label correlations in boundary areas and generating synthetic instances aligned with the label distribution of original data. The comprehensive experiments verify that the proposed LSDMLO outperforms the state-of-the-art multi-label sampling approaches under various base classifiers.

Related papers

• Feature-Label Modal Alignment for Robust Partial Multi-Label Learning [66.1611192892514]
  We propose a novel PML method based on feature-label modal alignment (PML-MA)<n>PML-MA treats features and labels as two complementary modalities and restores their consistency through systematic alignment.<n>Experiments on both real-world and synthetic datasets demonstrate that PML-MA significantly outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-04-10T07:44:46Z)
• Label Distribution Learning with Biased Annotations by Learning Multi-Label Representation [120.97262070068224]
  Multi-label learning (MLL) has gained attention for its ability to represent real-world data.<n>Label Distribution Learning (LDL) faces challenges in collecting accurate label distributions.
  arXiv  Detail & Related papers  (2025-02-03T09:04:03Z)
• Mixed Blessing: Class-Wise Embedding guided Instance-Dependent Partial Label Learning [53.64180787439527]
  In partial label learning (PLL), every sample is associated with a candidate label set comprising the ground-truth label and several noisy labels.<n>For the first time, we create class-wise embeddings for each sample, which allow us to explore the relationship of instance-dependent noisy labels.<n>To reduce the high label ambiguity, we introduce the concept of class prototypes containing global feature information.
  arXiv  Detail & Related papers  (2024-12-06T13:25:39Z)
• Exploiting Conjugate Label Information for Multi-Instance Partial-Label Learning [61.00359941983515]
  Multi-instance partial-label learning (MIPL) addresses scenarios where each training sample is represented as a multi-instance bag associated with a candidate label set containing one true label and several false positives. ELIMIPL exploits the conjugate label information to improve the disambiguation performance.
  arXiv  Detail & Related papers  (2024-08-26T15:49:31Z)
• Scalable Label Distribution Learning for Multi-Label Classification [43.52928088881866]
  Multi-label classification (MLC) refers to the problem of tagging a given instance with a set of relevant labels. Most existing MLC methods are based on the assumption that the correlation of two labels in each label pair is symmetric. Most existing methods design learning processes associated with the number of labels, which makes their computational complexity a bottleneck when scaling up to large-scale output space.
  arXiv  Detail & Related papers  (2023-11-28T06:52:53Z)
• Class-Distribution-Aware Pseudo Labeling for Semi-Supervised Multi-Label Learning [97.88458953075205]
  Pseudo-labeling has emerged as a popular and effective approach for utilizing unlabeled data. This paper proposes a novel solution called Class-Aware Pseudo-Labeling (CAP) that performs pseudo-labeling in a class-aware manner.
  arXiv  Detail & Related papers  (2023-05-04T12:52:18Z)
• One Positive Label is Sufficient: Single-Positive Multi-Label Learning with Label Enhancement [71.9401831465908]
  We investigate single-positive multi-label learning (SPMLL) where each example is annotated with only one relevant label. A novel method named proposed, i.e., Single-positive MultI-label learning with Label Enhancement, is proposed. Experiments on benchmark datasets validate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-06-01T14:26:30Z)
• Integrating Unsupervised Clustering and Label-specific Oversampling to Tackle Imbalanced Multi-label Data [13.888344214818733]
  Clustering is performed to find out the key distinct and locally connected regions of a multi-label dataset. Only the minority points within a cluster are used to generate the synthetic minority points that are used for oversampling. Experiments using 12 multi-label datasets and several multi-label algorithms show that the proposed method performed very well.
  arXiv  Detail & Related papers  (2021-09-25T19:00:00Z)
• Multi-Label Sampling based on Local Label Imbalance [7.355362369511579]
  Class imbalance is an inherent characteristic of multi-label data that hinders most multi-label learning methods. Existing multi-label sampling approaches alleviate the global imbalance of multi-label datasets. It is actually the imbalance level within the local neighbourhood of minority class examples that plays a key role in performance degradation.
  arXiv  Detail & Related papers  (2020-05-07T04:14:23Z)
• Generalized Label Enhancement with Sample Correlations [24.582764493585362]
  We propose two novel label enhancement methods, i.e., Label Enhancement with Sample Correlations (LESC) and generalized Label Enhancement with Sample Correlations (gLESC) Benefitting from the sample correlations, the proposed methods can boost the performance of label enhancement.
  arXiv  Detail & Related papers  (2020-04-07T03:32:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.