Class-Level Feature Selection Method Using Feature Weighted Growing Self-Organising Maps

• URL: http://arxiv.org/abs/2503.11732v1
• Date: Fri, 14 Mar 2025 11:02:34 GMT
• Title: Class-Level Feature Selection Method Using Feature Weighted Growing Self-Organising Maps
• Authors: Andrew Starkey, Uduak Idio Akpan, Omaimah AL Hosni, Yaseen Pullissery,
• Abstract summary: We develop a class-level feature selection method called the Feature Weighted Growing Self-Organising Map (FWGSOM)<n>Results from experiments indicate that our method performs better than other methods, gives explainable results at class level, and has a low computational footprint when compared to other methods.
• Score: 0.26249027950824505
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: There have been several attempts to develop Feature Selection (FS) algorithms capable of identifying features that are relevant in a dataset. Although in certain applications the FS algorithms can be seen to be successful, they have similar basic limitations. In all cases, the global feature selection algorithms seek to select features that are relevant and common to all classes of the dataset. This is a major limitation since there could be features that are specifically useful for a particular class while irrelevant for other classes, and full explanation of the relationship at class level therefore cannot be determined. While the inclusion of such features for all classes could cause improved predictive ability for the relevant class, the same features could be problematic for other classes. In this paper, we examine this issue and also develop a class-level feature selection method called the Feature Weighted Growing Self-Organising Map (FWGSOM). The proposed method carries out feature analysis at class level which enhances its ability to identify relevant features for each class. Results from experiments indicate that our method performs better than other methods, gives explainable results at class level, and has a low computational footprint when compared to other methods.

Related papers

• Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning [49.65841002338575]
  This paper focuses on the challenging yet practical multi-label class-incremental learning (MLCIL) problem.<n>We propose a novel class-independent incremental network (CINet) to extract multiple class-level embeddings for multi-label samples.<n>It learns and preserves the knowledge of different classes by constructing class-specific tokens.
  arXiv  Detail & Related papers  (2025-03-01T14:40:52Z)
• Feature Selection for Latent Factor Models [2.07180164747172]
  Feature selection is crucial for pinpointing relevant features in high-dimensional datasets.<n>Traditional feature selection methods for classification use data from all classes to select features for each class.<n>This paper explores feature selection methods that select features for each class separately, using class models based on low-rank generative methods.
  arXiv  Detail & Related papers  (2024-12-13T13:20:10Z)
• Collaborative Feature-Logits Contrastive Learning for Open-Set Semi-Supervised Object Detection [75.02249869573994]
  In open-set scenarios, the unlabeled dataset contains both in-distribution (ID) classes and out-of-distribution (OOD) classes.<n>Applying semi-supervised detectors in such settings can lead to misclassifying OOD class as ID classes.<n>We propose a simple yet effective method, termed Collaborative Feature-Logits Detector (CFL-Detector)
  arXiv  Detail & Related papers  (2024-11-20T02:57:35Z)
• Class-specific feature selection for classification explainability [0.0]
  This work first introduces a comprehensive review of the concept of class-specific, with a focus on feature selection and classification. The fundamental idea of the class-specific concept resides in the understanding that the significance of each feature can vary from one class to another. This class-specific perspective offers a more effective approach to classification tasks by recognizing and leveraging the unique characteristics of each class.
  arXiv  Detail & Related papers  (2024-11-02T10:31:55Z)
• Feature selection simultaneously preserving both class and cluster structures [5.5612170847190665]
  We propose a neural network-based feature selection method that focuses both on class discrimination and structure preservation in an integrated manner. Based on the results of the experiments, we may claim that the proposed feature/band selection can select a subset of features that is good for both classification and clustering.
  arXiv  Detail & Related papers  (2023-07-08T04:49:51Z)
• Understanding the classes better with class-specific and rule-specific feature selection, and redundancy control in a fuzzy rule based framework [5.5612170847190665]
  We propose a class-specific feature selection method embedded in a fuzzy rule-based classifier. Our method results in class-specific rules involving class-specific subsets. The effectiveness of the proposed method has been validated through experiments on three synthetic data sets.
  arXiv  Detail & Related papers  (2022-08-02T07:45:34Z)
• Generative Multi-Label Zero-Shot Learning [136.17594611722285]
  Multi-label zero-shot learning strives to classify images into multiple unseen categories for which no data is available during training. Our work is the first to tackle the problem of multi-label feature in the (generalized) zero-shot setting. Our cross-level fusion-based generative approach outperforms the state-of-the-art on all three datasets.
  arXiv  Detail & Related papers  (2021-01-27T18:56:46Z)
• Feature Space Augmentation for Long-Tailed Data [74.65615132238291]
  Real-world data often follow a long-tailed distribution as the frequency of each class is typically different. Class-balanced loss and advanced methods on data re-sampling and augmentation are among the best practices to alleviate the data imbalance problem. We present a novel approach to address the long-tailed problem by augmenting the under-represented classes in the feature space with the features learned from the classes with ample samples.
  arXiv  Detail & Related papers  (2020-08-09T06:38:00Z)
• A Few-Shot Sequential Approach for Object Counting [63.82757025821265]
  We introduce a class attention mechanism that sequentially attends to objects in the image and extracts their relevant features. The proposed technique is trained on point-level annotations and uses a novel loss function that disentangles class-dependent and class-agnostic aspects of the model. We present our results on a variety of object-counting/detection datasets, including FSOD and MS COCO.
  arXiv  Detail & Related papers  (2020-07-03T18:23:39Z)
• On-the-Fly Joint Feature Selection and Classification [16.84451472788859]
  We propose a framework to perform joint feature selection and classification on-the-fly. We derive the optimum solution of the associated optimization problem and analyze its structure. We evaluate the performance of the proposed algorithms on several public datasets.
  arXiv  Detail & Related papers  (2020-04-21T19:19:39Z)
• Learning Class Regularized Features for Action Recognition [68.90994813947405]
  We introduce a novel method named Class Regularization that performs class-based regularization of layer activations. We show that using Class Regularization blocks in state-of-the-art CNN architectures for action recognition leads to systematic improvement gains of 1.8%, 1.2% and 1.4% on the Kinetics, UCF-101 and HMDB-51 datasets, respectively.
  arXiv  Detail & Related papers  (2020-02-07T07:27:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.