Auxiliary Class Based Multiple Choice Learning

• URL: http://arxiv.org/abs/2108.02949v1
• Date: Fri, 6 Aug 2021 05:55:46 GMT
• Title: Auxiliary Class Based Multiple Choice Learning
• Authors: Sihwan Kim, Dae Yon Jung, Taejang Park
• Abstract summary: We propose an advanced ensemble method, called Auxiliary class based Multiple Choice Learning (AMCL), to ultimately specialize each model under the framework of multiple choice learning (MCL) The performance of AMCL exceeds all others in most of the public datasets trained with various networks as members of the ensembles.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The merit of ensemble learning lies in having different outputs from many individual models on a single input, i.e., the diversity of the base models. The high quality of diversity can be achieved when each model is specialized to different subsets of the whole dataset. Moreover, when each model explicitly knows to which subsets it is specialized, more opportunities arise to improve diversity. In this paper, we propose an advanced ensemble method, called Auxiliary class based Multiple Choice Learning (AMCL), to ultimately specialize each model under the framework of multiple choice learning (MCL). The advancement of AMCL is originated from three novel techniques which control the framework from different directions: 1) the concept of auxiliary class to provide more distinct information through the labels, 2) the strategy, named memory-based assignment, to determine the association between the inputs and the models, and 3) the feature fusion module to achieve generalized features. To demonstrate the performance of our method compared to all variants of MCL methods, we conduct extensive experiments on the image classification and segmentation tasks. Overall, the performance of AMCL exceeds all others in most of the public datasets trained with various networks as members of the ensembles.

Related papers

• Closed-form merging of parameter-efficient modules for Federated Continual Learning [9.940242741914748]
  We introduce LoRM, an alternating optimization strategy that trains one LoRA matrix at a time. This allows solving for each unknown variable individually, thus finding a unique solution. Our method demonstrates state-of-the-art performance across a range of FCIL scenarios.
  arXiv  Detail & Related papers  (2024-10-23T15:30:13Z)
• Multi-Teacher Multi-Objective Meta-Learning for Zero-Shot Hyperspectral Band Selection [50.30291173608449]
  We propose a novel multi-objective meta-learning network (M$3$BS) for zero-shot hyperspectral band selection. In M$3$BS, a generalizable graph convolution network (GCN) is constructed to generate dataset-agnostic base. The acquired meta-knowledge can be directly transferred to unseen datasets without any retraining or fine-tuning.
  arXiv  Detail & Related papers  (2024-06-12T07:13:31Z)
• U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation [63.31007867379312]
  We introduce U3M: An Unbiased Multiscale Modal Fusion Model for Multimodal Semantics. We employ feature fusion at multiple scales to ensure the effective extraction and integration of both global and local features. Experimental results demonstrate that our approach achieves superior performance across multiple datasets.
  arXiv  Detail & Related papers  (2024-05-24T08:58:48Z)
• VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognition [3.4923338594757674]
  Large language models (LLMs) can be used to train a model capable of extracting various types of entities. In this paper, we utilize the open-sourced LLM LLaMA2 as the backbone model, and design specific instructions to distinguish between different types of entities and datasets. Our model VANER, trained with a small partition of parameters, significantly outperforms previous LLMs-based models and, for the first time, as a model based on LLM, surpasses the majority of conventional state-of-the-art BioNER systems.
  arXiv  Detail & Related papers  (2024-04-27T09:00:39Z)
• Semantic-SAM: Segment and Recognize Anything at Any Granularity [83.64686655044765]
  We introduce Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity. We consolidate multiple datasets across three granularities and introduce decoupled classification for objects and parts. For the multi-granularity capability, we propose a multi-choice learning scheme during training, enabling each click to generate masks at multiple levels.
  arXiv  Detail & Related papers  (2023-07-10T17:59:40Z)
• Multi-View Class Incremental Learning [57.14644913531313]
  Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance. This paper investigates a novel paradigm called multi-view class incremental learning (MVCIL), where a single model incrementally classifies new classes from a continual stream of views.
  arXiv  Detail & Related papers  (2023-06-16T08:13:41Z)
• Multi-Objective Genetic Algorithm for Multi-View Feature Selection [0.23343923880060582]
  We propose a novel genetic algorithm strategy to overcome limitations of traditional feature selection methods for multi-view data. Our proposed approach, called the multi-view multi-objective feature selection genetic algorithm (MMFS-GA), simultaneously selects the optimal subset of features within a view and between views. The results of our evaluations on three benchmark datasets, including synthetic and real data, show improvement over the best baseline methods.
  arXiv  Detail & Related papers  (2023-05-26T13:25:20Z)
• Differentiable Model Selection for Ensemble Learning [37.99501959301896]
  This paper proposes a novel framework for differentiable model selection integrating machine learning and optimization. The framework is tailored for ensemble learning, a strategy that combines the outputs of individually pre-trained models, and learns to select appropriate ensemble members for a particular input sample.
  arXiv  Detail & Related papers  (2022-11-01T03:37:49Z)
• Multi-view Multi-behavior Contrastive Learning in Recommendation [52.42597422620091]
  Multi-behavior recommendation (MBR) aims to jointly consider multiple behaviors to improve the target behavior's performance. We propose a novel Multi-behavior Multi-view Contrastive Learning Recommendation framework.
  arXiv  Detail & Related papers  (2022-03-20T15:13:28Z)
• Contrastive Multi-Modal Clustering [22.117014300127423]
  We propose Contrastive Multi-Modal Clustering (CMMC) which can mine high-level semantic information via contrastive learning. CMMC has good scalability and outperforms state-of-the-art multi-modal clustering methods.
  arXiv  Detail & Related papers  (2021-06-21T15:32:34Z)
• Unsupervised Person Re-Identification with Multi-Label Learning Guided Self-Paced Clustering [48.31017226618255]
  Unsupervised person re-identification (Re-ID) has drawn increasing research attention recently. In this paper, we address the unsupervised person Re-ID with a conceptually novel yet simple framework, termed as Multi-label Learning guided self-paced Clustering (MLC) MLC mainly learns discriminative features with three crucial modules, namely a multi-scale network, a multi-label learning module, and a self-paced clustering module.
  arXiv  Detail & Related papers  (2021-03-08T07:30:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.