Angle-Based Cost-Sensitive Multicategory Classification
- URL: http://arxiv.org/abs/2003.03691v1
- Date: Sun, 8 Mar 2020 00:42:15 GMT
- Title: Angle-Based Cost-Sensitive Multicategory Classification
- Authors: Yi Yang, Yuxuan Guo and Xiangyu Chang
- Abstract summary: We propose a novel angle-based cost-sensitive classification framework for multicategory classification without the sum-to-zero constraint.
To show the usefulness of the framework, two cost-sensitive multicategory boosting algorithms are derived as concrete instances.
- Score: 34.174072286426885
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many real-world classification problems come with costs which can vary for
different types of misclassification. It is thus important to develop
cost-sensitive classifiers which minimize the total misclassification cost.
Although binary cost-sensitive classifiers have been well-studied, solving
multicategory classification problems is still challenging. A popular approach
to address this issue is to construct K classification functions for a K-class
problem and remove the redundancy by imposing a sum-to-zero constraint.
However, such method usually results in higher computational complexity and
inefficient algorithms. In this paper, we propose a novel angle-based
cost-sensitive classification framework for multicategory classification
without the sum-to-zero constraint. Loss functions that included in the
angle-based cost-sensitive classification framework are further justified to be
Fisher consistent. To show the usefulness of the framework, two cost-sensitive
multicategory boosting algorithms are derived as concrete instances. Numerical
experiments demonstrate that proposed boosting algorithms yield competitive
classification performances against other existing boosting approaches.
Related papers
- BAdaCost: Multi-class Boosting with Costs [2.6080756513915824]
BAdaCost is a multi-class cost-sensitive classification algorithm.
It achieves significant gains in performance when compared to previous multi-class cost-sensitive approaches.
arXiv Detail & Related papers (2024-02-06T23:18:29Z) - Cost-Sensitive Stacking: an Empirical Evaluation [3.867363075280544]
Cost-sensitive learning adapts classification algorithms to account for differences in misclassification costs.
There is no consensus in the literature as to what cost-sensitive stacking is.
Our experiments, conducted on twelve datasets, show that for best performance, both levels of stacking require cost-sensitive classification decision.
arXiv Detail & Related papers (2023-01-04T18:28:07Z) - Anomaly Detection using Ensemble Classification and Evidence Theory [62.997667081978825]
We present a novel approach for novel detection using ensemble classification and evidence theory.
A pool selection strategy is presented to build a solid ensemble classifier.
We use uncertainty for the anomaly detection approach.
arXiv Detail & Related papers (2022-12-23T00:50:41Z) - Multi-class Classification with Fuzzy-feature Observations: Theory and
Algorithms [36.810603503167755]
We propose a novel framework to address a new realistic problem called multi-class classification with imprecise observations (MCIMO)
First, we give the theoretical analysis of the MCIMO problem based on fuzzy Rademacher complexity.
Then, two practical algorithms based on support vector machine and neural networks are constructed to solve the proposed new problem.
arXiv Detail & Related papers (2022-06-09T07:14:00Z) - The SAMME.C2 algorithm for severely imbalanced multi-class
classification [0.0]
A minority class is often considered the more interesting class yet developing a scientific learning algorithm suitable for the observations presents countless challenges.
We suggest a novel multi-class classification algorithm specialized to handle severely imbalanced classes based on the method we refer to as SAMME.C2.
Not only do we provide the resulting algorithm but we also establish scientific and statistical formulation of our proposed SAMME.C2 algorithm.
arXiv Detail & Related papers (2021-12-30T00:20:01Z) - Adaptive Cost-Sensitive Learning in Neural Networks for
Misclassification Cost Problems [2.8935588665357077]
We design a new adaptive learning algorithm for misclassification cost problems.
Our algorithm bridges the difference between the class distributions between subgroups of samples in the training and test data sets with similar predicted probabilities.
We present empirical evidence that a deep neural network used with the proposed algorithm yields better cost results on several binary classification data sets that have class-imbalanced and class-balanced distributions compared to other alternative approaches.
arXiv Detail & Related papers (2021-11-14T16:19:11Z) - Binary Classification from Multiple Unlabeled Datasets via Surrogate Set
Classification [94.55805516167369]
We propose a new approach for binary classification from m U-sets for $mge2$.
Our key idea is to consider an auxiliary classification task called surrogate set classification (SSC)
arXiv Detail & Related papers (2021-02-01T07:36:38Z) - Theoretical Insights Into Multiclass Classification: A High-dimensional
Asymptotic View [82.80085730891126]
We provide the first modernally precise analysis of linear multiclass classification.
Our analysis reveals that the classification accuracy is highly distribution-dependent.
The insights gained may pave the way for a precise understanding of other classification algorithms.
arXiv Detail & Related papers (2020-11-16T05:17:29Z) - Classification with Rejection Based on Cost-sensitive Classification [83.50402803131412]
We propose a novel method of classification with rejection by ensemble of learning.
Experimental results demonstrate the usefulness of our proposed approach in clean, noisy, and positive-unlabeled classification.
arXiv Detail & Related papers (2020-10-22T14:05:05Z) - Self-Weighted Robust LDA for Multiclass Classification with Edge Classes [111.5515086563592]
A novel self-weighted robust LDA with l21-norm based between-class distance criterion, called SWRLDA, is proposed for multi-class classification.
The proposed SWRLDA is easy to implement, and converges fast in practice.
arXiv Detail & Related papers (2020-09-24T12:32:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.