Meta Ordinal Regression Forest For Learning with Unsure Lung Nodules
- URL: http://arxiv.org/abs/2012.03480v1
- Date: Mon, 7 Dec 2020 06:59:43 GMT
- Title: Meta Ordinal Regression Forest For Learning with Unsure Lung Nodules
- Authors: Yiming Lei, Haiping Zhu, Junping Zhang, Hongming Shan
- Abstract summary: An unsure data model (UDM) was proposed to incorporate those unsure nodules by formulating this problem as an ordinal regression.
This paper proposes a meta ordinal regression forest (MORF) which improves upon the state-of-the-art ordinal regression method.
Experimental results on the LIDC-IDRI dataset demonstrate superior performance over existing methods.
- Score: 18.597354524446487
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep learning-based methods have achieved promising performance in early
detection and classification of lung nodules, most of which discard unsure
nodules and simply deal with a binary classification -- malignant vs benign.
Recently, an unsure data model (UDM) was proposed to incorporate those unsure
nodules by formulating this problem as an ordinal regression, showing better
performance over traditional binary classification. To further explore the
ordinal relationship for lung nodule classification, this paper proposes a meta
ordinal regression forest (MORF), which improves upon the state-of-the-art
ordinal regression method, deep ordinal regression forest (DORF), in three
major ways. First, MORF can alleviate the biases of the predictions by making
full use of deep features while DORF needs to fix the composition of decision
trees before training. Second, MORF has a novel grouped feature selection (GFS)
module to re-sample the split nodes of decision trees. Last, combined with GFS,
MORF is equipped with a meta learning-based weighting scheme to map the
features selected by GFS to tree-wise weights while DORF assigns equal weights
for all trees. Experimental results on the LIDC-IDRI dataset demonstrate
superior performance over existing methods, including the state-of-the-art
DORF.
Related papers
- Binary Classification: Is Boosting stronger than Bagging? [5.877778007271621]
We introduce Enhanced Random Forests, an extension of vanilla Random Forests with extra functionalities and adaptive sample and model weighting.
We develop an iterative algorithm for adapting the training sample weights, by favoring the hardest examples, and an approach for finding personalized tree weighting schemes for each new sample.
Our method significantly improves upon regular Random Forests across 15 different binary classification datasets and considerably outperforms other tree methods, including XGBoost.
arXiv Detail & Related papers (2024-10-24T23:22:33Z) - Meta Ordinal Regression Forest for Medical Image Classification with
Ordinal Labels [37.121792169424744]
We propose a novel meta ordinal regression forest (MORF) method for medical image classification with ordinal labels.
MORF learns the ordinal relationship through the combination of convolutional neural network and differential forest in a meta-learning framework.
Experimental results on two medical image classification datasets with ordinal labels demonstrate the superior performances of our MORF method over existing state-of-the-art methods.
arXiv Detail & Related papers (2022-03-15T08:43:57Z) - CIM: Class-Irrelevant Mapping for Few-Shot Classification [58.02773394658623]
Few-shot classification (FSC) is one of the most concerned hot issues in recent years.
How to appraise the pre-trained FEM is the most crucial focus in the FSC community.
We propose a simple, flexible method, dubbed as Class-Irrelevant Mapping (CIM)
arXiv Detail & Related papers (2021-09-07T03:26:24Z) - Data-driven advice for interpreting local and global model predictions
in bioinformatics problems [17.685881417954782]
Conditional feature contributions (CFCs) provide textitlocal, case-by-case explanations of a prediction.
We compare the explanations computed by both methods on a set of 164 publicly available classification problems.
For random forests, we find extremely high similarities and correlations of both local and global SHAP values and CFC scores.
arXiv Detail & Related papers (2021-08-13T12:41:39Z) - Making CNNs Interpretable by Building Dynamic Sequential Decision
Forests with Top-down Hierarchy Learning [62.82046926149371]
We propose a generic model transfer scheme to make Convlutional Neural Networks (CNNs) interpretable.
We achieve this by building a differentiable decision forest on top of CNNs.
We name the transferred model deep Dynamic Sequential Decision Forest (dDSDF)
arXiv Detail & Related papers (2021-06-05T07:41:18Z) - Meta ordinal weighting net for improving lung nodule classification [19.61244172891081]
We propose a Meta Ordinal Weighting Network (MOW-Net) to align each training sample with a meta ordinal set (MOS) containing a few samples from all classes.
During the training process, the MOW-Net learns a mapping from samples in MOS to the corresponding class-specific weight.
The experimental results demonstrate that the MOW-Net achieves better accuracy than the state-of-the-art ordinal regression methods.
arXiv Detail & Related papers (2021-01-31T14:00:20Z) - Growing Deep Forests Efficiently with Soft Routing and Learned
Connectivity [79.83903179393164]
This paper further extends the deep forest idea in several important aspects.
We employ a probabilistic tree whose nodes make probabilistic routing decisions, a.k.a., soft routing, rather than hard binary decisions.
Experiments on the MNIST dataset demonstrate that our empowered deep forests can achieve better or comparable performance than [1],[3].
arXiv Detail & Related papers (2020-12-29T18:05:05Z) - Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance
Segmentation [75.93960390191262]
We exploit prior knowledge of the relations among object categories to cluster fine-grained classes into coarser parent classes.
We propose a simple yet effective resampling method, NMS Resampling, to re-balance the data distribution.
Our method, termed as Forest R-CNN, can serve as a plug-and-play module being applied to most object recognition models.
arXiv Detail & Related papers (2020-08-13T03:52:37Z) - Convolutional Ordinal Regression Forest for Image Ordinal Estimation [52.67784321853814]
We propose a novel ordinal regression approach, termed Convolutional Ordinal Regression Forest or CORF, for image ordinal estimation.
The proposed CORF integrates ordinal regression and differentiable decision trees with a convolutional neural network for obtaining precise and stable global ordinal relationships.
The effectiveness of the proposed CORF is verified on two image ordinal estimation tasks, showing significant improvements and better stability over the state-of-the-art ordinal regression methods.
arXiv Detail & Related papers (2020-08-07T10:41:17Z) - Revisiting Initialization of Neural Networks [72.24615341588846]
We propose a rigorous estimation of the global curvature of weights across layers by approximating and controlling the norm of their Hessian matrix.
Our experiments on Word2Vec and the MNIST/CIFAR image classification tasks confirm that tracking the Hessian norm is a useful diagnostic tool.
arXiv Detail & Related papers (2020-04-20T18:12:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.