Optimal Survival Trees
- URL: http://arxiv.org/abs/2012.04284v1
- Date: Tue, 8 Dec 2020 09:00:57 GMT
- Title: Optimal Survival Trees
- Authors: Dimitris Bertsimas, Jack Dunn, Emma Gibson, Agni Orfanoudaki
- Abstract summary: We present a new Optimal Survival Trees algorithm that leverages mixed-integer optimization (MIO) and local search techniques to generate globally optimized survival tree models.
We demonstrate that the algorithm improves on the accuracy of existing survival tree methods, particularly in large datasets.
- Score: 2.7910505923792637
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Tree-based models are increasingly popular due to their ability to identify
complex relationships that are beyond the scope of parametric models. Survival
tree methods adapt these models to allow for the analysis of censored outcomes,
which often appear in medical data. We present a new Optimal Survival Trees
algorithm that leverages mixed-integer optimization (MIO) and local search
techniques to generate globally optimized survival tree models. We demonstrate
that the OST algorithm improves on the accuracy of existing survival tree
methods, particularly in large datasets.
Related papers
- Forecasting with Hyper-Trees [50.72190208487953]
Hyper-Trees are designed to learn the parameters of time series models.
By relating the parameters of a target time series model to features, Hyper-Trees also address the issue of parameter non-stationarity.
In this novel approach, the trees first generate informative representations from the input features, which a shallow network then maps to the target model parameters.
arXiv Detail & Related papers (2024-05-13T15:22:15Z) - Learning a Decision Tree Algorithm with Transformers [75.96920867382859]
We introduce MetaTree, a transformer-based model trained via meta-learning to directly produce strong decision trees.
We fit both greedy decision trees and globally optimized decision trees on a large number of datasets, and train MetaTree to produce only the trees that achieve strong generalization performance.
arXiv Detail & Related papers (2024-02-06T07:40:53Z) - Optimal Sparse Survival Trees [23.23106906682907]
Tree-based methods have been widely adopted for survival analysis due to their appealing interpretablility and their ability to capture complex relationships.
We present a dynamic-programming-with-bounds approach that finds provably-optimal sparse survival tree models.
arXiv Detail & Related papers (2024-01-27T07:26:10Z) - Optimal Survival Trees: A Dynamic Programming Approach [8.815461200424776]
Survival analysis studies and predicts the time of death, or other singular unrepeated events, based on historical data.
We use dynamic programming to provide the first survival tree method with optimality guarantees.
arXiv Detail & Related papers (2024-01-09T11:01:11Z) - Hierarchical clustering with dot products recovers hidden tree structure [53.68551192799585]
In this paper we offer a new perspective on the well established agglomerative clustering algorithm, focusing on recovery of hierarchical structure.
We recommend a simple variant of the standard algorithm, in which clusters are merged by maximum average dot product and not, for example, by minimum distance or within-cluster variance.
We demonstrate that the tree output by this algorithm provides a bona fide estimate of generative hierarchical structure in data, under a generic probabilistic graphical model.
arXiv Detail & Related papers (2023-05-24T11:05:12Z) - Optimal Sparse Regression Trees [24.03491277969824]
This work proposes a dynamic-programming-with-bounds approach to the construction of provably-optimal sparse regression trees.
We leverage a novel lower bound based on an optimal solution to the k-Means clustering algorithm in 1-dimension over the set of labels.
arXiv Detail & Related papers (2022-11-28T00:43:21Z) - SETAR-Tree: A Novel and Accurate Tree Algorithm for Global Time Series
Forecasting [7.206754802573034]
In this paper, we explore the close connections between TAR models and regression trees.
We introduce a new forecasting-specific tree algorithm that trains global Pooled Regression (PR) models in the leaves.
In our evaluation, the proposed tree and forest models are able to achieve significantly higher accuracy than a set of state-of-the-art tree-based algorithms.
arXiv Detail & Related papers (2022-11-16T04:30:42Z) - MurTree: Optimal Classification Trees via Dynamic Programming and Search [61.817059565926336]
We present a novel algorithm for learning optimal classification trees based on dynamic programming and search.
Our approach uses only a fraction of the time required by the state-of-the-art and can handle datasets with tens of thousands of instances.
arXiv Detail & Related papers (2020-07-24T17:06:55Z) - Generalized and Scalable Optimal Sparse Decision Trees [56.35541305670828]
We present techniques that produce optimal decision trees over a variety of objectives.
We also introduce a scalable algorithm that produces provably optimal results in the presence of continuous variables.
arXiv Detail & Related papers (2020-06-15T19:00:11Z) - ENTMOOT: A Framework for Optimization over Ensemble Tree Models [57.98561336670884]
ENTMOOT is a framework for integrating tree models into larger optimization problems.
We show how ENTMOOT allows a simple integration of tree models into decision-making and black-box optimization.
arXiv Detail & Related papers (2020-03-10T14:34:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.