Active Learning-Based Multistage Sequential Decision-Making Model with
Application on Common Bile Duct Stone Evaluation
- URL: http://arxiv.org/abs/2201.04807v1
- Date: Thu, 13 Jan 2022 06:42:12 GMT
- Title: Active Learning-Based Multistage Sequential Decision-Making Model with
Application on Common Bile Duct Stone Evaluation
- Authors: Hongzhen Tian, Reuven Zev Cohen, Chuck Zhang, Yajun Mei
- Abstract summary: Multistage sequential decision-making scenarios are commonly seen in the healthcare diagnosis process.
In this paper, an active learning-based method is developed to actively collect only the necessary patient data in a sequential manner.
The effectiveness of the proposed method is validated in both a simulation study and a real case study.
- Score: 8.296821186083974
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Multistage sequential decision-making scenarios are commonly seen in the
healthcare diagnosis process. In this paper, an active learning-based method is
developed to actively collect only the necessary patient data in a sequential
manner. There are two novelties in the proposed method. First, unlike the
existing ordinal logistic regression model which only models a single stage, we
estimate the parameters for all stages together. Second, it is assumed that the
coefficients for common features in different stages are kept consistent. The
effectiveness of the proposed method is validated in both a simulation study
and a real case study. Compared with the baseline method where the data is
modeled individually and independently, the proposed method improves the
estimation efficiency by 62\%-1838\%. For both simulation and testing cohorts,
the proposed method is more effective, stable, interpretable, and
computationally efficient on parameter estimation. The proposed method can be
easily extended to a variety of scenarios where decision-making can be done
sequentially with only necessary information.
Related papers
- Robust CATE Estimation Using Novel Ensemble Methods [0.8246494848934447]
estimation of Conditional Average Treatment Effects (CATE) is crucial for understanding the heterogeneity of treatment effects in clinical trials.
We evaluate the performance of common methods, including causal forests and various meta-learners, across a diverse set of scenarios.
We propose two new ensemble methods that integrate multiple estimators to enhance prediction stability and performance.
arXiv Detail & Related papers (2024-07-04T07:23:02Z) - Globally-Optimal Greedy Experiment Selection for Active Sequential
Estimation [1.1530723302736279]
We study the problem of active sequential estimation, which involves adaptively selecting experiments for sequentially collected data.
The goal is to design experiment selection rules for more accurate model estimation.
We propose a class of greedy experiment selection methods and provide statistical analysis for the maximum likelihood.
arXiv Detail & Related papers (2024-02-13T17:09:29Z) - An Information-Theoretic Approach for Estimating Scenario Generalization
in Crowd Motion Prediction [27.10815774845461]
We propose a novel scoring method, which characterizes generalization of models trained on source crowd scenarios and applied to target crowd scenarios.
The Interaction component aims to characterize the difficulty of scenario domains, while the diversity of a scenario domain is captured in the Diversity score.
Our experimental results validate the efficacy of the proposed method on several simulated and real-world (source,target) generalization tasks.
arXiv Detail & Related papers (2022-11-02T01:39:30Z) - Random Actions vs Random Policies: Bootstrapping Model-Based Direct
Policy Search [0.0]
This paper studies the impact of the initial data gathering method on the subsequent learning of a dynamics model.
Dynamics models approximate the true transition function of a given task, in order to perform policy search directly on the model.
arXiv Detail & Related papers (2022-10-21T08:26:10Z) - Coordinated Double Machine Learning [8.808993671472349]
This paper argues that a carefully coordinated learning algorithm for deep neural networks may reduce the estimation bias.
The improved empirical performance of the proposed method is demonstrated through numerical experiments on both simulated and real data.
arXiv Detail & Related papers (2022-06-02T05:56:21Z) - Sampling from Arbitrary Functions via PSD Models [55.41644538483948]
We take a two-step approach by first modeling the probability distribution and then sampling from that model.
We show that these models can approximate a large class of densities concisely using few evaluations, and present a simple algorithm to effectively sample from these models.
arXiv Detail & Related papers (2021-10-20T12:25:22Z) - MINIMALIST: Mutual INformatIon Maximization for Amortized Likelihood
Inference from Sampled Trajectories [61.3299263929289]
Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice.
One class of methods uses data simulated with different parameters to infer an amortized estimator for the likelihood-to-evidence ratio.
We show that this approach can be formulated in terms of mutual information between model parameters and simulated data.
arXiv Detail & Related papers (2021-06-03T12:59:16Z) - Scalable Personalised Item Ranking through Parametric Density Estimation [53.44830012414444]
Learning from implicit feedback is challenging because of the difficult nature of the one-class problem.
Most conventional methods use a pairwise ranking approach and negative samplers to cope with the one-class problem.
We propose a learning-to-rank approach, which achieves convergence speed comparable to the pointwise counterpart.
arXiv Detail & Related papers (2021-05-11T03:38:16Z) - Control as Hybrid Inference [62.997667081978825]
We present an implementation of CHI which naturally mediates the balance between iterative and amortised inference.
We verify the scalability of our algorithm on a continuous control benchmark, demonstrating that it outperforms strong model-free and model-based baselines.
arXiv Detail & Related papers (2020-07-11T19:44:09Z) - Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking
Fairness and Algorithm Utility [54.179859639868646]
Bipartite ranking aims to learn a scoring function that ranks positive individuals higher than negative ones from labeled data.
There have been rising concerns on whether the learned scoring function can cause systematic disparity across different protected groups.
We propose a model post-processing framework for balancing them in the bipartite ranking scenario.
arXiv Detail & Related papers (2020-06-15T10:08:39Z) - Efficient Ensemble Model Generation for Uncertainty Estimation with
Bayesian Approximation in Segmentation [74.06904875527556]
We propose a generic and efficient segmentation framework to construct ensemble segmentation models.
In the proposed method, ensemble models can be efficiently generated by using the layer selection method.
We also devise a new pixel-wise uncertainty loss, which improves the predictive performance.
arXiv Detail & Related papers (2020-05-21T16:08:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.