Medical Dead-ends and Learning to Identify High-risk States and
Treatments
- URL: http://arxiv.org/abs/2110.04186v1
- Date: Fri, 8 Oct 2021 15:13:20 GMT
- Title: Medical Dead-ends and Learning to Identify High-risk States and
Treatments
- Authors: Mehdi Fatemi, Taylor W. Killian, Jayakumar Subramanian, Marzyeh
Ghassemi
- Abstract summary: We introduce an inherently different approach that identifies possible dead-ends'' of a state space.
We focus on the condition of patients in the intensive care unit, where a medical dead-end'' indicates that a patient will expire, regardless of all potential future treatment sequences.
- Score: 7.821495984906274
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Machine learning has successfully framed many sequential decision making
problems as either supervised prediction, or optimal decision-making policy
identification via reinforcement learning. In data-constrained offline
settings, both approaches may fail as they assume fully optimal behavior or
rely on exploring alternatives that may not exist. We introduce an inherently
different approach that identifies possible ``dead-ends'' of a state space. We
focus on the condition of patients in the intensive care unit, where a
``medical dead-end'' indicates that a patient will expire, regardless of all
potential future treatment sequences. We postulate ``treatment security'' as
avoiding treatments with probability proportional to their chance of leading to
dead-ends, present a formal proof, and frame discovery as an RL problem. We
then train three independent deep neural models for automated state
construction, dead-end discovery and confirmation. Our empirical results
discover that dead-ends exist in real clinical data among septic patients, and
further reveal gaps between secure treatments and those that were administered.
Related papers
- Identifying Differential Patient Care Through Inverse Intent Inference [3.4150521058470664]
Sepsis is a life-threatening condition defined by end-organ dysfunction due to a dysregulated host response to infection.
It has been reported in numerous studies that disparities in care exist across the trajectory of patient stay in the emergency department and intensive care unit.
arXiv Detail & Related papers (2024-11-11T21:21:32Z) - Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcare [8.920060884688395]
Reinforcement Learning (RL) applied in healthcare can lead to unsafe medical decisions and treatment, such as excessive dosages or abrupt changes, often due to agents overlooking common-sense constraints.
Recent Inverse Constrained Reinforcement Learning (ICRL) is a promising approach that infers constraints from expert demonstrations.
These settings do not align with the practical requirement of a decision-making system in healthcare, where decisions rely on historical treatment recorded in an offline dataset.
Specifically, 1) we utilize a causal attention mechanism to incorporate historical decisions and observations into the constraint modeling, while employing a Non-Markovian layer for weighted constraints
arXiv Detail & Related papers (2024-10-10T01:36:27Z) - Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events.
Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
arXiv Detail & Related papers (2024-07-28T02:42:36Z) - SepsisLab: Early Sepsis Prediction with Uncertainty Quantification and Active Sensing [67.8991481023825]
Sepsis is the leading cause of in-hospital mortality in the USA.
Existing predictive models are usually trained on high-quality data with few missing information.
For the potential high-risk patients with low confidence due to limited observations, we propose a robust active sensing algorithm.
arXiv Detail & Related papers (2024-07-24T04:47:36Z) - Inadequacy of common stochastic neural networks for reliable clinical
decision support [0.4262974002462632]
Widespread adoption of AI for medical decision making is still hindered due to ethical and safety-related concerns.
Common deep learning approaches, however, have the tendency towards overconfidence under data shift.
This study investigates their actual reliability in clinical applications.
arXiv Detail & Related papers (2024-01-24T18:49:30Z) - Finding Counterfactually Optimal Action Sequences in Continuous State
Spaces [22.84932480886562]
We describe a sequence of discrete actions and continuous states using finite horizon Markov decision processes.
We then develop a search method based on the $A*$ continuity of the environment's dynamics.
Our method is very efficient in practice, and it has the potential to offer interesting insights for sequential decision making tasks.
arXiv Detail & Related papers (2023-06-06T18:00:29Z) - Unsupervised deep learning techniques for powdery mildew recognition
based on multispectral imaging [63.62764375279861]
This paper presents a deep learning approach to automatically recognize powdery mildew on cucumber leaves.
We focus on unsupervised deep learning techniques applied to multispectral imaging data.
We propose the use of autoencoder architectures to investigate two strategies for disease detection.
arXiv Detail & Related papers (2021-12-20T13:29:13Z) - Optimal discharge of patients from intensive care via a data-driven
policy learning framework [58.720142291102135]
It is important that the patient discharge task addresses the nuanced trade-off between decreasing a patient's length of stay and the risk of readmission or even death following the discharge decision.
This work introduces an end-to-end general framework for capturing this trade-off to recommend optimal discharge timing decisions.
A data-driven approach is used to derive a parsimonious, discrete state space representation that captures a patient's physiological condition.
arXiv Detail & Related papers (2021-12-17T04:39:33Z) - Clinical Outcome Prediction from Admission Notes using Self-Supervised
Knowledge Integration [55.88616573143478]
Outcome prediction from clinical text can prevent doctors from overlooking possible risks.
Diagnoses at discharge, procedures performed, in-hospital mortality and length-of-stay prediction are four common outcome prediction targets.
We propose clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources.
arXiv Detail & Related papers (2021-02-08T10:26:44Z) - Enabling Counterfactual Survival Analysis with Balanced Representations [64.17342727357618]
Survival data are frequently encountered across diverse medical applications, i.e., drug development, risk profiling, and clinical trials.
We propose a theoretically grounded unified framework for counterfactual inference applicable to survival outcomes.
arXiv Detail & Related papers (2020-06-14T01:15:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.