A New Deep State-Space Analysis Framework for Patient Latent State
Estimation and Classification from EHR Time Series Data
- URL: http://arxiv.org/abs/2307.11487v1
- Date: Fri, 21 Jul 2023 10:45:08 GMT
- Title: A New Deep State-Space Analysis Framework for Patient Latent State
Estimation and Classification from EHR Time Series Data
- Authors: Aya Nakamura, Ryosuke Kojima, Yuji Okamoto, Eiichiro Uchino, Yohei
Mineharu, Yohei Harada, Mayumi Kamada, Manabu Muto, Motoko Yanagita, Yasushi
Okuno
- Abstract summary: We propose the "deep state-space analysis framework," using time-series unsupervised learning of EHRs with a deep state-space model.
This framework enables learning, visualizing, and clustering of temporal changes in patient latent states related to disease progression.
We evaluated our framework using time-series laboratory data from 12,695 cancer patients.
- Score: 1.0970480513577103
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many diseases, including cancer and chronic conditions, require extended
treatment periods and long-term strategies. Machine learning and AI research
focusing on electronic health records (EHRs) have emerged to address this need.
Effective treatment strategies involve more than capturing sequential changes
in patient test values. It requires an explainable and clinically interpretable
model by capturing the patient's internal state over time.
In this study, we propose the "deep state-space analysis framework," using
time-series unsupervised learning of EHRs with a deep state-space model. This
framework enables learning, visualizing, and clustering of temporal changes in
patient latent states related to disease progression.
We evaluated our framework using time-series laboratory data from 12,695
cancer patients. By estimating latent states, we successfully discover latent
states related to prognosis. By visualization and cluster analysis, the
temporal transition of patient status and test items during state transitions
characteristic of each anticancer drug were identified. Our framework surpasses
existing methods in capturing interpretable latent space. It can be expected to
enhance our comprehension of disease progression from EHRs, aiding treatment
adjustments and prognostic determinations.
Related papers
- Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events.
Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
arXiv Detail & Related papers (2024-07-28T02:42:36Z) - Semi-Supervised Generative Models for Disease Trajectories: A Case Study on Systemic Sclerosis [0.04057716989497714]
We propose a deep generative approach using latent temporal processes for modeling and holistically analyzing complex disease trajectories.
By combining the generative approach with medical definitions of different characteristics of Systemic Sclerosis, we facilitate the discovery of new aspects of the disease.
We show that the learned temporal latent processes can be utilized for further data analysis and clinical hypothesis testing, including finding similar patients and clustering SSc patient trajectories into novel sub-types.
arXiv Detail & Related papers (2024-07-16T06:45:27Z) - Modeling Complex Disease Trajectories using Deep Generative Models with
Semi-Supervised Latent Processes [0.04818215922729969]
We develop a semi-supervised approach for disentangling the latent space using established medical concepts.
We show that the learned temporal latent processes can be utilized for further data analysis and clinical hypothesis testing.
arXiv Detail & Related papers (2023-11-14T13:25:41Z) - Safe AI for health and beyond -- Monitoring to transform a health
service [51.8524501805308]
We will assess the infrastructure required to monitor the outputs of a machine learning algorithm.
We will present two scenarios with examples of monitoring and updates of models.
arXiv Detail & Related papers (2023-03-02T17:27:45Z) - Learning Spatio-Temporal Model of Disease Progression with NeuralODEs
from Longitudinal Volumetric Data [4.998875488622879]
We develop a deep learning method that models the evolution of age-related disease by processing a single medical scan.
For Geographic Atrophy, the proposed method outperformed the related baseline models in the atrophy growth prediction.
For Alzheimer's Disease, the proposed method demonstrated remarkable performance in predicting the brain ventricle changes induced by the disease.
arXiv Detail & Related papers (2022-11-08T13:28:26Z) - COPER: Continuous Patient State Perceiver [13.735956129637945]
We propose a novel COntinuous patient state PERceiver model, called COPER, to cope with irregular time-series in EHRs.
neural ordinary differential equations (ODEs) help COPER to generate regular time-series to feed to Perceiver model.
To evaluate the performance of the proposed model, we use in-hospital mortality prediction task on MIMIC-III dataset.
arXiv Detail & Related papers (2022-08-05T14:32:57Z) - MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response [58.0291320452122]
This paper aims at a unified deep learning approach to predict patient prognosis and therapy response.
We formalize the prognosis modeling as a multi-modal asynchronous time series classification task.
Our predictive model could further stratify low-risk and high-risk patients in terms of long-term survival.
arXiv Detail & Related papers (2020-10-08T15:30:17Z) - BiteNet: Bidirectional Temporal Encoder Network to Predict Medical
Outcomes [53.163089893876645]
We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey.
An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys.
We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
arXiv Detail & Related papers (2020-09-24T00:42:36Z) - Trajectories, bifurcations and pseudotime in large clinical datasets:
applications to myocardial infarction and diabetes data [94.37521840642141]
We suggest a semi-supervised methodology for the analysis of large clinical datasets, characterized by mixed data types and missing values.
The methodology is based on application of elastic principal graphs which can address simultaneously the tasks of dimensionality reduction, data visualization, clustering, feature selection and quantifying the geodesic distances (pseudotime) in partially ordered sequences of observations.
arXiv Detail & Related papers (2020-07-07T21:04:55Z) - Deep Recurrent Model for Individualized Prediction of Alzheimer's
Disease Progression [4.034948808542701]
Alzheimer's disease (AD) is one of the major causes of dementia and is characterized by slow progression over several years.
We propose a novel computational framework that can predict the phenotypic measurements of MRI biomarkers and trajectories of clinical status.
arXiv Detail & Related papers (2020-05-06T08:08:00Z) - Estimating Counterfactual Treatment Outcomes over Time Through
Adversarially Balanced Representations [114.16762407465427]
We introduce the Counterfactual Recurrent Network (CRN) to estimate treatment effects over time.
CRN uses domain adversarial training to build balancing representations of the patient history.
We show how our model achieves lower error in estimating counterfactuals and in choosing the correct treatment and timing of treatment.
arXiv Detail & Related papers (2020-02-10T20:47:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.