Multimodal Learning for Cardiovascular Risk Prediction using EHR Data
- URL: http://arxiv.org/abs/2008.11979v1
- Date: Thu, 27 Aug 2020 08:09:02 GMT
- Title: Multimodal Learning for Cardiovascular Risk Prediction using EHR Data
- Authors: Ayoub Bagheri, T. Katrien J. Groenhof, Wouter B. Veldhuis, Pim A. de
Jong, Folkert W. Asselbergs, Daniel L. Oberski
- Abstract summary: We propose a recurrent neural network model for cardiovascular risk prediction that integrates both medical texts and structured clinical information.
BiLSTM model embeds word embeddings to classical clinical predictors before applying them to a final fully connected neural network.
evaluated on a data set of real world patients with manifest vascular disease or at high-risk for cardiovascular disease.
- Score: 0.9805331696863404
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Electronic health records (EHRs) contain structured and unstructured data of
significant clinical and research value. Various machine learning approaches
have been developed to employ information in EHRs for risk prediction. The
majority of these attempts, however, focus on structured EHR fields and lose
the vast amount of information in the unstructured texts. To exploit the
potential information captured in EHRs, in this study we propose a multimodal
recurrent neural network model for cardiovascular risk prediction that
integrates both medical texts and structured clinical information. The proposed
multimodal bidirectional long short-term memory (BiLSTM) model concatenates
word embeddings to classical clinical predictors before applying them to a
final fully connected neural network. In the experiments, we compare
performance of different deep neural network (DNN) architectures including
convolutional neural network and long short-term memory in scenarios of using
clinical variables and chest X-ray radiology reports. Evaluated on a data set
of real world patients with manifest vascular disease or at high-risk for
cardiovascular disease, the proposed BiLSTM model demonstrates state-of-the-art
performance and outperforms other DNN baseline architectures.
Related papers
- EVENet: Evidence-based Ensemble Learning for Uncertainty-aware Brain Parcellation Using Diffusion MRI [5.757390718589337]
We develop an Evidence-based Ensemble Neural Network, namely EVENet, for anatomical brain parcellation using diffusion MRI.
We obtained accurate parcellation and uncertainty estimates across different datasets from healthy and clinical populations.
Thanks to the uncertainty estimation, our EVENet approach demonstrates a good ability to detect abnormal brain regions in patients with lesions.
arXiv Detail & Related papers (2024-09-11T05:26:23Z) - Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
In this study, we first construct the brain-effective network via the dynamic causal model.
We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE)
This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
arXiv Detail & Related papers (2024-05-21T20:37:07Z) - A Sentiment Analysis of Medical Text Based on Deep Learning [1.8130068086063336]
This paper focuses on the medical domain, using bidirectional encoder representations from transformers (BERT) as the basic pre-trained model.
Experiments and analyses were conducted on the METS-CoV dataset to explore the training performance after integrating different deep learning networks.
CNN models outperform other networks when trained on smaller medical text datasets in combination with pre-trained models like BERT.
arXiv Detail & Related papers (2024-04-16T12:20:49Z) - Radiology Report Generation Using Transformers Conditioned with
Non-imaging Data [55.17268696112258]
This paper proposes a novel multi-modal transformer network that integrates chest x-ray (CXR) images and associated patient demographic information.
The proposed network uses a convolutional neural network to extract visual features from CXRs and a transformer-based encoder-decoder network that combines the visual features with semantic text embeddings of patient demographic information.
arXiv Detail & Related papers (2023-11-18T14:52:26Z) - MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data
Augmentation [58.93221876843639]
This paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion.
It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space.
It discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data.
arXiv Detail & Related papers (2023-10-04T01:36:30Z) - SurvLatent ODE : A Neural ODE based time-to-event model with competing
risks for longitudinal data improves cancer-associated Deep Vein Thrombosis
(DVT) prediction [68.8204255655161]
We propose a generative time-to-event model, SurvLatent ODE, which parameterizes a latent representation under irregularly sampled data.
Our model then utilizes the latent representation to flexibly estimate survival times for multiple competing events without specifying shapes of event-specific hazard function.
SurvLatent ODE outperforms the current clinical standard Khorana Risk scores for stratifying DVT risk groups.
arXiv Detail & Related papers (2022-04-20T17:28:08Z) - Simple Recurrent Neural Networks is all we need for clinical events
predictions using EHR data [22.81278657120305]
Recurrent neural networks (RNNs) are common architecture for EHR-based clinical events predictive models.
We used two prediction tasks: the risk for developing heart failure and the risk of early readmission for inpatient hospitalization.
We found that simple gated RNN models, including GRUs and LSTMs, often offer competitive results when properly tuned with Bayesian Optimization.
arXiv Detail & Related papers (2021-10-03T13:07:23Z) - PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive
Learning [109.84770951839289]
We present PredRNN, a new recurrent network for learning visual dynamics from historical context.
We show that our approach obtains highly competitive results on three standard datasets.
arXiv Detail & Related papers (2021-03-17T08:28:30Z) - Deep sr-DDL: Deep Structurally Regularized Dynamic Dictionary Learning to Integrate Multimodal and Dynamic Functional Connectomics data for Multidimensional Clinical Characterizations [5.200461964737113]
We propose a novel integrated framework that jointly models complementary information from resting-state functional MRI (rs-fMRI) connectivity and diffusion tensor imaging (DTI) tractography.
Our framework couples a generative model of the connectomics data with a deep network that predicts behavioral scores.
Our hybrid model outperforms several state-of-the-art approaches at clinical outcome prediction and learns interpretable multimodal neural signatures of brain organization.
arXiv Detail & Related papers (2020-08-27T23:43:56Z) - A Dynamic Deep Neural Network For Multimodal Clinical Data Analysis [12.02718865835448]
AdaptiveNet is a novel recurrent neural network architecture, which can deal with multiple lists of different events.
We employ the architecture to the problem of disease progression prediction in rheumatoid arthritis using the Swiss Clinical Quality Management registry.
arXiv Detail & Related papers (2020-08-14T11:19:32Z) - Predicting Clinical Diagnosis from Patients Electronic Health Records
Using BERT-based Neural Networks [62.9447303059342]
We show the importance of this problem in medical community.
We present a modification of Bidirectional Representations from Transformers (BERT) model for classification sequence.
We use a large-scale Russian EHR dataset consisting of about 4 million unique patient visits.
arXiv Detail & Related papers (2020-07-15T09:22:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.