Patient Trajectory Prediction: Integrating Clinical Notes with Transformers

• URL: http://arxiv.org/abs/2502.18009v1
• Date: Tue, 25 Feb 2025 09:14:07 GMT
• Title: Patient Trajectory Prediction: Integrating Clinical Notes with Transformers
• Authors: Sifal Klioui, Sana Sellami, Youssef Trardi,
• Abstract summary: We propose an approach that integrates unstructured clinical notes into transformer-based deep learning models for sequential disease prediction.<n> Experiments on MIMIC-IV datasets demonstrate that the proposed approach outperforms traditional models relying solely on structured data.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Predicting disease trajectories from electronic health records (EHRs) is a complex task due to major challenges such as data non-stationarity, high granularity of medical codes, and integration of multimodal data. EHRs contain both structured data, such as diagnostic codes, and unstructured data, such as clinical notes, which hold essential information often overlooked. Current models, primarily based on structured data, struggle to capture the complete medical context of patients, resulting in a loss of valuable information. To address this issue, we propose an approach that integrates unstructured clinical notes into transformer-based deep learning models for sequential disease prediction. This integration enriches the representation of patients' medical histories, thereby improving the accuracy of diagnosis predictions. Experiments on MIMIC-IV datasets demonstrate that the proposed approach outperforms traditional models relying solely on structured data.

Related papers

• Continually Evolved Multimodal Foundation Models for Cancer Prognosis [50.43145292874533]
  Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates.<n>Previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic data, leveraging their complementary information.<n>Existing approaches face two major limitations. First, they struggle to incorporate newly arrived data with varying distributions into training, such as patient records from different hospitals.<n>Second, most multimodal integration methods rely on simplistic concatenation or task-specific pipelines, which fail to capture the complex interdependencies across modalities.
  arXiv  Detail & Related papers  (2025-01-30T06:49:57Z)
• Electronic Health Records: Towards Digital Twins in Healthcare [1.702436955667761]
  This chapter explores the evolution and significance of healthcare information systems.<n>It begins with an examination of the implementation of EHR in the UK and the USA.<n>It provides a comprehensive overview of the International Classification of Diseases (ICD) system, tracing its development from ICD-9 to ICD-10.<n>Central to this discussion is the MIMIC-III database, a landmark achievement in healthcare data sharing and arguably the most comprehensive critical care database freely available to researchers worldwide.
  arXiv  Detail & Related papers  (2025-01-16T16:30:02Z)
• Evaluating the Predictive Features of Person-Centric Knowledge Graph Embeddings: Unfolding Ablation Studies [0.757843972001219]
  We propose a systematic approach to examine the results of GNN models trained with structured and unstructured information from the MIMIC-III dataset. We show the robustness of this approach in identifying predictive features in PKGs for the task of readmission prediction.
  arXiv  Detail & Related papers  (2024-08-27T09:48:25Z)
• Knowledge Graph Representations to enhance Intensive Care Time-Series Predictions [4.660203987415476]
  Our proposed methodology integrates medical knowledge with ICU data, improving clinical decision modeling. It combines graph representations with vital signs and clinical reports, enhancing performance. Our model includes an interpretability component to understand how knowledge graph nodes affect predictions.
  arXiv  Detail & Related papers  (2023-11-13T09:11:55Z)
• MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation [58.93221876843639]
  This paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion. It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space. It discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data.
  arXiv  Detail & Related papers  (2023-10-04T01:36:30Z)
• A Transformer-based representation-learning model with unified processing of multimodal input for clinical diagnostics [63.106382317917344]
  We report a Transformer-based representation-learning model as a clinical diagnostic aid that processes multimodal input in a unified manner. The unified model outperformed an image-only model and non-unified multimodal diagnosis models in the identification of pulmonary diseases.
  arXiv  Detail & Related papers  (2023-06-01T16:23:47Z)
• P-Transformer: A Prompt-based Multimodal Transformer Architecture For Medical Tabular Data [2.6487114372147182]
  We propose P-Transformer, a Prompt-based multimodal Transformer architecture designed specifically for medical tabular data. The framework efficiently encodes diverse modalities from both structured and unstructured data into a harmonized language semantic space. P-Transformer demonstrated the improvements with 10.9%/11.0% on RMSE/MAE, 0.5%/2.2% on RMSE/MAE, and 1.6%/0.8% on BACC/AUROC compared to state-of-the-art (SOTA) baselines in predictability.
  arXiv  Detail & Related papers  (2023-03-30T14:25:44Z)
• sEHR-CE: Language modelling of structured EHR data for efficient and generalizable patient cohort expansion [0.0]
  sEHR-CE is a novel framework based on transformers to enable integrated phenotyping and analyses of heterogeneous clinical datasets. We validate our approach using primary and secondary care data from the UK Biobank, a large-scale research study.
  arXiv  Detail & Related papers  (2022-11-30T16:00:43Z)
• MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning [49.57261599776167]
  We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
  arXiv  Detail & Related papers  (2021-07-20T07:04:52Z)
• Predicting Clinical Diagnosis from Patients Electronic Health Records Using BERT-based Neural Networks [62.9447303059342]
  We show the importance of this problem in medical community. We present a modification of Bidirectional Representations from Transformers (BERT) model for classification sequence. We use a large-scale Russian EHR dataset consisting of about 4 million unique patient visits.
  arXiv  Detail & Related papers  (2020-07-15T09:22:55Z)
• Trajectories, bifurcations and pseudotime in large clinical datasets: applications to myocardial infarction and diabetes data [94.37521840642141]
  We suggest a semi-supervised methodology for the analysis of large clinical datasets, characterized by mixed data types and missing values. The methodology is based on application of elastic principal graphs which can address simultaneously the tasks of dimensionality reduction, data visualization, clustering, feature selection and quantifying the geodesic distances (pseudotime) in partially ordered sequences of observations.
  arXiv  Detail & Related papers  (2020-07-07T21:04:55Z)
• A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records [0.5672132510411464]
  We develop and publish a Python package to transform public health dataset into easy to access universal format. We propose two novel model architectures to predict multiple diagnoses simultaneously. Both models can predict multiple diagnoses simultaneously with high accuracy.
  arXiv  Detail & Related papers  (2020-06-23T14:58:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.