Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysis

• URL: http://arxiv.org/abs/2106.12658v1
• Date: Wed, 23 Jun 2021 21:29:50 GMT
• Title: Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysis
• Authors: Xianlong Zeng, Simon Lin, Chang Liu
• Abstract summary: Transformer-based Multimodal AutoEncoder (TMAE) can learn efficient patient representation by encoding meaningful information from the claims data. We trained TMAE using a real-world pediatric claims dataset containing more than 600,000 patients.
• Score: 3.5492837081144204
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The claims data, containing medical codes, services information, and incurred expenditure, can be a good resource for estimating an individual's health condition and medical risk level. In this study, we developed Transformer-based Multimodal AutoEncoder (TMAE), an unsupervised learning framework that can learn efficient patient representation by encoding meaningful information from the claims data. TMAE is motivated by the practical needs in healthcare to stratify patients into different risk levels for improving care delivery and management. Compared to previous approaches, TMAE is able to 1) model inpatient, outpatient, and medication claims collectively, 2) handle irregular time intervals between medical events, 3) alleviate the sparsity issue of the rare medical codes, and 4) incorporate medical expenditure information. We trained TMAE using a real-world pediatric claims dataset containing more than 600,000 patients and compared its performance with various approaches in two clustering tasks. Experimental results demonstrate that TMAE has superior performance compared to all baselines. Multiple downstream applications are also conducted to illustrate the effectiveness of our framework. The promising results confirm that the TMAE framework is scalable to large claims data and is able to generate efficient patient embeddings for risk stratification and analysis.

Related papers

• AIPatient: Simulating Patients with EHRs and LLM Powered Agentic Workflow [33.8495939261319]
  We develop an advanced simulated patient system with AIPatient Knowledge Graph (AIPatient KG) as the input and Reasoning Retrieval-Augmented Generation (Reasoning RAG) as the generation backbone. Reasoning RAG leverages six LLM powered agents spanning tasks including retrieval, KG query generation, abstraction, checker, rewrite, and summarization. Our system also presents high readability (median Flesch Reading Ease 77.23; median Flesch Kincaid Grade 5.6), robustness (ANOVA F-value 0.6126, p>0.1), and stability (ANOVA F-value 0.782, p>0.1)
  arXiv  Detail & Related papers  (2024-09-27T17:17:15Z)
• TrialBench: Multi-Modal Artificial Intelligence-Ready Clinical Trial Datasets [57.067409211231244]
  This paper presents meticulously curated AIready datasets covering multi-modal data (e.g., drug molecule, disease code, text, categorical/numerical features) and 8 crucial prediction challenges in clinical trial design. We provide basic validation methods for each task to ensure the datasets' usability and reliability. We anticipate that the availability of such open-access datasets will catalyze the development of advanced AI approaches for clinical trial design.
  arXiv  Detail & Related papers  (2024-06-30T09:13:10Z)
• XAI for In-hospital Mortality Prediction via Multimodal ICU Data [57.73357047856416]
  We propose an efficient, explainable AI solution for predicting in-hospital mortality via multimodal ICU data. We employ multimodal learning in our framework, which can receive heterogeneous inputs from clinical data and make decisions. Our framework can be easily transferred to other clinical tasks, which facilitates the discovery of crucial factors in healthcare research.
  arXiv  Detail & Related papers  (2023-12-29T14:28:04Z)
• DR-VIDAL -- Doubly Robust Variational Information-theoretic Deep Adversarial Learning for Counterfactual Prediction and Treatment Effect Estimation on Real World Data [7.712429926730386]
  Causal deep learning has improved over traditional techniques for estimating individualized treatment effects. We present DR-VIDAL, a novel generative framework that combines two joint models of treatment and outcome. DR-VIDAL achieves better performance than other non-generative and generative methods on synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-03-07T19:44:58Z)
• Modelling Patient Trajectories Using Multimodal Information [0.0]
  We propose a solution to model patient trajectories that combines different types of information and considers the temporal aspect of clinical data. The developed solution was evaluated on two different clinical outcomes, unexpected patient readmission and disease progression.
  arXiv  Detail & Related papers  (2022-09-09T10:20:54Z)
• Robust and Efficient Medical Imaging with Self-Supervision [80.62711706785834]
  We present REMEDIS, a unified representation learning strategy to improve robustness and data-efficiency of medical imaging AI. We study a diverse range of medical imaging tasks and simulate three realistic application scenarios using retrospective data.
  arXiv  Detail & Related papers  (2022-05-19T17:34:18Z)
• MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning [49.57261599776167]
  We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
  arXiv  Detail & Related papers  (2021-07-20T07:04:52Z)
• HINT: Hierarchical Interaction Network for Trial Outcome Prediction Leveraging Web Data [56.53715632642495]
  Clinical trials face uncertain outcomes due to issues with efficacy, safety, or problems with patient recruitment. In this paper, we propose Hierarchical INteraction Network (HINT) for more general, clinical trial outcome predictions.
  arXiv  Detail & Related papers  (2021-02-08T15:09:07Z)
• FIT: a Fast and Accurate Framework for Solving Medical Inquiring and Diagnosing Tasks [10.687562550605739]
  Self-diagnosis provides low-cost and accessible healthcare via an agent that queries the patient and makes predictions about possible diseases. We propose a competitive framework, called FIT, which uses an information-theoretic reward to determine what data to collect next. Our results in two simulated datasets show that FIT can effectively deal with large search space problems, outperforming existing baselines.
  arXiv  Detail & Related papers  (2020-12-02T10:12:49Z)
• BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes [53.163089893876645]
  We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey. An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys. We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
  arXiv  Detail & Related papers  (2020-09-24T00:42:36Z)
• CovidCare: Transferring Knowledge from Existing EMR to Emerging Epidemic for Interpretable Prognosis [20.701122594508675]
  We propose a deep-learning-based approach, CovidCare, to enhance the prognosis for inpatients with emerging infectious diseases. CovidCare learns to embed the COVID-19-related medical features based on massive existing EMR data via transfer learning. We conduct the length of stay prediction experiments for patients on a real-world COVID-19 dataset.
  arXiv  Detail & Related papers  (2020-07-17T09:20:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.