Self-Attention Enhanced Patient Journey Understanding in Healthcare System

• URL: http://arxiv.org/abs/2006.10516v2
• Date: Fri, 19 Jun 2020 01:04:22 GMT
• Title: Self-Attention Enhanced Patient Journey Understanding in Healthcare System
• Authors: Xueping Peng, Guodong Long, Tao Shen, Sen Wang, Jing Jiang
• Abstract summary: MusaNet is designed to learn the representations of patient journeys that is used to be a long sequence of activities. The MusaNet is trained in end-to-end manner using the training data derived from EHRs. Results have demonstrated the proposed MusaNet produces higher-quality representations than state-of-the-art baseline methods.
• Score: 43.11457142941327
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding patients' journeys in healthcare system is a fundamental prepositive task for a broad range of AI-based healthcare applications. This task aims to learn an informative representation that can comprehensively encode hidden dependencies among medical events and its inner entities, and then the use of encoding outputs can greatly benefit the downstream application-driven tasks. A patient journey is a sequence of electronic health records (EHRs) over time that is organized at multiple levels: patient, visits and medical codes. The key challenge of patient journey understanding is to design an effective encoding mechanism which can properly tackle the aforementioned multi-level structured patient journey data with temporal sequential visits and a set of medical codes. This paper proposes a novel self-attention mechanism that can simultaneously capture the contextual and temporal relationships hidden in patient journeys. A multi-level self-attention network (MusaNet) is specifically designed to learn the representations of patient journeys that is used to be a long sequence of activities. The MusaNet is trained in end-to-end manner using the training data derived from EHRs. We evaluated the efficacy of our method on two medical application tasks with real-world benchmark datasets. The results have demonstrated the proposed MusaNet produces higher-quality representations than state-of-the-art baseline methods. The source code is available in https://github.com/xueping/MusaNet.

Related papers

• NOTE: Notable generation Of patient Text summaries through Efficient approach based on direct preference optimization [0.0]
  "NOTE" stands for "Notable generation Of patient Text summaries through an Efficient approach based on direct preference optimization" Patient events are sequentially combined and used to generate a discharge summary for each hospitalization. Note can be utilized to generate various summaries not only discharge summaries but also throughout a patient's journey.
  arXiv  Detail & Related papers  (2024-02-19T06:43:25Z)
• Clairvoyance: A Pipeline Toolkit for Medical Time Series [95.22483029602921]
  Time-series learning is the bread and butter of data-driven *clinical decision support* Clairvoyance proposes a unified, end-to-end, autoML-friendly pipeline that serves as a software toolkit. Clairvoyance is the first to demonstrate viability of a comprehensive and automatable pipeline for clinical time-series ML.
  arXiv  Detail & Related papers  (2023-10-28T12:08:03Z)
• ViMQ: A Vietnamese Medical Question Dataset for Healthcare Dialogue System Development [1.4315915057750197]
  We publish a Vietnamese dataset of medical questions from patients with sentence-level and entity-level annotations. We propose a simple self-supervised training strategy with span-noise modelling that improves the performance.
  arXiv  Detail & Related papers  (2023-04-27T17:59:53Z)
• MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning [49.57261599776167]
  We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
  arXiv  Detail & Related papers  (2021-07-20T07:04:52Z)
• Multitask Recalibrated Aggregation Network for Medical Code Prediction [19.330911490203317]
  We propose a multitask recalibrated aggregation network to solve the challenges of encoding lengthy and noisy clinical documents. In particular, multitask learning shares information across different coding schemes and captures the dependencies between different medical codes. Experiments with a real-world MIMIC-III dataset show significantly improved predictive performance.
  arXiv  Detail & Related papers  (2021-04-02T09:22:10Z)
• Medical Code Assignment with Gated Convolution and Note-Code Interaction [39.079615516043674]
  We propose a novel method, gated convolutional neural networks, and a note-code interaction (GatedCNN-NCI) for automatic medical code assignment. With a novel note-code interaction design and a graph message passing mechanism, we explicitly capture the underlying dependency between notes and codes. Our proposed model outperforms state-of-the-art models in most cases, and our model size is on par with light-weighted baselines.
  arXiv  Detail & Related papers  (2020-10-14T11:37:24Z)
• BiteNet: Bidirectional Temporal Encoder Network to Predict Medical Outcomes [53.163089893876645]
  We propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey. An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys. We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset.
  arXiv  Detail & Related papers  (2020-09-24T00:42:36Z)
• Learning Contextualized Document Representations for Healthcare Answer Retrieval [68.02029435111193]
  Contextual Discourse Vectors (CDV) is a distributed document representation for efficient answer retrieval from long documents. Our model leverages a dual encoder architecture with hierarchical LSTM layers and multi-task training to encode the position of clinical entities and aspects alongside the document discourse. We show that our generalized model significantly outperforms several state-of-the-art baselines for healthcare passage ranking.
  arXiv  Detail & Related papers  (2020-02-03T15:47:19Z)
• DeepEnroll: Patient-Trial Matching with Deep Embedding and Entailment Prediction [67.91606509226132]
  Clinical trials are essential for drug development but often suffer from expensive, inaccurate and insufficient patient recruitment. DeepEnroll is a cross-modal inference learning model to jointly encode enrollment criteria (tabular data) into a shared latent space for matching inference.
  arXiv  Detail & Related papers  (2020-01-22T17:51:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.