A Visual Analytics System for Multi-model Comparison on Clinical Data Predictions

• URL: http://arxiv.org/abs/2002.10998v2
• Date: Mon, 23 Mar 2020 20:08:20 GMT
• Title: A Visual Analytics System for Multi-model Comparison on Clinical Data Predictions
• Authors: Yiran Li, Takanori Fujiwara, Yong K. Choi, Katherine K. Kim, Kwan-Liu Ma
• Abstract summary: We develop a visual analytics system that compares multiple models' prediction criteria and evaluates their consistency. We demonstrate the effectiveness of our system to assist clinicians and researchers in comparing and quantitatively evaluating different machine learning methods.
• Score: 21.86694022749115
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is a growing trend of applying machine learning methods to medical datasets in order to predict patients' future status. Although some of these methods achieve high performance, challenges still exist in comparing and evaluating different models through their interpretable information. Such analytics can help clinicians improve evidence-based medical decision making. In this work, we develop a visual analytics system that compares multiple models' prediction criteria and evaluates their consistency. With our system, users can generate knowledge on different models' inner criteria and how confidently we can rely on each model's prediction for a certain patient. Through a case study of a publicly available clinical dataset, we demonstrate the effectiveness of our visual analytics system to assist clinicians and researchers in comparing and quantitatively evaluating different machine learning methods.

Related papers

• Monitoring fairness in machine learning models that predict patient mortality in the ICU [0.0]
  We investigate how well models perform for patient groups with different race, sex and medical diagnoses. We show how fairness analysis provides a more detailed and insightful comparison of model performance than traditional accuracy metrics alone.
  arXiv  Detail & Related papers  (2024-10-31T20:17:12Z)
• Patient-centered data science: an integrative framework for evaluating and predicting clinical outcomes in the digital health era [0.0]
  This study proposes a novel, integrative framework for patient-centered data science in the digital health era. We developed a multidimensional model that combines traditional clinical data with patient-reported outcomes, social determinants of health, and multi-omic data to create comprehensive digital patient representations.
  arXiv  Detail & Related papers  (2024-07-31T02:36:17Z)
• Ethical considerations of use of hold-out sets in clinical prediction model management [0.4194295877935868]
  We focus on the ethical principles of beneficence, non-maleficence, autonomy and justice. We also discuss statistical issues arising from different hold-out set sampling methods.
  arXiv  Detail & Related papers  (2024-06-05T11:42:46Z)
• Out-of-distribution Detection in Medical Image Analysis: A survey [12.778646136644399]
  Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques. Traditional supervised deep learning methods assume that the test sample is drawn from the identical distribution as the training data. It is possible to encounter out-of-distribution samples in real-world clinical scenarios, which may cause silent failure in deep learning-based medical image analysis tasks.
  arXiv  Detail & Related papers  (2024-04-28T18:51:32Z)
• Recent Advances in Predictive Modeling with Electronic Health Records [71.19967863320647]
  utilizing EHR data for predictive modeling presents several challenges due to its unique characteristics. Deep learning has demonstrated its superiority in various applications, including healthcare.
  arXiv  Detail & Related papers  (2024-02-02T00:31:01Z)
• A Transformer-based representation-learning model with unified processing of multimodal input for clinical diagnostics [63.106382317917344]
  We report a Transformer-based representation-learning model as a clinical diagnostic aid that processes multimodal input in a unified manner. The unified model outperformed an image-only model and non-unified multimodal diagnosis models in the identification of pulmonary diseases.
  arXiv  Detail & Related papers  (2023-06-01T16:23:47Z)
• Modelling Patient Trajectories Using Multimodal Information [0.0]
  We propose a solution to model patient trajectories that combines different types of information and considers the temporal aspect of clinical data. The developed solution was evaluated on two different clinical outcomes, unexpected patient readmission and disease progression.
  arXiv  Detail & Related papers  (2022-09-09T10:20:54Z)
• Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability [82.29775890542967]
  Estimating personalized effects of treatments is a complex, yet pervasive problem. Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools. We use post-hoc feature importance methods to identify features that influence the model's predictions.
  arXiv  Detail & Related papers  (2022-06-16T17:59:05Z)
• What Do You See in this Patient? Behavioral Testing of Clinical NLP Models [69.09570726777817]
  We introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. We show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.
  arXiv  Detail & Related papers  (2021-11-30T15:52:04Z)
• Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration [55.88616573143478]
  Outcome prediction from clinical text can prevent doctors from overlooking possible risks. Diagnoses at discharge, procedures performed, in-hospital mortality and length-of-stay prediction are four common outcome prediction targets. We propose clinical outcome pre-training to integrate knowledge about patient outcomes from multiple public sources.
  arXiv  Detail & Related papers  (2021-02-08T10:26:44Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.