Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice

• URL: http://arxiv.org/abs/2102.01979v1
• Date: Wed, 3 Feb 2021 09:53:43 GMT
• Title: Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice
• Authors: Viraj Kulkarni, Manish Gawali, Amit Kharat
• Abstract summary: We propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The use of machine learning to develop intelligent software tools for interpretation of radiology images has gained widespread attention in recent years. The development, deployment, and eventual adoption of these models in clinical practice, however, remains fraught with challenges. In this paper, we propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation. We describe each consideration and identify techniques to address it. Although these techniques have been discussed in prior research literature, by freshly examining them in the context of medical imaging and compiling them in the form of a laundry list, we hope to make them more accessible to researchers, software developers, radiologists, and other stakeholders.

Related papers

• DREAMS: A python framework to train deep learning models with model card reporting for medical and health applications [7.2934799091933815]
  We introduce a comprehensive deep learning framework tailored for EEG data processing, model training and report generation. While constructed in way to be adapted and developed further by AI developers, it enables to report, through model cards, the outcome and specific information of use for both developers and clinicians.
  arXiv  Detail & Related papers  (2024-09-26T13:12:13Z)
• Knowledge-Informed Machine Learning for Cancer Diagnosis and Prognosis: A review [2.2268038840298714]
  We review the state-of-the-art machine learning studies that adopted the fusion of biomedical knowledge and data. We provide an overview of diverse forms of knowledge representation and current strategies of knowledge integration into machine learning pipelines.
  arXiv  Detail & Related papers  (2024-01-12T07:01:36Z)
• Safe AI for health and beyond -- Monitoring to transform a health service [51.8524501805308]
  We will assess the infrastructure required to monitor the outputs of a machine learning algorithm. We will present two scenarios with examples of monitoring and updates of models.
  arXiv  Detail & Related papers  (2023-03-02T17:27:45Z)
• Learnware: Small Models Do Big [69.88234743773113]
  The prevailing big model paradigm, which has achieved impressive results in natural language processing and computer vision applications, has not yet addressed those issues, whereas becoming a serious source of carbon emissions. This article offers an overview of the learnware paradigm, which attempts to enable users not need to build machine learning models from scratch, with the hope of reusing small models to do things even beyond their original purposes.
  arXiv  Detail & Related papers  (2022-10-07T15:55:52Z)
• Challenges and Opportunities for Machine Learning Classification of Behavior and Mental State from Images [3.7445390865272588]
  Computer Vision (CV) classifiers distinguish and detect nonverbal social human behavior and mental state. There are several pain points which arise when attempting this process for behavioral phenotyping. We discuss current state-of-the-art research endeavors in CV such as data curation, data augmentation, crowdsourced labeling, active learning, reinforcement learning, generative models, representation learning, federated learning, and meta-learning.
  arXiv  Detail & Related papers  (2022-01-26T21:35:17Z)
• Individual Explanations in Machine Learning Models: A Survey for Practitioners [69.02688684221265]
  The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
  arXiv  Detail & Related papers  (2021-04-09T01:46:34Z)
• Medical Imaging and Machine Learning [16.240472115235253]
  The National Institutes of Health in 2018 identified key focus areas for the future of artificial intelligence in medical imaging. Data availability, need for novel computing architectures and explainable AI algorithms, are still relevant. In this paper we explore challenges unique to high dimensional clinical imaging data, in addition to highlighting some of the technical and ethical considerations.
  arXiv  Detail & Related papers  (2021-03-02T18:53:39Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• Machine learning-based clinical prediction modeling -- A practical guide for clinicians [0.0]
  The number of manuscripts related to machine learning or artificial intelligence has exponentially increased over the past years. In the first section, we provide explanations on the general principles of machine learning. In further sections, we review the importance of resampling, overfitting and model generalizability and strategies for model evaluation.
  arXiv  Detail & Related papers  (2020-06-23T20:11:37Z)
• Self-Training with Improved Regularization for Sample-Efficient Chest X-Ray Classification [80.00316465793702]
  We present a deep learning framework that enables robust modeling in challenging scenarios. Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
  arXiv  Detail & Related papers  (2020-05-03T02:36:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.