Key Technology Considerations in Developing and Deploying Machine
Learning Models in Clinical Radiology Practice
- URL: http://arxiv.org/abs/2102.01979v1
- Date: Wed, 3 Feb 2021 09:53:43 GMT
- Title: Key Technology Considerations in Developing and Deploying Machine
Learning Models in Clinical Radiology Practice
- Authors: Viraj Kulkarni, Manish Gawali, Amit Kharat
- Abstract summary: We propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice.
Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The use of machine learning to develop intelligent software tools for
interpretation of radiology images has gained widespread attention in recent
years. The development, deployment, and eventual adoption of these models in
clinical practice, however, remains fraught with challenges. In this paper, we
propose a list of key considerations that machine learning researchers must
recognize and address to make their models accurate, robust, and usable in
practice. Namely, we discuss: insufficient training data, decentralized
datasets, high cost of annotations, ambiguous ground truth, imbalance in class
representation, asymmetric misclassification costs, relevant performance
metrics, generalization of models to unseen datasets, model decay, adversarial
attacks, explainability, fairness and bias, and clinical validation. We
describe each consideration and identify techniques to address it. Although
these techniques have been discussed in prior research literature, by freshly
examining them in the context of medical imaging and compiling them in the form
of a laundry list, we hope to make them more accessible to researchers,
software developers, radiologists, and other stakeholders.
Related papers
- Health AI Developer Foundations [18.690656891269686]
Health AI Developer Foundations (HAI-DEF) is a suite of pre-trained, domain-specific foundation models, tools, and recipes to accelerate building Machine Learning for health applications.
Models cover various modalities and domains, including radiology (X-rays and computed tomography), histopathology, dermatological imaging, and audio.
These models provide domain specific embeddings that facilitate AI development with less labeled data, shorter training times, and reduced computational costs.
arXiv Detail & Related papers (2024-11-22T18:51:51Z) - DREAMS: A python framework to train deep learning models with model card reporting for medical and health applications [7.2934799091933815]
We introduce a comprehensive deep learning framework tailored for EEG data processing, model training and report generation.
While constructed in way to be adapted and developed further by AI developers, it enables to report, through model cards, the outcome and specific information of use for both developers and clinicians.
arXiv Detail & Related papers (2024-09-26T13:12:13Z) - Safe AI for health and beyond -- Monitoring to transform a health
service [51.8524501805308]
We will assess the infrastructure required to monitor the outputs of a machine learning algorithm.
We will present two scenarios with examples of monitoring and updates of models.
arXiv Detail & Related papers (2023-03-02T17:27:45Z) - Learnware: Small Models Do Big [69.88234743773113]
The prevailing big model paradigm, which has achieved impressive results in natural language processing and computer vision applications, has not yet addressed those issues, whereas becoming a serious source of carbon emissions.
This article offers an overview of the learnware paradigm, which attempts to enable users not need to build machine learning models from scratch, with the hope of reusing small models to do things even beyond their original purposes.
arXiv Detail & Related papers (2022-10-07T15:55:52Z) - Challenges and Opportunities for Machine Learning Classification of
Behavior and Mental State from Images [3.7445390865272588]
Computer Vision (CV) classifiers distinguish and detect nonverbal social human behavior and mental state.
There are several pain points which arise when attempting this process for behavioral phenotyping.
We discuss current state-of-the-art research endeavors in CV such as data curation, data augmentation, crowdsourced labeling, active learning, reinforcement learning, generative models, representation learning, federated learning, and meta-learning.
arXiv Detail & Related papers (2022-01-26T21:35:17Z) - Individual Explanations in Machine Learning Models: A Survey for
Practitioners [69.02688684221265]
The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise.
Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways.
Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
arXiv Detail & Related papers (2021-04-09T01:46:34Z) - Medical Imaging and Machine Learning [16.240472115235253]
The National Institutes of Health in 2018 identified key focus areas for the future of artificial intelligence in medical imaging.
Data availability, need for novel computing architectures and explainable AI algorithms, are still relevant.
In this paper we explore challenges unique to high dimensional clinical imaging data, in addition to highlighting some of the technical and ethical considerations.
arXiv Detail & Related papers (2021-03-02T18:53:39Z) - Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
We propose a deep co-attention network for multi-view subspace learning.
It aims to extract both the common information and the complementary information in an adversarial setting.
In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
arXiv Detail & Related papers (2021-02-15T18:46:44Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Machine learning-based clinical prediction modeling -- A practical guide
for clinicians [0.0]
The number of manuscripts related to machine learning or artificial intelligence has exponentially increased over the past years.
In the first section, we provide explanations on the general principles of machine learning.
In further sections, we review the importance of resampling, overfitting and model generalizability and strategies for model evaluation.
arXiv Detail & Related papers (2020-06-23T20:11:37Z) - Self-Training with Improved Regularization for Sample-Efficient Chest
X-Ray Classification [80.00316465793702]
We present a deep learning framework that enables robust modeling in challenging scenarios.
Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
arXiv Detail & Related papers (2020-05-03T02:36:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.