Specialty detection in the context of telemedicine in a highly
imbalanced multi-class distribution
- URL: http://arxiv.org/abs/2402.14039v1
- Date: Wed, 21 Feb 2024 06:39:04 GMT
- Title: Specialty detection in the context of telemedicine in a highly
imbalanced multi-class distribution
- Authors: Alaa Alomari, Hossam Faris, Pedro A. Castillo
- Abstract summary: The study focuses on handling multiclass and highly imbalanced datasets for Arabic medical questions.
The proposed module is deployed in both synchronous and asynchronous medical consultations.
- Score: 3.992328888937568
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The Covid-19 pandemic has led to an increase in the awareness of and demand
for telemedicine services, resulting in a need for automating the process and
relying on machine learning (ML) to reduce the operational load. This research
proposes a specialty detection classifier based on a machine learning model to
automate the process of detecting the correct specialty for each question and
routing it to the correct doctor. The study focuses on handling multiclass and
highly imbalanced datasets for Arabic medical questions, comparing some
oversampling techniques, developing a Deep Neural Network (DNN) model for
specialty detection, and exploring the hidden business areas that rely on
specialty detection such as customizing and personalizing the consultation flow
for different specialties. The proposed module is deployed in both synchronous
and asynchronous medical consultations to provide more real-time
classification, minimize the doctor effort in addressing the correct specialty,
and give the system more flexibility in customizing the medical consultation
flow. The evaluation and assessment are based on accuracy, precision, recall,
and F1-score. The experimental results suggest that combining multiple
techniques, such as SMOTE and reweighing with keyword identification, is
necessary to achieve improved performance in detecting rare classes in
imbalanced multiclass datasets. By using these techniques, specialty detection
models can more accurately detect rare classes in real-world scenarios where
imbalanced data is common.
Related papers
- Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models [17.643421997037514]
We propose a novel framework that tackles both discriminative and generative multimodal medical tasks.
The learning of Med-MoE consists of three steps: multimodal medical alignment, instruction tuning and routing, and domain-specific MoE tuning.
Our model can achieve performance superior to or on par with state-of-the-art baselines.
arXiv Detail & Related papers (2024-04-16T02:35:17Z) - Learning Through Guidance: Knowledge Distillation for Endoscopic Image
Classification [40.366659911178964]
Endoscopy plays a major role in identifying any underlying abnormalities within the gastrointestinal (GI) tract.
Deep learning, specifically Convolution Neural Networks (CNNs) which are designed to perform automatic feature learning without any prior feature engineering, has recently reported great benefits for GI endoscopy image analysis.
We investigate three KD-based learning frameworks, response-based, feature-based, and relation-based mechanisms, and introduce a novel multi-head attention-based feature fusion mechanism to support relation-based learning.
arXiv Detail & Related papers (2023-08-17T02:02:11Z) - MVMTnet: A Multi-variate Multi-modal Transformer for Multi-class
Classification of Cardiac Irregularities Using ECG Waveforms and Clinical
Notes [4.648677931378919]
Deep learning can be used to optimize diagnosis and patient monitoring for clinical-based applications.
For cardiovascular disease, one such condition where the rising number of patients increasingly outweighs the availability of medical resources in different parts of the world, a core challenge is the automated classification of various cardiac abnormalities.
The proposed novel multi-modal Transformer architecture would be able to accurately perform this task while demonstrating the cross-domain effectiveness of Transformers.
arXiv Detail & Related papers (2023-02-21T21:38:41Z) - Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing [62.9062883851246]
Machine learning holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities.
One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data.
Using multi-task learning, we propose the first method to assess and mitigate shortcut learning as a part of the fairness assessment of clinical ML systems.
arXiv Detail & Related papers (2022-07-21T09:35:38Z) - Domain Generalization for Medical Imaging Classification with
Linear-Dependency Regularization [59.5104563755095]
We introduce a simple but effective approach to improve the generalization capability of deep neural networks in the field of medical imaging classification.
Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a representative feature space through variational encoding.
arXiv Detail & Related papers (2020-09-27T12:30:30Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Multimodal Feature Fusion and Knowledge-Driven Learning via Experts
Consult for Thyroid Nodule Classification [11.160089265436689]
Computer-aided diagnosis (CAD) is becoming a prominent approach to assist clinicians spanning multiple fields.
In this study, a novel end-to-end knowledge-driven classification framework is presented.
The proposed system leverages cues provided by an ensemble of experts to guide the learning phase of a densely connected convolutional network (DenseNet)
arXiv Detail & Related papers (2020-05-28T16:12:04Z) - Semi-supervised Medical Image Classification with Relation-driven
Self-ensembling Model [71.80319052891817]
We present a relation-driven semi-supervised framework for medical image classification.
It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations.
Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
arXiv Detail & Related papers (2020-05-15T06:57:54Z) - Self-Training with Improved Regularization for Sample-Efficient Chest
X-Ray Classification [80.00316465793702]
We present a deep learning framework that enables robust modeling in challenging scenarios.
Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
arXiv Detail & Related papers (2020-05-03T02:36:00Z) - MS-Net: Multi-Site Network for Improving Prostate Segmentation with
Heterogeneous MRI Data [75.73881040581767]
We propose a novel multi-site network (MS-Net) for improving prostate segmentation by learning robust representations.
Our MS-Net improves the performance across all datasets consistently, and outperforms state-of-the-art methods for multi-site learning.
arXiv Detail & Related papers (2020-02-09T14:11:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.