MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detection

• URL: http://arxiv.org/abs/2409.00204v2
• Date: Fri, 18 Oct 2024 19:31:11 GMT
• Title: MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detection
• Authors: Zeyu Zhang, Nengmin Yi, Shengbo Tan, Ying Cai, Yi Yang, Lei Xu, Qingtai Li, Zhang Yi, Daji Ergu, Yang Zhao,
• Abstract summary: Cervical disc herniation (CDH) is a prevalent musculoskeletal disorder that requires labor-intensive analysis from experts. Despite advancements in automated detection of medical imaging, two significant challenges hinder the real-time application of these methods. We introduce MedDet, which leverages the multi-teacher single-student knowledge distillation for model compression and efficiency. Lastly, we conduct comprehensive experiments on the CDH-1848 dataset, achieving up to a 5% improvement in mAP compared to previous methods.
• Score: 24.833129797776422
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Cervical disc herniation (CDH) is a prevalent musculoskeletal disorder that significantly impacts health and requires labor-intensive analysis from experts. Despite advancements in automated detection of medical imaging, two significant challenges hinder the real-world application of these methods. First, the computational complexity and resource demands present a significant gap for real-time application. Second, noise in MRI reduces the effectiveness of existing methods by distorting feature extraction. To address these challenges, we propose three key contributions: Firstly, we introduced MedDet, which leverages the multi-teacher single-student knowledge distillation for model compression and efficiency, meanwhile integrating generative adversarial training to enhance performance. Additionally, we customize the second-order nmODE to improve the model's resistance to noise in MRI. Lastly, we conducted comprehensive experiments on the CDH-1848 dataset, achieving up to a 5% improvement in mAP compared to previous methods. Our approach also delivers over 5 times faster inference speed, with approximately 67.8% reduction in parameters and 36.9% reduction in FLOPs compared to the teacher model. These advancements significantly enhance the performance and efficiency of automated CDH detection, demonstrating promising potential for future application in clinical practice. See project website https://steve-zeyu-zhang.github.io/MedDet

Related papers

• Extreme Cardiac MRI Analysis under Respiratory Motion: Results of the CMRxMotion Challenge [56.28872161153236]
  Deep learning models have achieved state-of-the-art performance in automated Cardiac Magnetic Resonance (CMR) analysis.<n>The efficacy of these models is highly dependent on the availability of high-quality, artifact-free images.<n>To promote research in this domain, we organized the MICCAI CMRxMotion challenge.
  arXiv  Detail & Related papers  (2025-07-25T11:12:21Z)
• CKD-EHR:Clinical Knowledge Distillation for Electronic Health Records [16.68137505931177]
  Existing large language models face two major challenges: insufficient representation of medical knowledge and low efficiency in clinical deployment.<n>This study proposes the CKD-EHR framework, which achieves efficient and accurate disease risk prediction through knowledge distillation techniques.
  arXiv  Detail & Related papers  (2025-06-18T03:35:24Z)
• CONSULT: Contrastive Self-Supervised Learning for Few-shot Tumor Detection [21.809270017579806]
  We introduce a novel two-stage anomaly detection algorithm called CONSULT (CONtrastive Self-sUpervised Learning for few-shot Tumor detection) CONSULT fine-tunes a pre-trained feature extractor specifically for MRI brain images, using a synthetic data generation pipeline to create tumor-like data. The first stage is to overcome the shortcomings of current anomaly detection in extracting features in high-variation data by incorporating Context-Aware Contrastive Learning and Self-supervised Feature Adversarial Learning.
  arXiv  Detail & Related papers  (2024-10-15T06:09:28Z)
• A Machine Learning Approach for Identifying Anatomical Biomarkers of Early Mild Cognitive Impairment [2.9027661868249255]
  Alzheimer Disease poses a significant challenge, necessitating early detection for effective intervention. This study analyzes machine learning methods for MRI based biomarker selection and classification to distinguish between healthy controls and mild cognitive impairment within five years.
  arXiv  Detail & Related papers  (2024-05-29T06:12:05Z)
• Physical formula enhanced multi-task learning for pharmacokinetics prediction [54.13787789006417]
  A major challenge for AI-driven drug discovery is the scarcity of high-quality data. We develop a formula enhanced mul-ti-task learning (PEMAL) method that predicts four key parameters of pharmacokinetics simultaneously. Our experiments reveal that PEMAL significantly lowers the data demand, compared to typical Graph Neural Networks.
  arXiv  Detail & Related papers  (2024-04-16T07:42:55Z)
• A Learnable Prior Improves Inverse Tumor Growth Modeling [8.87818392404259]
  We propose a novel framework that leverages the unique strengths of both approaches in a synergistic manner. We showcase the effectiveness of integrating a rapid deep-learning algorithm with a high-precision evolution strategy in estimating brain tumor cell concentrations from magnetic resonance images.
  arXiv  Detail & Related papers  (2024-03-07T13:59:34Z)
• Identifying Alzheimer Disease Dementia Levels Using Machine Learning Methods [0.0]
  We suggest an approach for classifying the four stages of dementia using RF, SVM, and CNN algorithms, augmented with watershed segmentation for feature extraction from MRI images. Our results reveal that SVM with watershed features achieves an impressive accuracy of 96.25%, surpassing other classification methods.
  arXiv  Detail & Related papers  (2023-11-02T17:44:28Z)
• Effective Whole-body Pose Estimation with Two-stages Distillation [52.92064408970796]
  Whole-body pose estimation localizes the human body, hand, face, and foot keypoints in an image. We present a two-stage pose textbfDistillation for textbfWhole-body textbfPose estimators, named textbfDWPose, to improve their effectiveness and efficiency.
  arXiv  Detail & Related papers  (2023-07-29T03:49:28Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• An Evaluation of Lightweight Deep Learning Techniques in Medical Imaging for High Precision COVID-19 Diagnostics [0.0]
  Decision support systems relax the challenges inherent to the physical examination of images. Most deep learning algorithms utilised approaches are not amenable to implementation on resource-constrained devices. This paper presents the development and evaluation of the performance of lightweight deep learning technique for the detection of COVID-19 using the MobileNetV2 model.
  arXiv  Detail & Related papers  (2023-05-30T13:14:03Z)
• SSD-KD: A Self-supervised Diverse Knowledge Distillation Method for Lightweight Skin Lesion Classification Using Dermoscopic Images [62.60956024215873]
  Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Most studies in skin cancer detection keep pursuing high prediction accuracies without considering the limitation of computing resources on portable devices. This study specifically proposes a novel method, termed SSD-KD, that unifies diverse knowledge into a generic KD framework for skin diseases classification.
  arXiv  Detail & Related papers  (2022-03-22T06:54:29Z)
• Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classification [63.44396343014749]
  We propose a new margin-based surrogate loss function for the AUC score. It is more robust than the commonly used. square loss while enjoying the same advantage in terms of large-scale optimization. To the best of our knowledge, this is the first work that makes DAM succeed on large-scale medical image datasets.
  arXiv  Detail & Related papers  (2020-12-06T03:41:51Z)
• Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation [51.72616167073565]
  We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
  arXiv  Detail & Related papers  (2020-06-28T21:03:19Z)
• Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using Deep Multiple-Instance Learning [59.74684475991192]
  Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old. PD symptoms include tremor, rigidity and braykinesia. We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
  arXiv  Detail & Related papers  (2020-05-06T09:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.