Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images

• URL: http://arxiv.org/abs/2307.02000v1
• Date: Wed, 5 Jul 2023 03:08:38 GMT
• Title: Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images
• Abstract summary: The pouch of Douglas (POD) obliteration can be diagnosed using Transvaginal gynecological ultrasound (TVUS) scans and magnetic resonance imaging (MRI) TVUS and MRI are complementary non-invasive endometriosis diagnosis imaging techniques, but patients are usually not scanned using both modalities. We propose in this paper a knowledge distillation training algorithm to improve the POD obliteration detection from MRI.
• Score: 18.191192167065555
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Endometriosis is a common chronic gynecological disorder that has many characteristics, including the pouch of Douglas (POD) obliteration, which can be diagnosed using Transvaginal gynecological ultrasound (TVUS) scans and magnetic resonance imaging (MRI). TVUS and MRI are complementary non-invasive endometriosis diagnosis imaging techniques, but patients are usually not scanned using both modalities and, it is generally more challenging to detect POD obliteration from MRI than TVUS. To mitigate this classification imbalance, we propose in this paper a knowledge distillation training algorithm to improve the POD obliteration detection from MRI by leveraging the detection results from unpaired TVUS data. More specifically, our algorithm pre-trains a teacher model to detect POD obliteration from TVUS data, and it also pre-trains a student model with 3D masked auto-encoder using a large amount of unlabelled pelvic 3D MRI volumes. Next, we distill the knowledge from the teacher TVUS POD obliteration detector to train the student MRI model by minimizing a regression loss that approximates the output of the student to the teacher using unpaired TVUS and MRI data. Experimental results on our endometriosis dataset containing TVUS and MRI data demonstrate the effectiveness of our method to improve the POD detection accuracy from MRI.

Related papers

• Rendering Novel Views of MRI Using 3D Gaussian Splatting [54.6286495315908]
  We adapt 3D Gaussian Splatting to form a reconstruction starting from sparse anisotropic MRIs, and imaging planes aligned with the anatomy relevant for clinical evaluation are then sampled and rendered.<n>The novel view plane is optimal for diagnostic radiological grading of the target anatomy, whereas the original MRI is not.
  arXiv  Detail & Related papers  (2026-06-24T18:00:03Z)
• AI Approach for MRI-only Full-Spine Vertebral Segmentation and 3D Reconstruction in Paediatric Scoliosis [0.0]
  MRI is preferred over CT in paediatric imaging because it avoids ionising radiation.<n>Its use in spine deformity assessment is largely limited by the lack of automated, high-resolution 3D bony reconstruction.<n>This study introduces an AI framework that enables fully automated thoracolumbar spine (T1-L5) segmentation and 3D reconstruction from MRI alone.
  arXiv  Detail & Related papers  (2026-04-20T05:57:06Z)
• Unsupervised Anomaly Detection of Diseases in the Female Pelvis for Real-Time MR Imaging [1.1486742537761567]
  Existing AI approaches are largely disease-specific and lack real-time compatibility.<n>We establish a benchmark framework for disease- and parameter-agnostic, real-time-compatible unsupervised anomaly detection in pelvic MRI.
  arXiv  Detail & Related papers  (2026-02-05T20:33:27Z)
• Towards Label-Free Brain Tumor Segmentation: Unsupervised Learning with Multimodal MRI [7.144319861722029]
  Unsupervised anomaly detection (UAD) presents a complementary alternative to supervised learning for brain tumor segmentation in MRI.<n>We propose a novel Multimodal Vision Transformer Autoencoder (MViT-AE) trained exclusively on healthy brain MRIs to detect and localize tumors.<n>Our method achieves clinically meaningful tumor localization, with lesion-wise Dice Similarity Coefficient of 0.437 (Whole Tumor), 0.316 (Tumor Core), and 0.350 (Enhancing Tumor) on the test set, and an anomaly Detection Rate of 89.4% on the validation set.
  arXiv  Detail & Related papers  (2025-10-17T14:26:30Z)
• Patch-Based Diffusion for Data-Efficient, Radiologist-Preferred MRI Reconstruction [30.203473273516895]
  Patch-based diffusion models have shown promise in learning effective data-driven priors over small real-valued datasets.<n>We show that PaDIS-MRI models trained on small datasets of as few as 25 k-space images outperform FastMRI-EDM on image quality metrics.
  arXiv  Detail & Related papers  (2025-09-25T20:18:56Z)
• SCOPE-MRI: Bankart Lesion Detection as a Case Study in Data Curation and Deep Learning for Challenging Diagnoses [0.0]
  This study introduces ScopeMRI, the first publicly available, expert-annotated dataset for shoulder pathologies. It presents a deep learning (DL) framework for detecting Bankart lesions on both standard MRIs and MRAs. Models achieved an AUC of 0.91 and 0.93, sensitivity of 83% and 94%, and specificity of 91% and 86% for standard MRIs and MRAs, respectively.
  arXiv  Detail & Related papers  (2025-04-29T04:02:44Z)
• Translation of Fetal Brain Ultrasound Images into Pseudo-MRI Images using Artificial Intelligence [0.0]
  In the third trimester, the complexity of the fetal brain requires high image quality for extracting quantitative data. In contrast, magnetic resonance imaging (MRI) offers superior image quality and tissue differentiation but is less available, expensive, and requires time-consuming acquisition.
  arXiv  Detail & Related papers  (2025-04-03T08:59:33Z)
• ContextMRI: Enhancing Compressed Sensing MRI through Metadata Conditioning [51.26601171361753]
  We propose ContextMRI, a text-conditioned diffusion model for MRI that integrates granular metadata into the reconstruction process. We show that increasing the fidelity of metadata, ranging from slice location and contrast to patient age, sex, and pathology, systematically boosts reconstruction performance.
  arXiv  Detail & Related papers  (2025-01-08T05:15:43Z)
• Unsupervised dMRI Artifact Detection via Angular Resolution Enhancement and Cycle Consistency Learning [45.3610312584439]
  Diffusion magnetic resonance imaging (dMRI) is a crucial technique in neuroimaging studies, allowing for the non-invasive probing of the underlying structures of brain tissues. Clinical dMRI data is susceptible to various artifacts during acquisition, which can lead to unreliable subsequent analyses. We propose a novel unsupervised deep learning framework called $textbfU$n $textbfd$MRI $textbfA$rtifact $textbfD$etection via $textbfA$ngular Resolution Enhancement and $textbfC$ycle
  arXiv  Detail & Related papers  (2024-09-24T08:56:10Z)
• Cross-modality Guidance-aided Multi-modal Learning with Dual Attention for MRI Brain Tumor Grading [47.50733518140625]
  Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
  arXiv  Detail & Related papers  (2024-01-17T07:54:49Z)
• Deep-learning-based acceleration of MRI for radiotherapy planning of pediatric patients with brain tumors [39.58317527488534]
  We developed a deep learning-based method for MRI reconstruction from undersampled data acquired with RT-specific receiver coil arrangements. DeepMRIRec reduced scanning time by a factor of four producing a structural similarity score surpassing the evaluated state-of-the-art method.
  arXiv  Detail & Related papers  (2023-11-22T16:01:44Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• Style transfer between Microscopy and Magnetic Resonance Imaging via Generative Adversarial Network in small sample size settings [49.84018914962972]
  Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising. We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
  arXiv  Detail & Related papers  (2023-10-16T13:58:53Z)
• Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification [42.75911994044675]
  We present a novel approach for unpaired image-to-image translation of prostate MRIs and an uncertainty-aware training approach for classifying clinically significant PCa. Our approach involves a novel pipeline for translating unpaired 3.0T multi-parametric prostate MRIs to 1.5T, thereby augmenting the available training data. Our experiments demonstrate that the proposed method significantly improves the Area Under ROC Curve (AUC) by over 20% compared to the previous work.
  arXiv  Detail & Related papers  (2023-07-02T05:26:54Z)
• Adaptive PromptNet For Auxiliary Glioma Diagnosis without Contrast-Enhanced MRI [11.231836756951655]
  Multi-contrast magnetic resonance imaging (MRI)-based automatic auxiliary glioma diagnosis plays an important role in the clinic. Contrast-enhanced MRI sequences (e.g., contrast-enhanced T1-weighted imaging) were utilized in most of the existing relevant studies. However, acquiring contrast-enhanced MRI data is sometimes not feasible due to the patients physiological limitations. It is more time-consuming and costly to collect contrast-enhanced MRI data in the clinic.
  arXiv  Detail & Related papers  (2022-11-15T08:02:54Z)
• Automatic Diagnosis of Myocarditis Disease in Cardiac MRI Modality using Deep Transformers and Explainable Artificial Intelligence [20.415917092103033]
  Myocarditis is a significant cardiovascular disease (CVD) that poses a threat to the health of many individuals. The occurrence of microbes and viruses, including the likes of HIV, plays a crucial role in the development of myocarditis disease (MCD) The proposed CADS consists of several steps, including dataset, preprocessing, feature extraction, classification, and post-processing.
  arXiv  Detail & Related papers  (2022-10-26T10:34:20Z)
• Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine [72.85011943179894]
  We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration. We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI. Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
  arXiv  Detail & Related papers  (2022-05-16T10:59:55Z)
• Unsupervised Anomaly Detection in 3D Brain MRI using Deep Learning with impured training data [53.122045119395594]
  We study how unhealthy samples within the training data affect anomaly detection performance for brain MRI-scans. We evaluate a method to identify falsely labeled samples directly during training based on the reconstruction error of the AE.
  arXiv  Detail & Related papers  (2022-04-12T13:05:18Z)
• Outlier-based Autism Detection using Longitudinal Structural MRI [6.311381904410801]
  This paper proposes structural Magnetic Resonance Imaging (sMRI)-based Autism Spectrum Disorder diagnosis via an outlier detection approach. Generative Adversarial Network (GAN) is trained exclusively with sMRI scans of healthy subjects. Experiments reveal that our ASD detection framework performs comparably with the state-of-the-art with far fewer training data.
  arXiv  Detail & Related papers  (2022-02-21T04:37:25Z)
• ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep learning [47.68307909984442]
  Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image. Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
  arXiv  Detail & Related papers  (2021-02-25T14:52:23Z)
• A Convolutional Approach to Vertebrae Detection and Labelling in Whole Spine MRI [70.04389979779195]
  We propose a novel convolutional method for the detection and identification of vertebrae in whole spine MRIs. This involves using a learnt vector field to group detected vertebrae corners together into individual vertebral bodies. We demonstrate the clinical applicability of this method, using it for automated scoliosis detection in both lumbar and whole spine MR scans.
  arXiv  Detail & Related papers  (2020-07-06T09:37:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.