The Protocol Genome A Self Supervised Learning Framework from DICOM Headers

• URL: http://arxiv.org/abs/2509.06995v1
• Date: Wed, 03 Sep 2025 07:38:32 GMT
• Title: The Protocol Genome A Self Supervised Learning Framework from DICOM Headers
• Abstract summary: Protocol Genome is a self-supervised learning system that learns correlations from DICOM headers.<n>Our method also improves calibration and robustness across modalities (CT, MRI, CXR) and vendors.
• Score: 0.5076419064097734
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: In this paper, we introduce the Protocol Genome, a self-supervised learning system that learns correlations from DICOM headers and achieves AUROC 0.901 (vs 0.847 baseline) and ECE 0.036 (vs 0.058) on fully held-out external validation. Our method also improves calibration and robustness across modalities (CT, MRI, CXR) and vendors. Clinical imaging is funneled through PACS/DICOM, where procedure choices (scanner make/model, sequence, kernel, kVp, TR/TE, and slice thickness) have consequences for contrast, noise, and artifact. These latent confounders impede the generalization of image-only networks across sites. We consider structured DICOM headers as a label and learn protocol-aware but clinically robust image representations. Protocol Genome obtains tokenized embeddings of de-identified header fields and models them along with image features using: (1) protocol-image contrastive learning, (2) masked protocol prediction, and (3) protocol-protocol translation. With 1.26M studies (7 health systems, 31 scanners, 3 vendors; CT, MR, CR/DR), we experiment on: (A) chest CT triage for PE, (B) brain MRI glioma grading, and (C) chest radiograph cardiomegaly detection. Relative to strong SSL baselines (SimCLR, MAE) as well as ImageNet transfer, Protocol Genome (+0.046: PE, +0.058: glioma, +0.041: cardiomegaly) is associated with higher external AUROC; 25-37% calibration improvements are obtained (p < 0.01, DeLong tests). While the gains may be task-dependent, they are preserved with 10-20% of labeled data. From a clinical point of view, the technique reduces false positives at protocol borders and is applicable in a PACS (DICOM C-FIND/C-MOVE, DICOMweb QIDO/WADO). We publish a model card and deployment guide, complete with both de-identification and bias audits.

Related papers

• Anatomical Grounding and Leakage-Aware Multimodal Contrastive Learning for Alzheimer's Disease Classification from Structural MRI [0.0]
  Deep networks trained on structural MRI for Alzheimer's disease often reach reasonable accuracy while attending to anatomically irrelevant regions.<n>We use FastSurfer segmentations as an anatomical reference.<n>We adapt a CLIP-style image and organize ADNIMERGE variables along a label-leakage spectrum.
  arXiv  Detail & Related papers  (2026-09-14T17:13:12Z)
• On Cross-Validation for Hyperparameter Optimization of Deep Learning Image Classifiers [0.0]
  Hyper optimization (HPO) can materially affect the performance of deep learning (DL) image classifiers.<n>We compare three HPO protocols in terms of absolute performance- parameter errorestimation (AEE)<n>Every point estimate favored cross-validation over both holdout protocols on medical datasets.<n>For small-sample medical image classification, we recommend cross-validation-based HPO.
  arXiv  Detail & Related papers  (2026-08-10T22:44:42Z)
• Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts [56.74856091904914]
  We propose a unified framework combining parameter-informed contrast disentanglement with severity-aware adaptive correction.<n>ScanCLIP derives contrast embeddings from acquisition parameters to disentangle contrast style from anatomical content, yielding contrast-free features.<n>A Vision Transformer then estimates motion severity and routes features through a Mixture-of-Experts network, enabling targeted artifact correction.
  arXiv  Detail & Related papers  (2026-05-29T02:48:23Z)
• Distilling Photon-Counting CT into Routine Chest CT through Clinically Validated Degradation Modeling [51.330452704464925]
  We train a latent diffusion model on 1,046 PCCTs and 405,379 EICTs from 145 hospitals.<n>We construct a large-scale dataset of over 17,316 publicly available EICTs enhanced to PCCT-like quality.<n>Our results suggest emerging imaging advances can be systematically distilled into routine EICT using limited high-quality scans as reference.
  arXiv  Detail & Related papers  (2026-04-08T17:47:35Z)
• Click, Predict, Trust: Clinician-in-the-Loop AI Segmentation for Lung Cancer CT-Based Prognosis within the Knowledge-to-Action Framework [0.7340285482623061]
  Lung cancer remains the leading cause of cancer mortality, with CT imaging central to screening, prognosis, and treatment.<n>Deep learning (DL) offers automation but faces barriers to clinical adoption.<n>This study develops a clinician-in-the-loop DL pipeline to enhance, prognostic accuracy, and clinical trust.
  arXiv  Detail & Related papers  (2025-10-19T23:02:43Z)
• Brain Tumor Classification on MRI in Light of Molecular Markers [61.77272414423481]
  Co-deletion of the 1p/19q gene is associated with clinical outcomes in low-grade gliomas.<n>This study aims to utilize a specially MRI-based convolutional neural network for brain cancer detection.
  arXiv  Detail & Related papers  (2024-09-29T07:04:26Z)
• Regional quality estimation for echocardiography using deep learning [0.6853438479513935]
  estimation of cardiac ultrasound image quality can be beneficial for guiding operators and ensuring the accuracy of clinical measurements.<n>Previous work often fails to distinguish the view correctness of the echocardiogram from the image quality.<n>In this work, we developed and compared three methods to estimate image quality.
  arXiv  Detail & Related papers  (2024-08-01T14:20:47Z)
• Lung-CADex: Fully automatic Zero-Shot Detection and Classification of Lung Nodules in Thoracic CT Images [45.29301790646322]
  Computer-aided diagnosis can help with early lung nodul detection and facilitate subsequent nodule characterization. We propose CADe, for segmenting lung nodules in a zero-shot manner using a variant of the Segment Anything Model called MedSAM. We also propose, CADx, a method for the nodule characterization as benign/malignant by making a gallery of radiomic features and aligning image-feature pairs through contrastive learning.
  arXiv  Detail & Related papers  (2024-07-02T19:30:25Z)
• Moving from 2D to 3D: volumetric medical image classification for rectal cancer staging [62.346649719614]
  preoperative discrimination between T2 and T3 stages is arguably both the most challenging and clinically significant task for rectal cancer treatment. We present a volumetric convolutional neural network to accurately discriminate T2 from T3 stage rectal cancer with rectal MR volumes.
  arXiv  Detail & Related papers  (2022-09-13T07:10:14Z)
• Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT) [2.7298989068857487]
  Self-supervised learning has demonstrated success in medical image segmentation using convolutional networks. We show our approach is more accurate and requires fewer fine tuning datasets than other pretext tasks.
  arXiv  Detail & Related papers  (2022-05-20T17:55:14Z)
• CNN Filter Learning from Drawn Markers for the Detection of Suggestive Signs of COVID-19 in CT Images [58.720142291102135]
  We propose a method that does not require either large annotated datasets or backpropagation to estimate the filters of a convolutional neural network (CNN) For a few CT images, the user draws markers at representative normal and abnormal regions. The method generates a feature extractor composed of a sequence of convolutional layers, whose kernels are specialized in enhancing regions similar to the marked ones.
  arXiv  Detail & Related papers  (2021-11-16T15:03:42Z)
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation [56.622832383316215]
  We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our empirical results show that CyTran outperforms all competing methods.
  arXiv  Detail & Related papers  (2021-10-12T23:25:03Z)
• Unpaired cross-modality educed distillation (CMEDL) applied to CT lung tumor segmentation [4.409836695738518]
  We develop a new crossmodality educed distillation (CMEDL) approach, using unpaired CT and MRI scans. Our framework uses an end-to-end trained unpaired I2I translation, teacher, and student segmentation networks.
  arXiv  Detail & Related papers  (2021-07-16T15:58:15Z)
• Deep Multi-path Network Integrating Incomplete Biomarker and Chest CT Data for Evaluating Lung Cancer Risk [4.822738153096615]
  We propose a new network design, termed as multi-path multi-modal missing network (M3Net) It integrates the multi-modal data (i.e., CDEs, biomarker and CT image) considering missing modality with multiple paths neural network. The network can be trained end-to-end with both medical image features and CDEs/biomarkers, or make a prediction with single modality.
  arXiv  Detail & Related papers  (2020-10-19T13:55:40Z)
• Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNet [74.22397862400177]
  We propose a novel catheter segmentation approach, which requests fewer annotations than the supervised learning method. Our scheme considers a deep Q learning as the pre-localization step, which avoids voxel-level annotation. With the detected catheter, patch-based Dual-UNet is applied to segment the catheter in 3D volumetric data.
  arXiv  Detail & Related papers  (2020-06-25T21:10:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.