DINOv3 with Test-Time Training for Medical Image Registration

• URL: http://arxiv.org/abs/2508.14809v1
• Date: Wed, 20 Aug 2025 15:58:19 GMT
• Title: DINOv3 with Test-Time Training for Medical Image Registration
• Abstract summary: We propose a training-free pipeline that relies on a frozen DINOv3 encoder and test-time optimization of the deformation field in feature space.<n>Across two representative benchmarks, the method is accurate and yields regular deformations.
• Score: 3.9576638237437183
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Prior medical image registration approaches, particularly learning-based methods, often require large amounts of training data, which constrains clinical adoption. To overcome this limitation, we propose a training-free pipeline that relies on a frozen DINOv3 encoder and test-time optimization of the deformation field in feature space. Across two representative benchmarks, the method is accurate and yields regular deformations. On Abdomen MR-CT, it attained the best mean Dice score (DSC) of 0.790 together with the lowest 95th percentile Hausdorff Distance (HD95) of 4.9+-5.0 and the lowest standard deviation of Log-Jacobian (SDLogJ) of 0.08+-0.02. On ACDC cardiac MRI, it improves mean DSC to 0.769 and reduces SDLogJ to 0.11 and HD95 to 4.8, a marked gain over the initial alignment. The results indicate that operating in a compact foundation feature space at test time offers a practical and general solution for clinical registration without additional training.

Related papers

• LeCor: Learning to Be Corrected by Meta-Learned Test-Time Training for Interactive 3D Lung-Tumour Segmentation [45.86925813888675]
  Fine-tuning SAM 3 on lung tumours raises the Dice obtained from a single point prompt from 0.298 to 0.757, and seven rounds of corrections raise it further to 0.765.<n>We propose LeCor, which performs test-time training on a small set of case adapters that are reset for every case.<n>LeCor raises the Dice reached after seven correction rounds from 0.787 with the fine-tuned model to 0.827, reduces the number of cases that never reach a Dice of 0.80 from 47 to 27, and reaches in three correction rounds the accuracy that the fine-tuned model attains in seven.
  arXiv  Detail & Related papers  (2026-09-08T21:49:56Z)
• Post-Operative Glioma Segmentation via Loss Stabilization, Normalization and Subspace Attention [46.03321798937855]
  We show that the standard Generalized Dice Loss (GDL) is unstable under domain shift.<n>We propose a Subspace-Aware Class Attention (SACA) module that re-calibrates the bottleneck features and raises Enhancing Tumor (ET) sensitivity by 8%.
  arXiv  Detail & Related papers  (2026-07-23T09:59:30Z)
• DiffEEG: A Self-Supervised Denoising Diffusion Model for Learning EEG Generic Representations [1.901880164206253]
  We present DiffEEG, a self-supervised foundation model for deep learning for EEG-based seizure detection.<n>Pre-trained on 1.3M unlabeled segments from the Temple University Hospital Seizure Corpus (TUHSZ), DiffEEG learns generic neural representations via a 1D U-Net with multi-head self-attention.<n>Under strict patient-wise evaluation, DiffEEG achieves 61% accuracy and 59% F1 for 4-class seizure subtyping, and 81% accuracy with 85% weighted F1 for binary detection.
  arXiv  Detail & Related papers  (2026-07-13T13:59:45Z)
• Improving Generalization of Deep Learning for Brain Metastases Segmentation Across Institutions [5.4585656405659195]
  The goal of this work is to create a domain adaptation framework that will allow for BM segmentation to be used across multiple institutions.<n>We propose a VAE-MMD preprocessing pipeline that combines variational autoencoders (VAE) with maximum mean discrepancy (MMD) loss.
  arXiv  Detail & Related papers  (2026-04-01T02:25:25Z)
• DINOv3 with Test-Time Calibration for Automated Carotid Intima-Media Thickness Measurement on CUBS v1 [5.343632486602401]
  We develop a DINOv3-based framework for carotid intima-media complex segmentation and subsequent CIMT measurement.<n>Our results place a DINOv3-based approach within the clinically relevant $sim$0.1 mm measurement regime.<n>Together, our findings support the feasibility of using vision foundation models for interpretable, calibration-aware CIMT measurement.
  arXiv  Detail & Related papers  (2026-03-11T03:33:04Z)
• GLIDE-Reg: Global-to-Local Deformable Registration Using Co-Optimized Foundation and Handcrafted Features [1.3341104532714532]
  We jointly optimize a registration field and a learnable dimensionality reduction module so that compressed VFM embeddings remain registration-relevant.<n>GLIDE-Reg achieves average dice similarity coefficients (DSC) across 6 anatomical structures of 0.859, 0.862, and 0.901.<n>For target registration errors, GLIDE-Reg achieves 1.58 mm on Lung250M landmarks (compared to 1.25 mm on corrField and 1.91 mm on DEEDS)
  arXiv  Detail & Related papers  (2026-02-27T17:19:02Z)
• Leveraging Convolutional Sparse Autoencoders for Robust Movement Classification from Low-Density sEMG [0.46976113832881716]
  This study proposes a deep learning framework for accurate gesture recognition using only two surface electromyography (sEMG) channels.<n>We present a few-shot transfer learning protocol that improved performance on unseen subjects from a baseline of 35.1% $pm$ 3.1% to 92.3% $pm$ 0.9% with minimal calibration data.
  arXiv  Detail & Related papers  (2026-01-30T14:21:46Z)
• FUGC: Benchmarking Semi-Supervised Learning Methods for Cervical Segmentation [63.7829089874007]
  This paper introduces the Fetal Ultrasound Grand Challenge (FUGC), the first benchmark for semi-supervised learning in cervical segmentation.<n>FUGC provides a dataset of 890 TVS images, including 500 training images, 90 validation images, and 300 test images.<n> Methods were evaluated using the Dice Similarity Coefficient (DSC), Hausdorff Distance (HD), and runtime (RT), with a weighted combination of 0.4/0.4/0.2.
  arXiv  Detail & Related papers  (2026-01-22T01:34:39Z)
• Deep learning motion correction of quantitative stress perfusion cardiovascular magnetic resonance [0.9195911076768547]
  We developed an unsupervised deep learning-based motion correction pipeline.<n>It corrects motion in three steps and uses robust principal component analysis to reduce contrast-related effects.<n>Performance was assessed via temporal alignment and quantitative perfusion values.
  arXiv  Detail & Related papers  (2025-10-01T09:59:48Z)
• A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
  We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
  arXiv  Detail & Related papers  (2025-08-19T14:41:22Z)
• CleanCTG: A Deep Learning Model for Multi-Artefact Detection and Reconstruction in Cardiotocography [0.0]
  We present CleanCTG, an end-to-end dual-stage model that first identifies multiple artefact types via multi-scale convolution and context-aware cross-attention.<n>On synthetic data, CleanCTG achieved perfect artefact detection (AU-ROC = 1.00) and reduced mean squared error (MSE) on corrupted segments to 2.74 x 10-4.<n>When integrated with the Dawes-Redman system on 933 clinical CTG recordings, denoised traces increased specificity (from 80.70% to 82.70%) and shortened median time to decision by 33%.
  arXiv  Detail & Related papers  (2025-08-11T11:24:45Z)
• Explainable Anatomy-Guided AI for Prostate MRI: Foundation Models and In Silico Clinical Trials for Virtual Biopsy-based Risk Assessment [3.5408411348831232]
  We present a fully automated, anatomically guided deep learning pipeline for prostate cancer (PCa) risk stratification using routine MRI.<n>The pipeline integrates three key components: an nnU-Net module for segmenting the prostate gland and its zones on axial T2-weighted MRI; a classification module based on the DiceedPT Swin Transformer foundation model, fine-tuned on 3D patches with optional anatomical priors and clinical data; and a VAE-GAN framework for generating counterfactual heatmaps that localize decision-driving image regions.
  arXiv  Detail & Related papers  (2025-05-23T14:40:09Z)
• Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methods [28.526710503853877]
  Current deformable image registration (DIR) implementations rely on discrete volumetric motion representation.<n>We propose a novel approach using implicit neural representation (INR) for continuous modeling of patient anatomical motion.<n>CPT-DIR significantly enhances registration and accuracy, automation, and speed.
  arXiv  Detail & Related papers  (2024-05-01T10:26:08Z)
• Detection of subclinical atherosclerosis by image-based deep learning on chest x-ray [86.38767955626179]
  Deep-learning algorithm to predict coronary artery calcium (CAC) score was developed on 460 chest x-ray. The diagnostic accuracy of the AICAC model assessed by the area under the curve (AUC) was the primary outcome.
  arXiv  Detail & Related papers  (2024-03-27T16:56:14Z)
• Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification [42.75911994044675]
  We present a novel approach for unpaired image-to-image translation of prostate MRIs and an uncertainty-aware training approach for classifying clinically significant PCa. Our approach involves a novel pipeline for translating unpaired 3.0T multi-parametric prostate MRIs to 1.5T, thereby augmenting the available training data. Our experiments demonstrate that the proposed method significantly improves the Area Under ROC Curve (AUC) by over 20% compared to the previous work.
  arXiv  Detail & Related papers  (2023-07-02T05:26:54Z)
• Deep Learning-Based Automatic Diagnosis System for Developmental Dysplasia of the Hip [3.216812203515066]
  The clinical diagnosis of developmental dysplasia of the hip typically involves manually measuring key radiological angles.<n>This study aims to develop an automated system that integrates these measurements to enhance the accuracy and consistency of DDH diagnosis.
  arXiv  Detail & Related papers  (2022-09-07T19:50:30Z)
• Self-supervised contrastive learning of echocardiogram videos enables label-efficient cardiac disease diagnosis [48.64462717254158]
  We developed a self-supervised contrastive learning approach, EchoCLR, to catered to echocardiogram videos. When fine-tuned on small portions of labeled data, EchoCLR pretraining significantly improved classification performance for left ventricular hypertrophy (LVH) and aortic stenosis (AS) EchoCLR is unique in its ability to learn representations of medical videos and demonstrates that SSL can enable label-efficient disease classification from small, labeled datasets.
  arXiv  Detail & Related papers  (2022-07-23T19:17:26Z)
• Systematic Clinical Evaluation of A Deep Learning Method for Medical Image Segmentation: Radiosurgery Application [48.89674088331313]
  We systematically evaluate a Deep Learning (DL) method in a 3D medical image segmentation task. Our method is integrated into the radiosurgery treatment process and directly impacts the clinical workflow.
  arXiv  Detail & Related papers  (2021-08-21T16:15:40Z)
• CovidDeep: SARS-CoV-2/COVID-19 Test Based on Wearable Medical Sensors and Efficient Neural Networks [51.589769497681175]
  The novel coronavirus (SARS-CoV-2) has led to a pandemic. The current testing regime based on Reverse Transcription-Polymerase Chain Reaction for SARS-CoV-2 has been unable to keep up with testing demands. We propose a framework called CovidDeep that combines efficient DNNs with commercially available WMSs for pervasive testing of the virus.
  arXiv  Detail & Related papers  (2020-07-20T21:47:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.