LoRCA: LoRA Cycle Adaptation for Histology to HiP-CT Translation with DINOv3
- URL: http://arxiv.org/abs/2608.10002v1
- Date: Fri, 07 Aug 2026 15:43:55 GMT
- Title: LoRCA: LoRA Cycle Adaptation for Histology to HiP-CT Translation with DINOv3
- Abstract summary: We propose a cycle consistent style translation framework built on a shared frozen DINOv3 with modality-specific LoRA adapters.<n>We evaluate translation quality using Fréchet Inception Distance (FID) and structural fidelity via mutual information.<n>As a preliminary indicator of downstream registration utility, we find that style-translated images yield increased feature correspondences under MatchAnything on manually aligned HiP-CT and histology test pairs.
- Score: 3.882636699866806
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Hierarchical Phase-Contrast Tomography (HiP-CT) is a synchrotron based X-ray imaging technique that enables non-destructive, volumetric imaging of intact organs with multi-resolutions bridging 20 $μm$/voxel for whole organs to near-cellular resolution ($\sim$0.8 $μm$/voxel) in local regions. This offers the opportunity to bring volumetric whole-organ context to histology. However, nonlinear registration between H\&E histology and HiP-CT volumes is challenging due to the differences in feature representations of different colour spaces. Synthesis-before-registration methods have shown strong results in histology-to-MRI and histology-to-CT alignment. However, existing approaches either rely on manual anatomical contours or are trained from scratch without semantic constraints, limiting their generalisability to soft tissue organs and novel modalities. We propose LoRCA (LoRA Cycle Adaptation), a cycle consistent style translation framework built on a shared frozen DINOv3 with modality-specific LoRA adapters, learning modality-specific representations that are decoded and adversarially trained. LoRCA enables structure-preserving translation without requiring paired training data. The frozen backbone is intended to be a structural anchor that prevents content drift by preserving pretrained semantic-extraction capability. We evaluate translation quality using Fréchet Inception Distance (FID) and structural fidelity via mutual information and Canny edge preservation. LoRCA outperforms CycleGAN in both translation quality and structural consistency. As a preliminary indicator of downstream registration utility, we find that style-translated images yield increased feature correspondences under MatchAnything on manually aligned HiP-CT and histology test pairs, suggesting that LoRCA-style translation is a promising step towards 2D histological sections to 3D HiP-CT volumes registration.
Related papers
- Rad-JEPA 3D: Radiology Joint-Embedding Predictive Model for 3D Computed Tomography [10.665332135327205]
We introduce Rad-JEPA 3D, a joint-embedding predictive framework that learns volumetric CT representations.<n>To improve the quality of intermediate representations, we propose Hidden States Orthogonal Regularization (HSOR)<n>HSOR aligns student-teacher hidden states and reduces feature redundancy throughout the encoder.
arXiv Detail & Related papers (2026-07-28T19:00:17Z) - 3D Ultrasound-Derived Pseudo-CT Synthesis Using a Transformer-Augmented Residual Network for Real-Time Operator Guidance [0.0]
Ultrasound (US) is non-ionizing and widely accessible; however, it is highly operator dependent and lacks quantitative tissue characterization.<n>This work presents a 3D ultrasound-derived pseudo-CT framework that generates CT-like anatomical reference volumes inferred from US.<n>The proposed method outperforms established baselines in structural fidelity and perceptual image quality.
arXiv Detail & Related papers (2026-05-06T12:52:59Z) - PHASOR: Anatomy- and Phase-Consistent Volumetric Diffusion for CT Virtual Contrast Enhancement [60.81732730684265]
This paper introduces PHASOR, a volumetric diffusion framework for high-fidelity virtual contrast enhancement (VCE)<n>By treating CT volumes as coherent sequences, we leverage a video diffusion model to enhance structural coherence and volumetric accuracy.<n>To ensure anatomy-phase consistent synthesis, we introduce two complementary modules. First, anatomy-routed mixture-of-experts (AR-MoE) anchors distinct enhancement patterns to anatomical semantics, with organ-specific memory to capture salient details.<n>Second, intensity-phase aware representation alignment (IP-REPA) highlights intricate contrast signals while mitigating the impact of imperfect spatial alignment.
arXiv Detail & Related papers (2026-04-01T15:57:18Z) - Brain MR Image Synthesis with Multi-contrast Self-attention GAN [0.2291770711277359]
3D-MC-SAGAN is a unified 3D multi-contrast synthesis framework.<n>It generates high-fidelity missing modalities from a single T2 input while preserving tumour characteristics.<n>It achieves state-of-the-art quantitative performance and generates visually coherent, anatomically plausible contrasts.
arXiv Detail & Related papers (2026-03-31T13:43:53Z) - Preoperative-to-intraoperative Liver Registration for Laparoscopic Surgery via Latent-Grounded Correspondence Constraints [51.7011449975586]
Land-Reg is a deformable registration framework that learns latent-grounded 2D-3D landmark correspondences.<n>For rigid registration, Land-Reg embraces a Cross-modal Latent Alignment module.<n>An Uncertainty-enhanced Overlap Landmark Detector with similarity matching is proposed to robustly estimate explicit 2D-3D landmark correspondences.
arXiv Detail & Related papers (2026-03-02T10:44:03Z) - OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysis [53.01523944168442]
Clinical interpretation relies on both slice-driven local features and volume-driven spatial representations.<n>Existing Large Vision-Language Models (LVLMs) remain fragmented in CT slice versus volumetric understanding.<n>We present OmniCT, a powerful unified slice-volume LVLM for CT scenarios.
arXiv Detail & Related papers (2026-02-18T00:42:41Z) - TGC-Net: A Structure-Aware and Semantically-Aligned Framework for Text-Guided Medical Image Segmentation [56.09179939570486]
We propose TGC-Net, a CLIP-based framework focusing on parameter-efficient, task-specific adaptations.<n>TGC-Net achieves state-of-the-art performance with substantially fewer trainable parameters, including notable Dice gains on challenging benchmarks.
arXiv Detail & Related papers (2025-12-24T12:06:26Z) - Curvilinear Structure-preserving Unpaired Cross-domain Medical Image Translation [29.978321741632197]
Unpaired image-to-image translation has emerged as a crucial technique in medical imaging.<n>Existing approaches often distort fine curvilinear structures, such as microvasculature.<n>We propose Curvilinear Structure-preserving Translation (CST), a framework that explicitly preserves fine curvilinear structures during unpaired translation.
arXiv Detail & Related papers (2025-10-22T15:24:32Z) - REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification [2.384306241677947]
We present REACT-KD, a framework that transfers supervision from high-fidelity multi-modal sources into a lightweight CT-based student model.<n>One branch captures structure-function relationships through dual-tracer PET/CT, while the other models dose-aware features using synthetically degraded low-dose CT.<n>The framework achieved an average AUC of 93.5% on an internal PET/CT cohort and maintained 76.6% to 81.5% AUC across varying levels of dose degradation in external CT testing.
arXiv Detail & Related papers (2025-08-04T06:29:34Z) - Structure-aware registration network for liver DCE-CT images [50.28546654316009]
We propose a novel structure-aware registration method by incorporating structural information of related organs with segmentation-guided deep registration network.
Our proposed method can achieve higher registration accuracy and preserve anatomical structure more effectively than state-of-the-art methods.
arXiv Detail & Related papers (2023-03-08T14:08:56Z) - Weakly-supervised Biomechanically-constrained CT/MRI Registration of the
Spine [72.85011943179894]
We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration.
We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI.
Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
arXiv Detail & Related papers (2022-05-16T10:59:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.