Semantically Calibrated Evidence Composition for CT Vision-Language Learning

• URL: http://arxiv.org/abs/2608.00239v1
• Date: Fri, 31 Jul 2026 19:34:31 GMT
• Title: Semantically Calibrated Evidence Composition for CT Vision-Language Learning
• Abstract summary: Learning representations from CT-report pairs requires combining whole-volume context with anatomy-specific evidence.<n>We propose SCOPE (Semantic Evidence Of comPosed), a framework for semantically calibrated evidence composition in CT vision-language learning.
• Score: 4.757530530297623
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning transferable representations from CT-report pairs requires combining whole-volume context with anatomy-specific evidence. Existing methods typically emphasize either global CT-report alignment or fine-grained anatomy-level correspondence. Global alignment preserves broad study context but leaves the contribution of localized evidence implicit, whereas anatomy-level alignment explicitly grounds local findings but does not specify how independently represented evidence should interact, acquire study-level meaning, and contribute to a global CT representation. To address this gap, we propose SCOPE (Semantic Calibration Of comPosed Evidence), a framework for semantically calibrated evidence composition in CT vision-language learning. Under organ-specific report supervision, mask-guided queries with fixed anatomical identities extract context-aware organ evidence from shared, uncropped volumetric features, while an unrestricted global query retains access to whole-volume context. The global query then drives Local-Global Coupling to compose the organ evidence into a unified evidence representation. The composed evidence is subsequently calibrated using the diagnostic summary, providing study-level semantic supervision beyond local organ descriptions, and is finally integrated as a controlled residual into a context-preserving whole-volume representation aligned with the complete report. This progressive pathway connects localized evidence with study-level semantics without reducing the CT representation to a predefined set of organs. On CT-RATE and RadChestCT, SCOPE achieves macro AUCs of 85.0 and 72.2, respectively, outperforming the previous SOTA by 7.2 and 4.2, while also yielding substantial gains in linear probing and cross-modal retrieval. These results demonstrate the effectiveness of semantically calibrated evidence composition.

Related papers

• AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation [58.56402940400457]
  3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis.<n>We introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions.<n>AnaDiffusion produces both explicit part assets and a globally coherent volume, enabling controllable part editing.
  arXiv  Detail & Related papers  (2026-08-24T09:16:42Z)
• LoRCA: LoRA Cycle Adaptation for Histology to HiP-CT Translation with DINOv3 [3.882636699866806]
  We propose a cycle consistent style translation framework built on a shared frozen DINOv3 with modality-specific LoRA adapters.<n>We evaluate translation quality using Fréchet Inception Distance (FID) and structural fidelity via mutual information.<n>As a preliminary indicator of downstream registration utility, we find that style-translated images yield increased feature correspondences under MatchAnything on manually aligned HiP-CT and histology test pairs.
  arXiv  Detail & Related papers  (2026-08-07T15:43:55Z)
• Learning Anatomy-Grounded CT Vision-Language Representations with Organ-Hierarchical Report Knowledge [7.277508278429653]
  We propose OKA-CT, an organ-hierarchical knowledge-augmented framework for CT-report.<n> OKA-CT first converts free-text reports into organ-conditioned knowledge using radiology report parsing.<n>Stage1 injects anatomy-grounded evidence into the CT visual representation through fine-grained organ-conditioned supervision.<n>Stage2 uses organ-specific report evidence to guide structured report-CT contrastive learning.
  arXiv  Detail & Related papers  (2026-07-12T23:09:23Z)
• ASAP: Advancing Medical Volumetric Representation Learning with Anatomy-aware Semantically-adaptive Pre-training [26.518178155362634]
  We propose a principled vision-language pre-training framework for fine-grained medical volumetric representation learning.<n>ASAP integrates three key components: (1) an anatomy-aware knowledge injection module that incorporates organ-level structural priors; (2) a semantically-adaptive selective alignment mechanism that associates sentence-level findings with localized regions; and (3) a semantically-adaptive fusion module for effective interaction between anatomically informed visual features and grounded textual cues.
  arXiv  Detail & Related papers  (2026-05-30T07:59:21Z)
• EXACT: an explainable anomaly-aware vision foundation model for analysis of 3D chest CT [29.0378459959757]
  EXACT is an anomaly-aware foundation model for three-dimensional chest CT.<n>It learns spatially resolved representations from paired clinical scans and radiology reports.<n> EXACT shows consistent improvements across clinically relevant CT tasks.
  arXiv  Detail & Related papers  (2026-04-27T07:57:47Z)
• Enhancing Medical Visual Grounding via Knowledge-guided Spatial Prompts [52.256130375429414]
  Medical Visual Grounding (MVG) aims to identify relevant phrases from free-text radiology reports and localize their corresponding regions in medical images.<n>We present KnowMVG, a knowledge-enhanced prompting strategy that encodes phrase related medical knowledge into compact embeddings.<n>This design bridges high-level semantic understanding and fine-grained visual perception without introducing extra textual reasoning overhead.
  arXiv  Detail & Related papers  (2026-04-02T11:31:30Z)
• Retrieval-Augmented Anatomical Guidance for Text-to-CT Generation [1.5532758127091075]
  We propose a retrieval-augmented approach for Text-to-CT generation that integrates semantic and anatomical information under a realistic inference setting.<n>Experiments on the CT-RATE dataset show that retrieval-augmented generation improves image fidelity and clinical consistency compared to text-only baselines.<n>This work introduces a principled and scalable mechanism to bridge semantic conditioning and anatomical plausibility in volumetric medical image synthesis.
  arXiv  Detail & Related papers  (2026-03-09T12:27:17Z)
• OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysis [53.01523944168442]
  Clinical interpretation relies on both slice-driven local features and volume-driven spatial representations.<n>Existing Large Vision-Language Models (LVLMs) remain fragmented in CT slice versus volumetric understanding.<n>We present OmniCT, a powerful unified slice-volume LVLM for CT scenarios.
  arXiv  Detail & Related papers  (2026-02-18T00:42:41Z)
• Semantic Visual Anomaly Detection and Reasoning in AI-Generated Images [96.43608872116347]
  AnomReason is a large-scale benchmark with structured annotations as quadruple textbfAnomAgent<n>AnomReason and AnomAgent serve as a foundation for measuring and improving the semantic plausibility of AI-generated images.
  arXiv  Detail & Related papers  (2025-10-11T14:09:24Z)
• Self-Supervised Anatomical Consistency Learning for Vision-Grounded Medical Report Generation [61.350584471060756]
  Vision-grounded medical report generation aims to produce clinically accurate descriptions of medical images.<n>We propose Self-Supervised Anatomical Consistency Learning (SS-ACL) to align generated reports with corresponding anatomical regions.<n>SS-ACL constructs a hierarchical anatomical graph inspired by the invariant top-down inclusion structure of human anatomy.
  arXiv  Detail & Related papers  (2025-09-30T08:59:06Z)
• Cross-Modal Causal Intervention for Medical Report Generation [107.76649943399168]
  Radiology Report Generation (RRG) is essential for computer-aided diagnosis and medication guidance.<n> generating accurate lesion descriptions remains challenging due to spurious correlations from visual-linguistic biases.<n>We propose a two-stage framework named CrossModal Causal Representation Learning (CMCRL)<n> Experiments on IU-Xray and MIMIC-CXR show that our CMCRL pipeline significantly outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-03-16T07:23:55Z)
• Learning Inductive Attention Guidance for Partially Supervised Pancreatic Ductal Adenocarcinoma Prediction [73.96902906734522]
  Pancreatic ductal adenocarcinoma (PDAC) is the third most common cause of cancer death in the United States. In this paper, we consider a partially supervised setting, where cheap image-level annotations are provided for all the training data, and the costly per-voxel annotations are only available for a subset of them. We propose an Inductive Attention Guidance Network (IAG-Net) to jointly learn a global image-level classifier for normal/PDAC classification and a local voxel-level classifier for semi-supervised PDAC segmentation.
  arXiv  Detail & Related papers  (2021-05-31T08:16:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.