ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET

• URL: http://arxiv.org/abs/2606.29577v1
• Date: Sun, 28 Jun 2026 19:43:03 GMT
• Title: ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET
• Abstract summary: We propose ReMAP-PET to treat PET as structured, interpretable, and language-compatible representations.<n>Our results show that grounding PET encoders in regional metabolic semantics yields representations that are structured, interpretable, and language-compatible.
• Score: 20.566933407659093
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Positron Emission Tomography (PET) reveals brain metabolism and is clinically central to neurodegenerative disease assessment, yet existing 3D brain foundation models treat PET as generic volumetric data, missing the structured regional metabolic information that distinguishes it from structural neuroimaging. To address these limitations, we propose ReMAP-PET, a framework that moves beyond visual encoding by supervising a partially-tuned MedicalNet 3D ResNet-50 with brain regional standardized uptake value ratio (SUVR) profiles through joint regression and contrastive objectives, enabling the encoder to learn the metabolic semantics underlying PET modality. On 1015 paired PET--SUVR samples, ReMAP-PET achieves 0.070 SUVR MAE and 77.8% PET SUVR Recall@1, substantially outperforming five frozen pretrained baselines. We further connect the metabolic embedding to clinical language via contrastive alignment with frozen BioClinicalBERT and demonstrate end-to-end PET-to-report generation through SUVR-constrained verbalization. Linear probing on diagnostic classification and cognitive regression tasks confirms that the embeddings retain clinically relevant information without task-specific fine-tuning. Our results show that grounding PET encoders in regional metabolic semantics -- rather than treating PET as generic volumetric data -- yields representations that are structured, interpretable, and language-compatible, pointing to a new direction for metabolic-aware PET understanding.

Related papers

• 3D CT-to-PET Translation via Latent Brownian Bridge Diffusion [2.013258778704508]
  We propose a 3D CT-to-PET translation framework based on latent Brownian Bridge Diffusion (BBDM)<n>The proposed approach improves PET signal fidelity, better preserves clinically relevant uptake patterns, and shows improved performance in preserving small-lesion metabolic activation.
  arXiv  Detail & Related papers  (2026-09-11T13:47:50Z)
• A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancer [0.0]
  18F-FDG PET/CT plays a central role in staging, treatment planning, and response assessment for head and neck cancer.<n>We present a proof of concept deep learning framework for synthesizing PET like images directly from routine CT scans.
  arXiv  Detail & Related papers  (2026-07-23T20:33:50Z)
• Weakly Supervised Pathology-Informed Representation Learning for PET-Based Content Retrieval of Intra-Tumour Heterogeneity [0.16999906736255554]
  The proposed method was designed to use H&E derived information during training while maintaining PET only inference.<n>A teacher student training strategy was used to learn the PET tumour derived voxel representations.
  arXiv  Detail & Related papers  (2026-07-21T06:40:14Z)
• The autoPET3 Challenge: Automated Lesion Segmentation in Whole-Body PET/CT $\unicode{x2013}$ Multitracer Multicenter Generalization [67.92281859568168]
  We report the design and results of the third autoPET challenge (MICCAI 2024)<n>It benchmarked automated lesion segmentation in whole-body PET/CT under a compositional generalization setting.<n>The top-ranked algorithm achieved a mean DSC of 0.66, FNV of 3.18 mL, and FPV of 2.78 mL across all four test conditions.
  arXiv  Detail & Related papers  (2026-05-07T07:07:09Z)
• MlPET: A Localized Neural Network Approach for Probabilistic Post-Reconstruction PET Image Analysis Using Informed Priors [0.0]
  We develop and evaluate MlPET, a fast localized machine learning approach for probabilistic PET image analysis.<n>MlPET replaces computationally demanding Markov chain Monte Carlo sampling with a localized neural network trained to estimate posterior mean voxel activity from small image neighborhoods.<n>Performance was evaluated on NEMA IEC phantom data from three PET systems.
  arXiv  Detail & Related papers  (2026-01-25T22:41:50Z)
• Unveiling and Bridging the Functional Perception Gap in MLLMs: Atomic Visual Alignment and Hierarchical Evaluation via PET-Bench [48.60251555171943]
  Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in tasks such as abnormality detection and report generation for anatomical modalities.<n>In this work, we quantify a fundamental functional perception gap: the inability of current vision encoders to decode functional tracer biodistribution independent of morphological priors.<n>We introduce PET-Bench, the first large-scale functional imaging benchmark comprising 52,308 hierarchical QA pairs from 9,732 multi-site, multi-tracer PET studies.<n>Our results demonstrate that AVA effectively bridges the perception gap, transforming CoT from a source of hallucination into a robust inference tool and improving diagnostic
  arXiv  Detail & Related papers  (2026-01-06T05:58:50Z)
• Vision-Language Models for Automated 3D PET/CT Report Generation [13.781844347232079]
  AutoPET/CT report generation is increasingly important for reducing clinical workload.<n>PETRG-3D is an end-to-end 3D dual-branch framework that encodes PET and CT volumes and incorporates style-adaptive prompts.<n>PETRG-Score is a lymphoma-specific evaluation protocol that measures metabolic and structural findings across curated anatomical regions.
  arXiv  Detail & Related papers  (2025-11-25T10:07:57Z)
• TauGenNet: Plasma-Driven Tau PET Image Synthesis via Text-Guided 3D Diffusion Models [6.674230585698143]
  We propose a text-guided 3D diffusion model for 3D tau PET image synthesis, leveraging multimodal conditions from both structural MRI and plasma measurement.<n> Experimental results demonstrate that our approach can generate realistic, clinically meaningful 3D tau PET across a range of disease stages.
  arXiv  Detail & Related papers  (2025-09-04T14:45:50Z)
• Supervised Diffusion-Model-Based PET Image Reconstruction [44.89560992517543]
  Diffusion models (DMs) have been introduced as a regularizing prior for PET image reconstruction.<n>We propose a supervised DM-based algorithm for PET reconstruction.<n>Our method enforces the non-negativity of PET's Poisson likelihood model and accommodates the wide intensity range of PET images.
  arXiv  Detail & Related papers  (2025-06-30T16:39:50Z)
• HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning [55.88910947643436]
  We propose a unified framework for continual learning (CL) with pre-trained models (PTMs) and parameter-efficient tuning (PET)<n>We present Hierarchical Decomposition PET (HiDe-PET), an innovative approach that explicitly optimize the objective through incorporating task-specific and task-shared knowledge.<n>Our approach demonstrates remarkably superior performance over a broad spectrum of recent strong baselines.
  arXiv  Detail & Related papers  (2024-07-07T01:50:25Z)
• Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans [2.3432822395081807]
  This work introduces a Siamese CNN approach for lesion tracking between PET/CT scans. Our algorithm extracts suitable lesion patches and forwards them into a Siamese CNN trained to classify the lesion patch pairs as corresponding or non-corresponding lesions. Experiments have been performed with different input patch types and a Siamese network in 2D and 3D.
  arXiv  Detail & Related papers  (2024-06-13T17:06:15Z)
• Contrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine PET Reconstruction [62.29541106695824]
  This paper presents a coarse-to-fine PET reconstruction framework that consists of a coarse prediction module (CPM) and an iterative refinement module (IRM) By delegating most of the computational overhead to the CPM, the overall sampling speed of our method can be significantly improved. Two additional strategies, i.e., an auxiliary guidance strategy and a contrastive diffusion strategy, are proposed and integrated into the reconstruction process.
  arXiv  Detail & Related papers  (2023-08-20T04:10:36Z)
• A Unified Continual Learning Framework with General Parameter-Efficient Tuning [56.250772378174446]
  "Pre-training $rightarrow$ downstream adaptation" presents both new opportunities and challenges for Continual Learning. We position prompting as one instantiation of PET, and propose a unified CL framework, dubbed as Learning-Accumulation-Ensemble (LAE) PET, e.g., using Adapter, LoRA, or Prefix, can adapt a pre-trained model to downstream tasks with fewer parameters and resources.
  arXiv  Detail & Related papers  (2023-03-17T15:52:45Z)
• Synthetic PET via Domain Translation of 3D MRI [1.0052333944678682]
  We use a dataset of 56 $18$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. The predicted PET images are forward projected to produce synthetic PET time-of-flight sinograms that can be used with vendor-provided PET reconstruction algorithms.
  arXiv  Detail & Related papers  (2022-06-11T21:32:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.