ALTER: Modeling Longitudinal Changes via Regional Differencing for 3D CT Report Generation
- URL: http://arxiv.org/abs/2608.05615v1
- Date: Thu, 06 Aug 2026 05:27:38 GMT
- Title: ALTER: Modeling Longitudinal Changes via Regional Differencing for 3D CT Report Generation
- Abstract summary: Anatomically Localized Temporal Evidence Representation (ALTER)<n>General Prior Integration (GPI) incorporates the prior CT and report to establish historical context for the current examination.<n>Regional Proxy Differencing (RPD) enables each current anatomical region to retrieve a historical proxy from a single shared encoding of the prior volume and to derive localized interval evidence.<n> Interval Change Fusion (ICF) converts current abnormality states with region-distributed differences into change-aware soft prompts that guide report generation.
- Score: 2.9905735389905153
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Computed tomography (CT) is widely used for clinical diagnosis and longitudinal follow-up, yet automatically generating accurate and complete radiology reports from three-dimensional (3D) CT remains challenging. Existing methods improve fine-grained correspondence between images and text by modeling anatomical regions, but remain centered on the current examination. Consequently, patient-specific longitudinal changes within individual regions remain insufficiently modeled. Meanwhile, interval changes are often distributed across multiple anatomical regions, complicating a coherent assessment of the overall longitudinal state. We propose Anatomically Localized Temporal Evidence Representation (ALTER) to address these limitations. Global Prior Integration (GPI) incorporates the prior CT and report to establish historical context for the current examination. Regional Proxy Differencing (RPD) enables each current anatomical region to retrieve a historical proxy from a single shared encoding of the prior volume and to derive localized interval evidence. Interval Change Fusion (ICF) further combines current abnormality states with region-distributed differences, converting their joint representation into change-aware soft prompts that guide report generation. ALTER achieves state-of-the-art results on most evaluation metrics across the RadGenome-ChestCT validation and CTRG-Chest-548K test sets. Code and data preprocessing details are available at https://github.com/peytonkarlie/ALTER/tree/main.
Related papers
- How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning? [49.14050864978079]
We introduce the Time-Aware Multi-View MRI Benchmark, an evaluation framework unifying multi-view anatomical input, temporal reasoning, and structured localization guidance.<n>The benchmark comprises 3,920 expert-verified question-answer pairs derived from 890 patients across over 3,200 longitudinal MRI timepoints.
arXiv Detail & Related papers (2026-08-13T14:35:20Z) - CT-$Δ$Bench: A Benchmark for Longitudinal 3D Medical Imaging Difference Reporting with Vision-Language Models [21.022823890203597]
longitudinal imaging difference reporting is a task in which a model takes two temporally separated scans from the same patient and generates a clinically meaningful report.<n>We introduce CT-$$Bench, a dedicated benchmark for this task with patient-level splitting to prevent information leakage.<n>We also develop change-aware metrics specifically designed to capture clinically meaningful longitudinal changes, and conduct an independent physician validation.
arXiv Detail & Related papers (2026-08-12T00:55:31Z) - Empirical investigation of 3D CT Foundation Models and Unsupervised Adaptation for Head and Neck Cancer Recurrence Prediction [0.5999777817331317]
We benchmarked several 3D CT foundation models for predicting recurrence-free survival in head and neck cancer.<n>Our findings reveal persistent difficulty in identifying features that generalize consistently across different imaging distributions.
arXiv Detail & Related papers (2026-07-29T08:57:16Z) - GRCD: Grounded Region Change Detection for Multi-Finding Chest X-Ray Pairs [7.272024968089535]
GRCD is a framework for grounded report generation from chest X-ray pairs in the multi-finding setting.<n>We first construct a rigorously cleaned dataset of temporal chest X-ray pairs.<n>We then introduce a Region-Guided Change Token module that encodes per-region temporal change across anatomical structures.
arXiv Detail & Related papers (2026-07-02T19:14:50Z) - SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation [22.24208120178663]
We propose SliceWorld, a CT-specific world-state framework that treats an axial CT scan as an ordered sequence along the z-axis.<n>We show that SliceWorld improves natural language generation metrics and clinically oriented automatic evaluation.
arXiv Detail & Related papers (2026-05-23T03:18:56Z) - MedScribe: Clinically Grounded CT Reporting through Agentic Workflows [13.40306812882295]
Vision-language models (VLMs) have shown potential for automated radiology report generation.<n>We introduce MedScribe, a hypothesis-driven framework that reformulates report generation as an iterative evidence acquisition process.
arXiv Detail & Related papers (2026-05-03T08:32:40Z) - EXACT: an explainable anomaly-aware vision foundation model for analysis of 3D chest CT [29.0378459959757]
EXACT is an anomaly-aware foundation model for three-dimensional chest CT.<n>It learns spatially resolved representations from paired clinical scans and radiology reports.<n> EXACT shows consistent improvements across clinically relevant CT tasks.
arXiv Detail & Related papers (2026-04-27T07:57:47Z) - A Continual Learning-driven Model for Accurate and Generalizable Segmentation of Clinically Comprehensive and Fine-grained Whole-body Anatomies in CT [67.34586036959793]
There is no fully annotated CT dataset with all anatomies delineated for training.<n>We propose a novel continual learning-driven CT model that can segment complete anatomies.<n>Our single unified CT segmentation model, CL-Net, can highly accurately segment a clinically comprehensive set of 235 fine-grained whole-body anatomies.
arXiv Detail & Related papers (2025-03-16T23:55:02Z) - HC-LLM: Historical-Constrained Large Language Models for Radiology Report Generation [89.3260120072177]
We propose a novel Historical-Constrained Large Language Models (HC-LLM) framework for Radiology report generation.<n>Our approach extracts both time-shared and time-specific features from longitudinal chest X-rays and diagnostic reports to capture disease progression.<n> Notably, our approach performs well even without historical data during testing and can be easily adapted to other multimodal large models.
arXiv Detail & Related papers (2024-12-15T06:04:16Z) - RadGenome-Chest CT: A Grounded Vision-Language Dataset for Chest CT Analysis [56.57177181778517]
RadGenome-Chest CT is a large-scale, region-guided 3D chest CT interpretation dataset based on CT-RATE.
We leverage the latest powerful universal segmentation and large language models to extend the original datasets.
arXiv Detail & Related papers (2024-04-25T17:11:37Z) - A unified 3D framework for Organs at Risk Localization and Segmentation
for Radiation Therapy Planning [56.52933974838905]
Current medical workflow requires manual delineation of organs-at-risk (OAR)
In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation.
Our proposed framework fully enables the exploitation of 3D context information inherent in medical imaging.
arXiv Detail & Related papers (2022-03-01T17:08:41Z) - Explainable multiple abnormality classification of chest CT volumes with
AxialNet and HiResCAM [89.2175350956813]
We introduce the challenging new task of explainable multiple abnormality classification in volumetric medical images.
We propose a multiple instance learning convolutional neural network, AxialNet, that allows identification of top slices for each abnormality.
We then aim to improve the model's learning through a novel mask loss that leverages HiResCAM and 3D allowed regions.
arXiv Detail & Related papers (2021-11-24T01:14:33Z) - Deep Reinforcement Learning for Organ Localization in CT [59.23083161858951]
We propose a deep reinforcement learning approach for organ localization in CT.
In this work, an artificial agent is actively self-taught to localize organs in CT by learning from its asserts and mistakes.
Our method can use as a plug-and-play module for localizing any organ of interest.
arXiv Detail & Related papers (2020-05-11T10:06:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.