Temporal Flow Matching for Learning Spatio-Temporal Trajectories in 4D Longitudinal Medical Imaging

• URL: http://arxiv.org/abs/2508.21580v1
• Date: Fri, 29 Aug 2025 12:34:28 GMT
• Title: Temporal Flow Matching for Learning Spatio-Temporal Trajectories in 4D Longitudinal Medical Imaging
• Authors: Nico Albert Disch, Yannick Kirchhoff, Robin Peretzke, Maximilian Rokuss, Saikat Roy, Constantin Ulrich, David Zimmerer, Klaus Maier-Hein,
• Abstract summary: We introduce Temporal Flow Matching (TFM), a unified generative trajectory method that aims to learn the underlying temporal distribution.<n>TFM consistently surpasses disease-temporal modeling methods from natural imaging.<n>It supports $3D$ volumes, multiple prior scans, and irregular sampling.
• Score: 4.916511768554556
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding temporal dynamics in medical imaging is crucial for applications such as disease progression modeling, treatment planning and anatomical development tracking. However, most deep learning methods either consider only single temporal contexts, or focus on tasks like classification or regression, limiting their ability for fine-grained spatial predictions. While some approaches have been explored, they are often limited to single timepoints, specific diseases or have other technical restrictions. To address this fundamental gap, we introduce Temporal Flow Matching (TFM), a unified generative trajectory method that (i) aims to learn the underlying temporal distribution, (ii) by design can fall back to a nearest image predictor, i.e. predicting the last context image (LCI), as a special case, and (iii) supports $3D$ volumes, multiple prior scans, and irregular sampling. Extensive benchmarks on three public longitudinal datasets show that TFM consistently surpasses spatio-temporal methods from natural imaging, establishing a new state-of-the-art and robust baseline for $4D$ medical image prediction.

Related papers

• CRONOS: Continuous Time Reconstruction for 4D Medical Longitudinal Series [4.916511768554555]
  We present CRONOS, a unified framework for many-to-one prediction from multiple past scans.<n>We will release code and evaluation protocols to enable reproducible, multi-dataset benchmarking of multi-context, continuous-time forecasting.
  arXiv  Detail & Related papers  (2025-12-18T14:16:46Z)
• Conditional Neural ODE for Longitudinal Parkinson's Disease Progression Forecasting [51.906871559732245]
  Parkinson's disease (PD) shows heterogeneous, evolving brain-morphometry patterns.<n>Modeling these longitudinal trajectories enables mechanistic insight, treatment development, and individualized 'digital-twin' forecasting.<n>We propose CNODE, a novel framework for continuous, individualized PD progression forecasting.
  arXiv  Detail & Related papers  (2025-11-06T20:16:33Z)
• Temporally-Aware Diffusion Model for Brain Progression Modelling with Bidirectional Temporal Regularisation [7.097850157718258]
  Current approaches fail to explicitly capture the relationship between structural changes and time intervals.<n>Most approaches rely on 2D slice-based architectures, thereby disregarding full 3D anatomical context.<n>We propose a 3D Temporally-Aware Diffusion Model (TADM-3D), which accurately predicts brain progression on MRI volumes.
  arXiv  Detail & Related papers  (2025-09-03T08:51:38Z)
• CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysis [50.56875995511431]
  We introduce a Cross-Modal Temporal Pattern Discovery (CTPD) framework, designed to efficiently extract meaningful cross-modal temporal patterns from multimodal EHR data.<n>Our approach introduces shared initial temporal pattern representations which are refined using slot attention to generate temporal semantic embeddings.
  arXiv  Detail & Related papers  (2024-11-01T15:54:07Z)
• Extrapolating Prospective Glaucoma Fundus Images through Diffusion Model in Irregular Longitudinal Sequences [46.80977922491862]
  The utilization of longitudinal datasets for glaucoma progression prediction offers a compelling approach to support early therapeutic interventions. We propose a novel diffusion-based model to predict prospective images by extrapolating from existing longitudinal fundus images of patients.
  arXiv  Detail & Related papers  (2024-10-28T15:31:47Z)
• Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training [99.2891802841936]
  We introduce the Med-ST framework for fine-grained spatial and temporal modeling. For spatial modeling, Med-ST employs the Mixture of View Expert (MoVE) architecture to integrate different visual features from both frontal and lateral views. For temporal modeling, we propose a novel cross-modal bidirectional cycle consistency objective by forward mapping classification (FMC) and reverse mapping regression (RMR)
  arXiv  Detail & Related papers  (2024-05-30T03:15:09Z)
• Spatiotemporal Representation Learning for Short and Long Medical Image Time Series [8.344657414044153]
  Analyzing temporal developments is crucial for the accurate prognosis of many medical conditions. tracking longer term developments that occur over months or years is essential for accurate prognosis. Despite importance of both short and long term analysis to clinical decision making they remain understudied in medical deep learning.
  arXiv  Detail & Related papers  (2024-03-12T10:47:29Z)
• Local Spatiotemporal Representation Learning for Longitudinally-consistent Neuroimage Analysis [7.568469725821069]
  This paper presents a local and multi-scaletemporal representation learning method for image-to-image architectures trained on longitudinal images. During finetuning, it proposes a surprisingly simple self-supervised segmentation consistency regularization to exploit intrasubject correlation. These improvements are demonstrated across both longitudinal neurodegenerative adult and developing infant brain MRI and yield both higher performance and longitudinal consistency.
  arXiv  Detail & Related papers  (2022-06-09T05:17:00Z)
• Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs [65.18780403244178]
  We propose a continuous model to forecast Multivariate Time series with dynamic Graph neural Ordinary Differential Equations (MTGODE) Specifically, we first abstract multivariate time series into dynamic graphs with time-evolving node features and unknown graph structures. Then, we design and solve a neural ODE to complement missing graph topologies and unify both spatial and temporal message passing.
  arXiv  Detail & Related papers  (2022-02-17T02:17:31Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• A Deep Learning Approach for Motion Forecasting Using 4D OCT Data [69.62333053044712]
  We propose 4D-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. Our best performing 4D method achieves motion forecasting with an overall average correlation of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.
  arXiv  Detail & Related papers  (2020-04-21T15:59:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.