VesselGPT: Autoregressive Modeling of Vascular Geometry

• URL: http://arxiv.org/abs/2505.13318v2
• Date: Mon, 23 Jun 2025 13:57:18 GMT
• Title: VesselGPT: Autoregressive Modeling of Vascular Geometry
• Authors: Paula Feldman, Martin Sinnona, Claudio Delrieux, Viviana Siless, Emmanuel Iarussi,
• Abstract summary: Anatomical trees are critical for clinical diagnosis and treatment planning.<n>Motivated by the latest advances in large language models, we introduce an autoregressive method for anatomical trees.<n>This work is the first to generate blood vessels in an autoregressive manner.
• Score: 0.7722830505405722
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Anatomical trees are critical for clinical diagnosis and treatment planning, yet their complex and diverse geometry make accurate representation a significant challenge. Motivated by the latest advances in large language models, we introduce an autoregressive method for synthesizing anatomical trees. Our approach first embeds vessel structures into a learned discrete vocabulary using a VQ-VAE architecture, then models their generation autoregressively with a GPT-2 model. This method effectively captures intricate geometries and branching patterns, enabling realistic vascular tree synthesis. Comprehensive qualitative and quantitative evaluations reveal that our technique achieves high-fidelity tree reconstruction with compact discrete representations. Moreover, our B-spline representation of vessel cross-sections preserves critical morphological details that are often overlooked in previous' methods parameterizations. To the best of our knowledge, this work is the first to generate blood vessels in an autoregressive manner. Code is available at https://github.com/LIA-DiTella/VesselGPT-MICCAI.

Related papers

• GRASPing Anatomy to Improve Pathology Segmentation [67.98147643529309]
  We introduce GRASP, a modular plug-and-play framework that enhances pathology segmentation models.<n>We evaluate GRASP on two PET/CT datasets, conduct systematic ablation studies, and investigate the framework's inner workings.
  arXiv  Detail & Related papers  (2025-08-05T12:26:36Z)
• Recursive Variational Autoencoders for 3D Blood Vessel Generative Modeling [0.7722830505405722]
  We developed a Recursive variational Neural Network (RvNN) that fully exploits the hierarchical organization of the vessel.<n>RvNN learns a low-dimensional manifold encoding branch connectivity along with geometry features describing the target surface.<n>We generate 3D models of blood vessels that are both accurate and diverse, which is crucial for medical and surgical training, hemodynamic simulations, and many other purposes.
  arXiv  Detail & Related papers  (2025-06-17T18:47:27Z)
• Vector Representations of Vessel Trees [12.391128284848135]
  We introduce a novel framework for learning vector representations of tree-structured geometric data focusing on 3D vascular networks.<n>Our framework, named VeTTA, offers precise, flexible, and topologically consistent modeling of anatomical tree structures in medical imaging.
  arXiv  Detail & Related papers  (2025-06-11T20:34:08Z)
• SeqSeg: Learning Local Segments for Automatic Vascular Model Construction [2.4567747195551175]
  SeqSeg is a novel deep learning based automatic tracing and segmentation algorithm for constructing image-based vascular models.<n>We demonstrate that SeqSeg is able to segment more complete vasculature and is able to generalize to vascular structures not annotated in the training data.
  arXiv  Detail & Related papers  (2025-01-27T00:31:30Z)
• DVasMesh: Deep Structured Mesh Reconstruction from Vascular Images for Dynamics Modeling of Vessels [33.69621458523397]
  Vessel dynamics simulation is vital in studying the relationship between geometry and vascular disease progression. Reliable dynamics simulation relies on high-quality vascular meshes.<n>Most of the existing mesh generation methods highly depend on manual annotation, which is time-consuming and laborious.<n>We propose a deep learning-based method, dubbed as DVasMesh, to directly generate structured hexahedral vascular meshes from vascular images.
  arXiv  Detail & Related papers  (2024-12-01T15:05:28Z)
• TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs [49.69047720285225]
  We propose a novel topological approach that explicitly extracts multi-scale topological structures to better approximate breast parenchymal structures. We empirically validate emphTopoTxR using the VICTRE phantom breast dataset. Our qualitative and quantitative analyses suggest differential topological behavior of breast tissue in treatment-na"ive imaging.
  arXiv  Detail & Related papers  (2024-11-05T19:35:10Z)
• Transformer-Based Self-Supervised Learning for Histopathological Classification of Ischemic Stroke Clot Origin [0.0]
  Identifying the thromboembolism source in ischemic stroke is crucial for treatment and secondary prevention. This study describes a self-supervised deep learning approach in digital pathology of emboli for classifying ischemic stroke clot origin.
  arXiv  Detail & Related papers  (2024-05-01T23:40:12Z)
• An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation [45.820901263103806]
  Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs) We develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space. We extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability.
  arXiv  Detail & Related papers  (2024-03-10T21:33:53Z)
• VesselVAE: Recursive Variational Autoencoders for 3D Blood Vessel Synthesis [0.879967413208593]
  We present a data-driven generative framework for synthesizing blood vessel 3D geometry. VesselVAE fully exploits the hierarchical organization of the vessel and learns a low-dimensional manifold. We generate 3D models of blood vessels that are both accurate and diverse, which is crucial for medical and surgical training, hemodynamic simulations, and many other purposes.
  arXiv  Detail & Related papers  (2023-07-07T13:35:48Z)
• A Hybrid Approach to Full-Scale Reconstruction of Renal Arterial Network [5.953404851562665]
  We propose a hybrid framework to build subject-specific models of the renal vascular network. We use semi-automated segmentation of large arteries and estimation of cortex area from a micro-CT scan as a starting point. Our results show a statistical correspondence between the reconstructed data and existing anatomical data obtained from a rat kidney.
  arXiv  Detail & Related papers  (2023-03-03T10:39:25Z)
• Orientation-Shared Convolution Representation for CT Metal Artifact Learning [63.67718355820655]
  During X-ray computed tomography (CT) scanning, metallic implants carrying with patients often lead to adverse artifacts. Existing deep-learning-based methods have gained promising reconstruction performance. We propose an orientation-shared convolution representation strategy to adapt the physical prior structures of artifacts.
  arXiv  Detail & Related papers  (2022-12-26T13:56:12Z)
• Ultrasound Signal Processing: From Models to Deep Learning [64.56774869055826]
  Medical ultrasound imaging relies heavily on high-quality signal processing to provide reliable and interpretable image reconstructions. Deep learning based methods, which are optimized in a data-driven fashion, have gained popularity. A relatively new paradigm combines the power of the two: leveraging data-driven deep learning, as well as exploiting domain knowledge.
  arXiv  Detail & Related papers  (2022-04-09T13:04:36Z)
• A multi-stage machine learning model on diagnosis of esophageal manometry [50.591267188664666]
  The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage. This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
  arXiv  Detail & Related papers  (2021-06-25T20:09:23Z)
• A Twin Neural Model for Uplift [59.38563723706796]
  Uplift is a particular case of conditional treatment effect modeling. We propose a new loss function defined by leveraging a connection with the Bayesian interpretation of the relative risk. We show our proposed method is competitive with the state-of-the-art in simulation setting and on real data from large scale randomized experiments.
  arXiv  Detail & Related papers  (2021-05-11T16:02:39Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Hyperbolic Neural Networks++ [66.16106727715061]
  We generalize the fundamental components of neural networks in a single hyperbolic geometry model, namely, the Poincar'e ball model. Experiments show the superior parameter efficiency of our methods compared to conventional hyperbolic components, and stability and outperformance over their Euclidean counterparts.
  arXiv  Detail & Related papers  (2020-06-15T08:23:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.