Vector Representations of Vessel Trees
- URL: http://arxiv.org/abs/2506.11163v1
- Date: Wed, 11 Jun 2025 20:34:08 GMT
- Title: Vector Representations of Vessel Trees
- Authors: James Batten, Michiel Schaap, Matthew Sinclair, Ying Bai, Ben Glocker,
- Abstract summary: We introduce a novel framework for learning vector representations of tree-structured geometric data focusing on 3D vascular networks.<n>Our framework, named VeTTA, offers precise, flexible, and topologically consistent modeling of anatomical tree structures in medical imaging.
- Score: 12.391128284848135
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We introduce a novel framework for learning vector representations of tree-structured geometric data focusing on 3D vascular networks. Our approach employs two sequentially trained Transformer-based autoencoders. In the first stage, the Vessel Autoencoder captures continuous geometric details of individual vessel segments by learning embeddings from sampled points along each curve. In the second stage, the Vessel Tree Autoencoder encodes the topology of the vascular network as a single vector representation, leveraging the segment-level embeddings from the first model. A recursive decoding process ensures that the reconstructed topology is a valid tree structure. Compared to 3D convolutional models, this proposed approach substantially lowers GPU memory requirements, facilitating large-scale training. Experimental results on a 2D synthetic tree dataset and a 3D coronary artery dataset demonstrate superior reconstruction fidelity, accurate topology preservation, and realistic interpolations in latent space. Our scalable framework, named VeTTA, offers precise, flexible, and topologically consistent modeling of anatomical tree structures in medical imaging.
Related papers
- Hierarchical Part-based Generative Model for Realistic 3D Blood Vessel [11.568409945642584]
We propose a hierarchical part-based frame work for 3D vessel generation that separates the global binary tree-like topology from local geometric details.<n>This work marks the first successful application of a part-based generative approach for 3D vessel modeling, setting a new benchmark for vascular data generation.
arXiv Detail & Related papers (2025-07-21T03:52:25Z) - Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning [50.684254969269546]
We introduce a novel method for acquiring boundary representations (B-Reps) of 3D CAD models.
We apply a spatial partitioning to derive a single primitive within each partition.
We show that our network, coined NVD-Net for neural Voronoi diagrams, can effectively learn Voronoi partitions for CAD models from training data.
arXiv Detail & Related papers (2024-06-07T21:07:49Z) - Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D
Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full
and Sparse Annotations [32.69359482975795]
This work presents a novel framework based on hybrid 2D-3D convolutional neural networks (CNNs) to obtain continuous 3D retinal layer surfaces from OCT volumes.
Experiments on a synthetic dataset and three public clinical datasets show that our framework can effectively align the B-scans for potential motion correction.
arXiv Detail & Related papers (2023-12-04T08:32:31Z) - Interpretable 2D Vision Models for 3D Medical Images [47.75089895500738]
This study proposes a simple approach of adapting 2D networks with an intermediate feature representation for processing 3D images.
We show on all 3D MedMNIST datasets as benchmark and two real-world datasets consisting of several hundred high-resolution CT or MRI scans that our approach performs on par with existing methods.
arXiv Detail & Related papers (2023-07-13T08:27:09Z) - Unsupervised Discovery of 3D Hierarchical Structure with Generative
Diffusion Features [22.657405088126012]
We show that features of diffusion models capture different hierarchy levels in 3D biomedical images.
We train a predictive unsupervised segmentation network that encourages the decomposition of 3D volumes into meaningful nested subvolumes.
Our models achieve better performance than prior unsupervised structure discovery approaches on challenging synthetic datasets and on a real-world brain tumor MRI dataset.
arXiv Detail & Related papers (2023-04-28T19:37:17Z) - Image To Tree with Recursive Prompting [16.56278942191951]
We propose a novel approach to predicting tree connectivity structure which reformulates the task as an optimization problem over individual steps.
Our proposed method achieves compelling results on a pair of synthetic datasets, and outperforms a shortest-path baseline.
arXiv Detail & Related papers (2023-01-01T17:35:24Z) - Enforcing connectivity of 3D linear structures using their 2D
projections [54.0598511446694]
We propose to improve the 3D connectivity of our results by minimizing a sum of topology-aware losses on their 2D projections.
This suffices to increase the accuracy and to reduce the annotation effort required to provide the required annotated training data.
arXiv Detail & Related papers (2022-07-14T11:42:18Z) - Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D
Shapes [77.6741486264257]
We introduce an efficient neural representation that, for the first time, enables real-time rendering of high-fidelity neural SDFs.
We show that our representation is 2-3 orders of magnitude more efficient in terms of rendering speed compared to previous works.
arXiv Detail & Related papers (2021-01-26T18:50:22Z) - TSGCNet: Discriminative Geometric Feature Learning with Two-Stream
GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes.
We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
arXiv Detail & Related papers (2020-12-26T08:02:56Z) - TopNet: Topology Preserving Metric Learning for Vessel Tree
Reconstruction and Labelling [22.53041565779104]
We propose a novel deep learning architecture for vessel tree reconstruction.
The network architecture simultaneously solves the task of detecting voxels on vascular centerlines (i.e. nodes) and estimates connectivity between center-voxels (edges) in the tree structure to be reconstructed.
A thorough evaluation on public IRCAD dataset shows that the proposed method considerably outperforms existing semantic segmentation based methods.
arXiv Detail & Related papers (2020-09-18T07:55:58Z) - Learning Local Neighboring Structure for Robust 3D Shape Representation [143.15904669246697]
Representation learning for 3D meshes is important in many computer vision and graphics applications.
We propose a local structure-aware anisotropic convolutional operation (LSA-Conv)
Our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.
arXiv Detail & Related papers (2020-04-21T13:40:03Z) - clDice -- A Novel Topology-Preserving Loss Function for Tubular
Structure Segmentation [57.20783326661043]
We introduce a novel similarity measure termed centerlineDice (short clDice)
We theoretically prove that clDice guarantees topology preservation up to homotopy equivalence for binary 2D and 3D segmentation.
We benchmark the soft-clDice loss on five public datasets, including vessels, roads and neurons (2D and 3D)
arXiv Detail & Related papers (2020-03-16T16:27:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.