TractShapeNet: Efficient Multi-Shape Learning with 3D Tractography Point Clouds

• URL: http://arxiv.org/abs/2410.22099v4
• Date: Fri, 14 Feb 2025 14:46:03 GMT
• Title: TractShapeNet: Efficient Multi-Shape Learning with 3D Tractography Point Clouds
• Authors: Yui Lo, Yuqian Chen, Dongnan Liu, Jon Haitz Legarreta, Leo Zekelman, Fan Zhang, Jarrett Rushmore, Yogesh Rathi, Nikos Makris, Alexandra J. Golby, Weidong Cai, Lauren J. O'Donnell,
• Abstract summary: We introduce a novel framework, TractShapeNet, that leverages a point cloud representation of tractography to compute five shape measures.<n> Experiments for shape measure computation demonstrate that our proposed TractShapeNet outperforms other point cloud-based neural network models.<n>Our results demonstrate that a deep learning approach enables faster and more efficient shape measure computation.
• Score: 39.93585584930809
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Brain imaging studies have demonstrated that diffusion MRI tractography geometric shape descriptors can inform the study of the brain's white matter pathways and their relationship to brain function. In this work, we investigate the possibility of utilizing a deep learning model to compute shape measures of the brain's white matter connections. We introduce a novel framework, TractShapeNet, that leverages a point cloud representation of tractography to compute five shape measures: length, span, volume, total surface area, and irregularity. We assess the performance of the method on a large dataset including 1065 healthy young adults. Experiments for shape measure computation demonstrate that our proposed TractShapeNet outperforms other point cloud-based neural network models in both the Pearson correlation coefficient and normalized error metrics. We compare the inference runtime results with the conventional shape computation tool DSI-Studio. Our results demonstrate that a deep learning approach enables faster and more efficient shape measure computation. We also conduct experiments on two downstream language cognition prediction tasks, showing that shape measures from TractShapeNet perform similarly to those computed by DSI-Studio. Our code will be available at: https://github.com/SlicerDMRI/TractShapeNet.

Related papers

• Geometric Operator Learning with Optimal Transport [77.16909146519227]
  We propose integrating optimal transport (OT) into operator learning for partial differential equations (PDEs) on complex geometries.<n>For 3D simulations focused on surfaces, our OT-based neural operator embeds the surface geometry into a 2D parameterized latent space.<n> Experiments with Reynolds-averaged Navier-Stokes equations (RANS) on the ShapeNet-Car and DrivAerNet-Car datasets show that our method achieves better accuracy and also reduces computational expenses.
  arXiv  Detail & Related papers  (2025-07-26T21:28:25Z)
• A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography [40.91207723143099]
  We propose Tract2Shape, a novel deep learning framework to predict ten white matter tractography shape measures. To enhance model efficiency, we utilize a dimensionality reduction algorithm for the model to predict five primary shape components. We evaluate the performance of Tract2Shape by training and testing it on the HCP-YA dataset and the unseen PPMI dataset.
  arXiv  Detail & Related papers  (2025-04-25T14:54:47Z)
• Coverage Axis++: Efficient Inner Point Selection for 3D Shape Skeletonization [49.47444127373479]
  Coverage Axis++ is a novel and efficient approach to 3D shape skeletonization. It offers a high-accuracy approximation of the Medial Axis Transform (MAT)
  arXiv  Detail & Related papers  (2024-01-23T18:07:07Z)
• Geometry-Informed Neural Operator for Large-Scale 3D PDEs [76.06115572844882]
  We propose the geometry-informed neural operator (GINO) to learn the solution operator of large-scale partial differential equations. We successfully trained GINO to predict the pressure on car surfaces using only five hundred data points.
  arXiv  Detail & Related papers  (2023-09-01T16:59:21Z)
• Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures [2.167843405313757]
  3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. Many generative learning algorithms require correspondence between each point when comparing the predicted shape and the target shape. We propose an architecture able to cope with different parameterizations, even during the training phase.
  arXiv  Detail & Related papers  (2023-06-27T19:27:15Z)
• An Information-Theoretic Analysis of Compute-Optimal Neural Scaling Laws [24.356906682593532]
  We study the compute-optimal trade-off between model and training data set sizes for large neural networks. Our result suggests a linear relation similar to that supported by the empirical analysis of chinchilla.
  arXiv  Detail & Related papers  (2022-12-02T18:46:41Z)
• Adaptive Convolutional Dictionary Network for CT Metal Artifact Reduction [62.691996239590125]
  We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction. Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image. Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
  arXiv  Detail & Related papers  (2022-05-16T06:49:36Z)
• Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data [50.23363975709122]
  We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data. We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem. We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
  arXiv  Detail & Related papers  (2022-02-18T22:41:51Z)
• A computational geometry approach for modeling neuronal fiber pathways [10.741721423684305]
  Tractography constructs complex neuronal fibers in three dimensions that exhibit the geometry of white matter pathways in the brain. We develop a computational geometry-based tractography representation that aims to simplify the connectivity of white matter fibers. Using diffusion MRI data from Alzheimer's patient study, we extract tractography features from our model for distinguishing the Alzheimer's subject from the normal control.
  arXiv  Detail & Related papers  (2021-08-02T21:16:29Z)
• Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images [18.650642666164252]
  We propose an adversarial shape learning network (ASLNet) to model the building shape patterns. Experiments show that the proposed ASLNet improves both the pixel-based accuracy and the object-based measurements by a large margin.
  arXiv  Detail & Related papers  (2021-02-22T18:49:43Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondence [31.840880075039944]
  We present a novel learning-based approach for computing correspondences between non-rigid 3D shapes. Key to our method is a feature-extraction network that learns directly from raw shape geometry.
  arXiv  Detail & Related papers  (2020-03-31T15:20:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.