Supervised Tractogram Filtering using Geometric Deep Learning
- URL: http://arxiv.org/abs/2212.03300v1
- Date: Tue, 6 Dec 2022 19:52:29 GMT
- Title: Supervised Tractogram Filtering using Geometric Deep Learning
- Authors: Pietro Astolfi, Ruben Verhagen, Laurent Petit, Emanuele Olivetti,
Silvio Sarubbo, Jonathan Masci, Davide Boscaini, Paolo Avesani
- Abstract summary: A tractogram is a virtual representation of the brain white matter.
A large portion of tractogram fibers is not anatomically plausible and can be considered artifacts of the tracking procedure.
We tackle the problem of filtering out such non-plausible fibers using a novel fully-supervised learning approach.
- Score: 7.387834089452367
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: A tractogram is a virtual representation of the brain white matter. It is
composed of millions of virtual fibers, encoded as 3D polylines, which
approximate the white matter axonal pathways. To date, tractograms are the most
accurate white matter representation and thus are used for tasks like
presurgical planning and investigations of neuroplasticity, brain disorders, or
brain networks. However, it is a well-known issue that a large portion of
tractogram fibers is not anatomically plausible and can be considered artifacts
of the tracking procedure. With Verifyber, we tackle the problem of filtering
out such non-plausible fibers using a novel fully-supervised learning approach.
Differently from other approaches based on signal reconstruction and/or brain
topology regularization, we guide our method with the existing anatomical
knowledge of the white matter. Using tractograms annotated according to
anatomical principles, we train our model, Verifyber, to classify fibers as
either anatomically plausible or non-plausible. The proposed Verifyber model is
an original Geometric Deep Learning method that can deal with variable size
fibers, while being invariant to fiber orientation. Our model considers each
fiber as a graph of points, and by learning features of the edges between
consecutive points via the proposed sequence Edge Convolution, it can capture
the underlying anatomical properties. The output filtering results highly
accurate and robust across an extensive set of experiments, and fast; with a
12GB GPU, filtering a tractogram of 1M fibers requires less than a minute.
Verifyber implementation and trained models are available at
https://github.com/FBK-NILab/verifyber.
Related papers
- Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing [72.45257414889478]
We aim to reduce human workload by predicting connectivity between over-segmented neuron pieces.
We first construct a dataset, named FlyTracing, that contains millions of pairwise connections of segments expanding the whole fly brain.
We propose a novel connectivity-aware contrastive learning method to generate dense volumetric EM image embedding.
arXiv Detail & Related papers (2024-01-05T19:45:12Z) - RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface
Normal Estimation and Manipulation [50.10282876199739]
This paper introduces RFTrans, an RGB-D-based method for surface normal estimation and manipulation of transparent objects.
It integrates the RFNet, which predicts refractive flow, object mask, and boundaries, followed by the F2Net, which estimates surface normal from the refractive flow.
A real-world robot grasping task witnesses an 83% success rate, proving that refractive flow can help enable direct sim-to-real transfer.
arXiv Detail & Related papers (2023-11-21T07:19:47Z) - TractCloud: Registration-free tractography parcellation with a novel
local-global streamline point cloud representation [63.842881844791094]
Current tractography parcellation methods rely heavily on registration, but registration inaccuracies can affect parcellation.
We propose TractCloud, a registration-free framework that performs whole-brain tractography parcellation directly in individual subject space.
arXiv Detail & Related papers (2023-07-18T06:35:12Z) - Superficial White Matter Analysis: An Efficient Point-cloud-based Deep
Learning Framework with Supervised Contrastive Learning for Consistent
Tractography Parcellation across Populations and dMRI Acquisitions [68.41088365582831]
White matter parcellation classifies tractography streamlines into clusters or anatomically meaningful tracts.
Most parcellation methods focus on the deep white matter (DWM), whereas fewer methods address the superficial white matter (SWM) due to its complexity.
We propose a novel two-stage deep-learning-based framework, Superficial White Matter Analysis (SupWMA), that performs an efficient parcellation of 198 SWM clusters from whole-brain tractography.
arXiv Detail & Related papers (2022-07-18T23:07:53Z) - Medulloblastoma Tumor Classification using Deep Transfer Learning with
Multi-Scale EfficientNets [63.62764375279861]
We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions.
Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
arXiv Detail & Related papers (2021-09-10T13:07:11Z) - A computational geometry approach for modeling neuronal fiber pathways [10.741721423684305]
Tractography constructs complex neuronal fibers in three dimensions that exhibit the geometry of white matter pathways in the brain.
We develop a computational geometry-based tractography representation that aims to simplify the connectivity of white matter fibers.
Using diffusion MRI data from Alzheimer's patient study, we extract tractography features from our model for distinguishing the Alzheimer's subject from the normal control.
arXiv Detail & Related papers (2021-08-02T21:16:29Z) - Deep Fiber Clustering: Anatomically Informed Unsupervised Deep Learning
for Fast and Effective White Matter Parcellation [21.835894924330752]
We propose a novel WMFC framework based on unsupervised deep learning.
We use a convolutional neural network to learn embeddings of input fibers, using pairwise fiber distances as pseudo annotations.
Results demonstrate superior performance and efficiency of the proposed approach.
arXiv Detail & Related papers (2021-07-11T01:36:57Z) - Comparisons among different stochastic selection of activation layers
for convolutional neural networks for healthcare [77.99636165307996]
We classify biomedical images using ensembles of neural networks.
We select our activations among the following ones: ReLU, leaky ReLU, Parametric ReLU, ELU, Adaptive Piecewice Linear Unit, S-Shaped ReLU, Swish, Mish, Mexican Linear Unit, Parametric Deformable Linear Unit, Soft Root Sign.
arXiv Detail & Related papers (2020-11-24T01:53:39Z) - Filtering in tractography using autoencoders (FINTA) [5.8135956130576965]
We describe a novel autoencoder-based learning method to filter streamlines from diffusion MRI tractography.
Our method, dubbed FINTA, uses raw, un computation tractograms to train the autoencoder, and to learn a robust representation of brain streamlines.
Results reveal that FINTA has a superior filtering performance compared to conventional, anatomy-based methods.
arXiv Detail & Related papers (2020-10-07T16:45:55Z) - Tractogram filtering of anatomically non-plausible fibers with geometric
deep learning [7.758302353877525]
Tractograms are virtual representations of the white matter fibers of the brain.
They are of primary interest for tasks like presurgical planning, and investigation of neuroplasticity or brain disorders.
Unfortunately, a large portion of those fibers are not anatomically plausible and can be considered artifacts of the tracking algorithms.
Common methods for tractogram filtering are based on signal reconstruction, a principled approach, but unable to consider the knowledge of brain anatomy.
arXiv Detail & Related papers (2020-03-24T17:56:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.