$E(3) \times SO(3)$-Equivariant Networks for Spherical Deconvolution in Diffusion MRI

• URL: http://arxiv.org/abs/2304.06103v1
• Date: Wed, 12 Apr 2023 18:37:32 GMT
• Title: $E(3) \times SO(3)$-Equivariant Networks for Spherical Deconvolution in Diffusion MRI
• Authors: Axel Elaldi, Guido Gerig, Neel Dey
• Abstract summary: We present a framework for sparse deconvolution of volumes where each voxel contains a spherical signal. This work constructs equivariant deep learning layers which respect to symmetries of spatial rotations, reflections, and translations.
• Score: 4.726777092009554
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present Roto-Translation Equivariant Spherical Deconvolution (RT-ESD), an $E(3)\times SO(3)$ equivariant framework for sparse deconvolution of volumes where each voxel contains a spherical signal. Such 6D data naturally arises in diffusion MRI (dMRI), a medical imaging modality widely used to measure microstructure and structural connectivity. As each dMRI voxel is typically a mixture of various overlapping structures, there is a need for blind deconvolution to recover crossing anatomical structures such as white matter tracts. Existing dMRI work takes either an iterative or deep learning approach to sparse spherical deconvolution, yet it typically does not account for relationships between neighboring measurements. This work constructs equivariant deep learning layers which respect to symmetries of spatial rotations, reflections, and translations, alongside the symmetries of voxelwise spherical rotations. As a result, RT-ESD improves on previous work across several tasks including fiber recovery on the DiSCo dataset, deconvolution-derived partial volume estimation on real-world \textit{in vivo} human brain dMRI, and improved downstream reconstruction of fiber tractograms on the Tractometer dataset. Our implementation is available at https://github.com/AxelElaldi/e3so3_conv

Related papers

• Equivariant spatio-hemispherical networks for diffusion MRI deconvolution [5.680416078423551]
  This paper advances the analysis of such sphericalal data by developing convolutional network layers that are equivariant to the $math(3) times SO(3)$ group. In the context of sparse spherical fiber deconvolution to recover white matter, our proposed equivariant network layers yield substantial performance and efficiency gains.
  arXiv  Detail & Related papers  (2024-11-18T18:37:39Z)
• fMRI-3D: A Comprehensive Dataset for Enhancing fMRI-based 3D Reconstruction [50.534007259536715]
  We present the fMRI-3D dataset, which includes data from 15 participants and showcases a total of 4768 3D objects. We propose MinD-3D, a novel framework designed to decode 3D visual information from fMRI signals.
  arXiv  Detail & Related papers  (2024-09-17T16:13:59Z)
• SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion Classification Using 3D Multi-Phase Imaging [59.78761085714715]
  This study proposes a novel Siamese Dual-Resolution Transformer (SDR-Former) framework for liver lesion classification. The proposed framework has been validated through comprehensive experiments on two clinical datasets. To support the scientific community, we are releasing our extensive multi-phase MR dataset for liver lesion analysis to the public.
  arXiv  Detail & Related papers  (2024-02-27T06:32:56Z)
• SIRE: scale-invariant, rotation-equivariant estimation of artery orientations using graph neural networks [2.439909645714735]
  We present SIRE: a scale-invariant, rotation-equivariant estimator for local vessel orientation. SIRE can be trained with arbitrarily oriented vessels with varying radii to generalise to vessels with a wide range of calibres and tortuosity. We embed SIRE in a centerline tracker which accurately tracks AAAs, regardless of the data SIRE is trained with.
  arXiv  Detail & Related papers  (2023-11-09T14:32:57Z)
• Neural Spherical Harmonics for structurally coherent continuous representation of diffusion MRI signal [0.3277163122167433]
  We present a novel way to model diffusion magnetic resonance imaging (dMRI) datasets, that benefits from the structural coherence of the human brain. Current methods model the dMRI signal in individual voxels, disregarding the intervoxel coherence that is present. We use a neural network to parameterize a spherical harmonics series to represent the dMRI signal of a single subject from the Human Connectome Project dataset.
  arXiv  Detail & Related papers  (2023-08-16T08:28:01Z)
• Orthogonal Matrix Retrieval with Spatial Consensus for 3D Unknown-View Tomography [58.60249163402822]
  Unknown-view tomography (UVT) reconstructs a 3D density map from its 2D projections at unknown, random orientations. The proposed OMR is more robust and performs significantly better than the previous state-of-the-art OMR approach.
  arXiv  Detail & Related papers  (2022-07-06T21:40:59Z)
• Geometry-Contrastive Transformer for Generalized 3D Pose Transfer [95.56457218144983]
  The intuition of this work is to perceive the geometric inconsistency between the given meshes with the powerful self-attention mechanism. We propose a novel geometry-contrastive Transformer that has an efficient 3D structured perceiving ability to the global geometric inconsistencies. We present a latent isometric regularization module together with a novel semi-synthesized dataset for the cross-dataset 3D pose transfer task.
  arXiv  Detail & Related papers  (2021-12-14T13:14:24Z)
• 3D Reconstruction of Curvilinear Structures with Stereo Matching DeepConvolutional Neural Networks [52.710012864395246]
  We propose a fully automated pipeline for both detection and matching of curvilinear structures in stereo pairs. We mainly focus on 3D reconstruction of dislocations from stereo pairs of TEM images.
  arXiv  Detail & Related papers  (2021-10-14T23:05:47Z)
• Equivariant Spherical Deconvolution: Learning Sparse Orientation Distribution Functions from Spherical Data [0.0]
  We present a rotation-equivariant unsupervised learning framework for the sparse deconvolution of non-negative scalar fields defined on the unit sphere. We show improvements in terms of tractography and partial volume estimation on a multi-shell dataset of human subjects.
  arXiv  Detail & Related papers  (2021-02-17T16:04:35Z)
• Rotation-Equivariant Deep Learning for Diffusion MRI [49.321304988619865]
  Convolutional networks are successful, but they have recently been outperformed by new neural networks that are equivariant under rotations and translations. Here we generalize them to 6D diffusion MRI data, ensuring joint equivariance under 3D roto-translations in image space and the matching 3D rotations in $q$-space. Our proposed neural networks yield better results and require fewer scans for training compared to non-rotation-equivariant deep learning.
  arXiv  Detail & Related papers  (2021-02-13T15:18:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.