Cortical surface registration using unsupervised learning
- URL: http://arxiv.org/abs/2004.04617v2
- Date: Thu, 9 Jul 2020 09:06:55 GMT
- Title: Cortical surface registration using unsupervised learning
- Authors: Jieyu Cheng, Adrian V. Dalca, Bruce Fischl, Lilla Zollei (for the
Alzheimer's Disease Neuroimaging Initiative)
- Abstract summary: Non-rigid cortical registration is an important and challenging task due to the geometric complexity of the human cortex.
Recent learning-based methods to surfaces yields poor results due to distortions introduced by projecting a sphere to a 2D plane.
We present SphereMorph, a diffeomorphic registration framework for cortical surfaces using deep networks that addresses these issues.
- Score: 8.57142014602892
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Non-rigid cortical registration is an important and challenging task due to
the geometric complexity of the human cortex and the high degree of
inter-subject variability. A conventional solution is to use a spherical
representation of surface properties and perform registration by aligning
cortical folding patterns in that space. This strategy produces accurate
spatial alignment but often requires a high computational cost. Recently,
convolutional neural networks (CNNs) have demonstrated the potential to
dramatically speed up volumetric registration. However, due to distortions
introduced by projecting a sphere to a 2D plane, a direct application of recent
learning-based methods to surfaces yields poor results. In this study, we
present SphereMorph, a diffeomorphic registration framework for cortical
surfaces using deep networks that addresses these issues. SphereMorph uses a
UNet-style network associated with a spherical kernel to learn the displacement
field and warps the sphere using a modified spatial transformer layer. We
propose a resampling weight in computing the data fitting loss to account for
distortions introduced by polar projection, and demonstrate the performance of
our proposed method on two tasks, including cortical parcellation and
group-wise functional area alignment. The experiments show that the proposed
SphereMorph is capable of modeling the geometric registration problem in a CNN
framework and demonstrate superior registration accuracy and computational
efficiency. The source code of SphereMorph will be released to the public upon
acceptance of this manuscript at https://github.com/voxelmorph/spheremorph.
Related papers
- GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration [8.896542371748115]
This paper constructs a deep learning model to study the technology of cortical surface image registration.
An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed.
A graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features.
arXiv Detail & Related papers (2024-10-18T18:21:47Z) - Mesh Denoising Transformer [104.5404564075393]
Mesh denoising is aimed at removing noise from input meshes while preserving their feature structures.
SurfaceFormer is a pioneering Transformer-based mesh denoising framework.
New representation known as Local Surface Descriptor captures local geometric intricacies.
Denoising Transformer module receives the multimodal information and achieves efficient global feature aggregation.
arXiv Detail & Related papers (2024-05-10T15:27:43Z) - SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model [63.685132323224124]
Controllable spherical panoramic image generation holds substantial applicative potential across a variety of domains.
In this paper, we introduce a novel framework of SphereDiffusion to address these unique challenges.
Experiments on Structured3D dataset show that SphereDiffusion significantly improves the quality of controllable spherical image generation and relatively reduces around 35% FID on average.
arXiv Detail & Related papers (2024-03-15T06:26:46Z) - Unsupervised Multimodal Surface Registration with Geometric Deep
Learning [3.3403308469369577]
GeoMorph is a novel geometric deep-learning framework designed for image registration of cortical surfaces.
We show that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations.
Such versatility and robustness suggest strong potential for various neuroscience applications.
arXiv Detail & Related papers (2023-11-21T22:05:00Z) - HSurf-Net: Normal Estimation for 3D Point Clouds by Learning Hyper
Surfaces [54.77683371400133]
We propose a novel normal estimation method called HSurf-Net, which can accurately predict normals from point clouds with noise and density variations.
Experimental results show that our HSurf-Net achieves the state-of-the-art performance on the synthetic shape dataset.
arXiv Detail & Related papers (2022-10-13T16:39:53Z) - A Deep-Discrete Learning Framework for Spherical Surface Registration [4.7633236054762875]
Cortical surface registration is a fundamental tool for neuroimaging analysis.
We propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem.
Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms.
arXiv Detail & Related papers (2022-03-24T11:47:11Z) - Learning Smooth Neural Functions via Lipschitz Regularization [92.42667575719048]
We introduce a novel regularization designed to encourage smooth latent spaces in neural fields.
Compared with prior Lipschitz regularized networks, ours is computationally fast and can be implemented in four lines of code.
arXiv Detail & Related papers (2022-02-16T21:24:54Z) - Geodesic squared exponential kernel for non-rigid shape registration [0.0]
This work addresses the problem of non-rigid registration of 3D scans.
We propose a new kernel based on geodesic for the Gaussian Process Morphable Models framework.
We show that the Geodesic squared exponential kernel performs significantly better than state of the art kernels for the task of face registration.
arXiv Detail & Related papers (2021-12-22T13:01:00Z) - NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One
Go [109.88509362837475]
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes.
NeuroMorph produces smooth and point-to-point correspondences between them.
It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
arXiv Detail & Related papers (2021-06-17T12:25:44Z) - Sign-Agnostic CONet: Learning Implicit Surface Reconstructions by
Sign-Agnostic Optimization of Convolutional Occupancy Networks [39.65056638604885]
We learn implicit surface reconstruction by sign-agnostic optimization of convolutional occupancy networks.
We show this goal can be effectively achieved by a simple yet effective design.
arXiv Detail & Related papers (2021-05-08T03:35:32Z) - A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow
Fields on Irregular Geometries [62.28265459308354]
Network learns end-to-end mapping between spatial positions and CFD quantities.
Incompress laminar steady flow past a cylinder with various shapes for its cross section is considered.
Network predicts the flow fields hundreds of times faster than our conventional CFD.
arXiv Detail & Related papers (2020-10-15T12:15:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.