Aladdin: Joint Atlas Building and Diffeomorphic Registration Learning
with Pairwise Alignment
- URL: http://arxiv.org/abs/2202.03563v1
- Date: Mon, 7 Feb 2022 23:52:21 GMT
- Title: Aladdin: Joint Atlas Building and Diffeomorphic Registration Learning
with Pairwise Alignment
- Authors: Zhipeng Ding and Marc Niethammer
- Abstract summary: This work explores using a convolutional neural network (CNN) to jointly predict the atlas and a stationary velocity field (SVF) parameterization for diffeomorphic image registration.
Our results show that the proposed framework achieves better performance than other state-of-the-art image registration algorithms.
- Score: 18.338563869053065
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Atlas building and image registration are important tasks for medical image
analysis. Once one or multiple atlases from an image population have been
constructed, commonly (1) images are warped into an atlas space to study
intra-subject or inter-subject variations or (2) a possibly probabilistic atlas
is warped into image space to assign anatomical labels. Atlas estimation and
nonparametric transformations are computationally expensive as they usually
require numerical optimization. Additionally, previous approaches for atlas
building often define similarity measures between a fuzzy atlas and each
individual image, which may cause alignment difficulties because a fuzzy atlas
does not exhibit clear anatomical structures in contrast to the individual
images. This work explores using a convolutional neural network (CNN) to
jointly predict the atlas and a stationary velocity field (SVF)
parameterization for diffeomorphic image registration with respect to the
atlas. Our approach does not require affine pre-registrations and utilizes
pairwise image alignment losses to increase registration accuracy. We evaluate
our model on 3D knee magnetic resonance images (MRI) from the OAI-ZIB dataset.
Our results show that the proposed framework achieves better performance than
other state-of-the-art image registration algorithms, allows for end-to-end
training, and for fast inference at test time.
Related papers
- Cross-View Open-Vocabulary Object Detection in Aerial Imagery [48.851422992413184]
We propose a novel framework for adapting open-vocabulary representations from ground-view images to solve object detection in aerial imagery.<n>The method introduces contrastive image-to-image alignment to enhance the similarity between aerial and ground-view embeddings.<n>Our open-vocabulary model achieves improvements of +6.32 mAP on DOTAv2, +4.16 mAP on VisDrone (Images), and +3.46 mAP on HRRSD in the zero-shot setting.
arXiv Detail & Related papers (2025-10-04T16:12:03Z) - An Efficient Model-Driven Groupwise Approach for Atlas Construction [40.43130112593729]
We introduce DARC (Diffeomorphic Atlas Registration via Coordinate descent), a novel model-driven groupwise registration framework for atlas construction.<n>DARC supports a broad range of image dissimilarity metrics and efficiently handles arbitrary numbers of 3D images without incurring GPU memory issues.<n>We demonstrate two key applications: (1) One-shot segmentation, where labels annotated only on the atlas are propagated to subjects via inverse deformations; and (2) shape synthesis, where new anatomical variants are generated by warping the atlas mesh.
arXiv Detail & Related papers (2025-08-14T15:28:09Z) - DiffAtlas: GenAI-fying Atlas Segmentation via Image-Mask Diffusion [47.43502676919903]
We introduce DiffAtlas, a novel generative framework that models both images and masks through diffusion during training.
During testing, the model is guided to generate a specific target image-mask pair, from which the corresponding mask is obtained.
Our approach outperforms existing methods, particularly in limited-data and zero-shot modality segmentation.
arXiv Detail & Related papers (2025-03-09T20:06:40Z) - Symmetrical Bidirectional Knowledge Alignment for Zero-Shot Sketch-Based
Image Retrieval [69.46139774646308]
This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR)
It aims to use sketches from unseen categories as queries to match the images of the same category.
We propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA)
arXiv Detail & Related papers (2023-12-16T04:50:34Z) - Improving Human-Object Interaction Detection via Virtual Image Learning [68.56682347374422]
Human-Object Interaction (HOI) detection aims to understand the interactions between humans and objects.
In this paper, we propose to alleviate the impact of such an unbalanced distribution via Virtual Image Leaning (VIL)
A novel label-to-image approach, Multiple Steps Image Creation (MUSIC), is proposed to create a high-quality dataset that has a consistent distribution with real images.
arXiv Detail & Related papers (2023-08-04T10:28:48Z) - Neural Congealing: Aligning Images to a Joint Semantic Atlas [14.348512536556413]
We present a zero-shot self-supervised framework for aligning semantically-common content across a set of images.
Our approach harnesses the power of pre-trained DINO-ViT features to learn.
We show that our method performs favorably compared to a state-of-the-art method that requires extensive training on large-scale datasets.
arXiv Detail & Related papers (2023-02-08T09:26:22Z) - Anatomy-aware and acquisition-agnostic joint registration with SynthMorph [6.017634371712142]
Affine image registration is a cornerstone of medical image analysis.
Deep-learning (DL) methods learn a function that maps an image pair to an output transform.
Most affine methods are agnostic to the anatomy the user wishes to align, meaning the registration will be inaccurate if algorithms consider all structures in the image.
We address these shortcomings with SynthMorph, a fast, symmetric, diffeomorphic, and easy-to-use DL tool for joint affine-deformable registration of any brain image.
arXiv Detail & Related papers (2023-01-26T18:59:33Z) - Hybrid Atlas Building with Deep Registration Priors [22.744067458133628]
We introduce a novel hybrid atlas building algorithm that fast estimates atlas from large-scale image datasets with much reduced computational cost.
We demonstrate the effectiveness of this proposed model on 3D brain magnetic resonance imaging (MRI) scans.
arXiv Detail & Related papers (2021-12-13T03:55:27Z) - Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with
Image-and-Spatial Transformer Networks [11.677800377183972]
We propose Atlas-ISTN, a framework that jointly learns segmentation and registration on 2D and 3D image data.
Atlas-ISTN learns to segment multiple structures of interest and to register the constructed, topologically consistent atlas labelmap to an intermediate pixel-wise segmentation.
This process both mitigates for noise in the target image that can result in spurious pixel-wise predictions, as well as improves upon the one-pass prediction of the model.
arXiv Detail & Related papers (2020-12-18T21:53:09Z) - Towards Unsupervised Learning for Instrument Segmentation in Robotic
Surgery with Cycle-Consistent Adversarial Networks [54.00217496410142]
We propose an unpaired image-to-image translation where the goal is to learn the mapping between an input endoscopic image and a corresponding annotation.
Our approach allows to train image segmentation models without the need to acquire expensive annotations.
We test our proposed method on Endovis 2017 challenge dataset and show that it is competitive with supervised segmentation methods.
arXiv Detail & Related papers (2020-07-09T01:39:39Z) - Learning Deformable Image Registration from Optimization: Perspective,
Modules, Bilevel Training and Beyond [62.730497582218284]
We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation.
We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
arXiv Detail & Related papers (2020-04-30T03:23:45Z) - SynthMorph: learning contrast-invariant registration without acquired
images [8.0963891430422]
We introduce a strategy for learning image registration without acquired imaging data.
We show that this strategy enables robust and accurate registration of arbitrary MRI contrasts.
arXiv Detail & Related papers (2020-04-21T20:29:39Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z) - High-Order Information Matters: Learning Relation and Topology for
Occluded Person Re-Identification [84.43394420267794]
We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment.
Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
arXiv Detail & Related papers (2020-03-18T12:18:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.