A Tournament of Transformation Models: B-Spline-based vs. Mesh-based
Multi-Objective Deformable Image Registration
- URL: http://arxiv.org/abs/2401.16867v1
- Date: Tue, 30 Jan 2024 10:17:46 GMT
- Title: A Tournament of Transformation Models: B-Spline-based vs. Mesh-based
Multi-Objective Deformable Image Registration
- Authors: Georgios Andreadis, Joas I. Mulder, Anton Bouter, Peter A. N. Bosman,
Tanja Alderliesten
- Abstract summary: We conduct the first direct comparison between B-spline and mesh transformation models.
We experimentally compare both models on two different registration problems based on pelvic CT scans of cervical cancer patients.
Our results, on three cervical cancer patients, indicate that the choice of transformation model can have a profound impact on the diversity and quality of achieved registration outcomes.
- Score: 0.44998333629984877
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The transformation model is an essential component of any deformable image
registration approach. It provides a representation of physical deformations
between images, thereby defining the range and realism of registrations that
can be found. Two types of transformation models have emerged as popular
choices: B-spline models and mesh models. Although both models have been
investigated in detail, a direct comparison has not yet been made, since the
models are optimized using very different optimization methods in practice.
B-spline models are predominantly optimized using gradient-descent methods,
while mesh models are typically optimized using finite-element method solvers
or evolutionary algorithms. Multi-objective optimization methods, which aim to
find a diverse set of high-quality trade-off registrations, are increasingly
acknowledged to be important in deformable image registration. Since these
methods search for a diverse set of registrations, they can provide a more
complete picture of the capabilities of different transformation models, making
them suitable for a comparison of models. In this work, we conduct the first
direct comparison between B-spline and mesh transformation models, by
optimizing both models with the same state-of-the-art multi-objective
optimization method, the Multi-Objective Real-Valued Gene-pool Optimal Mixing
Evolutionary Algorithm (MO-RV-GOMEA). The combination with B-spline
transformation models, moreover, is novel. We experimentally compare both
models on two different registration problems that are both based on pelvic CT
scans of cervical cancer patients, featuring large deformations. Our results,
on three cervical cancer patients, indicate that the choice of transformation
model can have a profound impact on the diversity and quality of achieved
registration outcomes.
Related papers
- EMR-Merging: Tuning-Free High-Performance Model Merging [55.03509900949149]
We show that Elect, Mask & Rescale-Merging (EMR-Merging) shows outstanding performance compared to existing merging methods.
EMR-Merging is tuning-free, thus requiring no data availability or any additional training while showing impressive performance.
arXiv Detail & Related papers (2024-05-23T05:25:45Z) - MOREA: a GPU-accelerated Evolutionary Algorithm for Multi-Objective
Deformable Registration of 3D Medical Images [0.7734726150561088]
We present MOREA: the first evolutionary algorithm-based approach to deformable registration of 3D images capable of tackling large deformations.
MOREA includes a 3D biomechanical mesh model for physical plausibility and is fully GPU-accelerated.
We compare MOREA to two state-of-the-art approaches on abdominal CT scans of 4 cervical cancer patients, with the latter two approaches configured for the best results per patient.
arXiv Detail & Related papers (2023-03-08T20:26:55Z) - Model soups: averaging weights of multiple fine-tuned models improves
accuracy without increasing inference time [69.7693300927423]
We show that averaging the weights of multiple models fine-tuned with different hyper parameter configurations improves accuracy and robustness.
We show that the model soup approach extends to multiple image classification and natural language processing tasks.
arXiv Detail & Related papers (2022-03-10T17:03:49Z) - Multi-Objective Dual Simplex-Mesh Based Deformable Image Registration
for 3D Medical Images -- Proof of Concept [0.7734726150561088]
This work introduces the first method for multi-objective 3D deformable image registration, using a 3D dual-dynamic grid transformation model based on simplex meshes.
Our proof-of-concept prototype shows promising results on synthetic and clinical 3D registration problems.
arXiv Detail & Related papers (2022-02-22T16:07:29Z) - IMACS: Image Model Attribution Comparison Summaries [16.80986701058596]
We introduce IMACS, a method that combines gradient-based model attributions with aggregation and visualization techniques.
IMACS extracts salient input features from an evaluation dataset, clusters them based on similarity, then visualizes differences in model attributions for similar input features.
We show how our technique can uncover behavioral differences caused by domain shift between two models trained on satellite images.
arXiv Detail & Related papers (2022-01-26T21:35:14Z) - Dynamic multi feature-class Gaussian process models [0.0]
This study presents a statistical modelling method for automatic learning of shape, pose and intensity features in medical images.
A DMFC-GPM is a Gaussian process (GP)-based model with a shared latent space that encodes linear and non-linear variation.
The model performance results suggest that this new modelling paradigm is robust, accurate, accessible, and has potential applications.
arXiv Detail & Related papers (2021-12-08T15:12:47Z) - Image Deformation Estimation via Multi-Objective Optimization [13.159751065619544]
Free-form deformation model can represent a wide range of non-rigid deformations by manipulating a control point lattice over the image.
It is challenging to fit the model directly to the deformed image for deformation estimation because of the complexity of the fitness landscape.
arXiv Detail & Related papers (2021-06-08T06:52:12Z) - Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model [58.17021225930069]
We explain the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA)
We propose a more efficient EAT model, and design task-related heads to deal with different tasks more flexibly.
Our approach achieves state-of-the-art results on the ImageNet classification task compared with recent vision transformer works.
arXiv Detail & Related papers (2021-05-31T16:20:03Z) - A Hierarchical Transformation-Discriminating Generative Model for Few
Shot Anomaly Detection [93.38607559281601]
We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image.
The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
arXiv Detail & Related papers (2021-04-29T17:49:48Z) - Improving the Reconstruction of Disentangled Representation Learners via Multi-Stage Modeling [54.94763543386523]
Current autoencoder-based disentangled representation learning methods achieve disentanglement by penalizing the ( aggregate) posterior to encourage statistical independence of the latent factors.
We present a novel multi-stage modeling approach where the disentangled factors are first learned using a penalty-based disentangled representation learning method.
Then, the low-quality reconstruction is improved with another deep generative model that is trained to model the missing correlated latent variables.
arXiv Detail & Related papers (2020-10-25T18:51:15Z) - Learning Deformable Image Registration from Optimization: Perspective,
Modules, Bilevel Training and Beyond [62.730497582218284]
We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation.
We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
arXiv Detail & Related papers (2020-04-30T03:23:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.