CAR: Contrast-Agnostic Deformable Medical Image Registration with Contrast-Invariant Latent Regularization

• URL: http://arxiv.org/abs/2408.05341v1
• Date: Sat, 3 Aug 2024 19:46:23 GMT
• Title: CAR: Contrast-Agnostic Deformable Medical Image Registration with Contrast-Invariant Latent Regularization
• Authors: Yinsong Wang, Siyi Du, Shaoming Zheng, Xinzhe Luo, Chen Qin,
• Abstract summary: We propose a novel contrast-agnostic deformable image registration framework that can be generalized to arbitrary contrast images. Particularly, we propose a random convolution-based contrast augmentation scheme, which simulates arbitrary contrasts of images over a single image contrast. Experiments show that CAR outperforms the baseline approaches regarding registration accuracy and also possesses better generalization ability unseen imaging contrasts.
• Score: 6.313081057543946
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-contrast image registration is a challenging task due to the complex intensity relationships between different imaging contrasts. Conventional image registration methods are typically based on iterative optimizations for each input image pair, which is time-consuming and sensitive to contrast variations. While learning-based approaches are much faster during the inference stage, due to generalizability issues, they typically can only be applied to the fixed contrasts observed during the training stage. In this work, we propose a novel contrast-agnostic deformable image registration framework that can be generalized to arbitrary contrast images, without observing them during training. Particularly, we propose a random convolution-based contrast augmentation scheme, which simulates arbitrary contrasts of images over a single image contrast while preserving their inherent structural information. To ensure that the network can learn contrast-invariant representations for facilitating contrast-agnostic registration, we further introduce contrast-invariant latent regularization (CLR) that regularizes representation in latent space through a contrast invariance loss. Experiments show that CAR outperforms the baseline approaches regarding registration accuracy and also possesses better generalization ability to unseen imaging contrasts. Code is available at \url{https://github.com/Yinsong0510/CAR}.

Related papers

• Robust image representations with counterfactual contrastive learning [17.273155534515393]
  We introduce counterfactual contrastive learning, a novel framework leveraging recent advances in causal image synthesis. Our method, evaluated across five datasets, outperforms standard contrastive learning in terms of robustness to acquisition shift. Further experiments show that the proposed framework extends beyond acquisition shifts, with models trained with counterfactual contrastive learning substantially improving subgroup performance across biological sex.
  arXiv  Detail & Related papers  (2024-09-16T15:11:00Z)
• Gadolinium dose reduction for brain MRI using conditional deep learning [66.99830668082234]
  Two main challenges for these approaches are the accurate prediction of contrast enhancement and the synthesis of realistic images. We address both challenges by utilizing the contrast signal encoded in the subtraction images of pre-contrast and post-contrast image pairs. We demonstrate the effectiveness of our approach on synthetic and real datasets using various scanners, field strengths, and contrast agents.
  arXiv  Detail & Related papers  (2024-03-06T08:35:29Z)
• Breaking Modality Disparity: Harmonized Representation for Infrared and Visible Image Registration [66.33746403815283]
  We propose a scene-adaptive infrared and visible image registration. We employ homography to simulate the deformation between different planes. We propose the first ground truth available misaligned infrared and visible image dataset.
  arXiv  Detail & Related papers  (2023-04-12T06:49:56Z)
• Deep Intra-Image Contrastive Learning for Weakly Supervised One-Step Person Search [98.2559247611821]
  We present a novel deep intra-image contrastive learning using a Siamese network. Our method achieves a state-of-the-art performance among weakly supervised one-step person search approaches.
  arXiv  Detail & Related papers  (2023-02-09T12:45:20Z)
• JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI [49.29851365978476]
  The proposed framework consists of a sampling mask generator for each image contrast and a reconstructor exploiting the inter-contrast correlations with a recurrent structure. The acceleration ratio of each image contrast is also learnable and can be driven by a downstream task performance.
  arXiv  Detail & Related papers  (2022-10-22T20:46:56Z)
• Modulated Contrast for Versatile Image Synthesis [60.304183493234376]
  MoNCE is a versatile metric that introduces image contrast to learn a calibrated metric for the perception of multifaceted inter-image distances. We introduce optimal transport in MoNCE to modulate the pushing force of negative samples collaboratively across multiple contrastive objectives.
  arXiv  Detail & Related papers  (2022-03-17T14:03:46Z)
• Robust Contrastive Learning against Noisy Views [79.71880076439297]
  We propose a new contrastive loss function that is robust against noisy views. We show that our approach provides consistent improvements over the state-of-the-art image, video, and graph contrastive learning benchmarks.
  arXiv  Detail & Related papers  (2022-01-12T05:24:29Z)
• DeepSim: Semantic similarity metrics for learned image registration [6.789370732159177]
  We propose a semantic similarity metric for image registration. Our approach learns dataset-specific features that drive the optimization of a learning-based registration model.
  arXiv  Detail & Related papers  (2020-11-11T12:35:07Z)
• CoMIR: Contrastive Multimodal Image Representation for Registration [4.543268895439618]
  We propose contrastive coding to learn shared, dense image representations, referred to as CoMIRs (Contrastive Multimodal Image Representations) CoMIRs enable the registration of multimodal images where existing registration methods often fail due to a lack of sufficiently similar image structures.
  arXiv  Detail & Related papers  (2020-06-11T10:51:33Z)
• SynthMorph: learning contrast-invariant registration without acquired images [8.0963891430422]
  We introduce a strategy for learning image registration without acquired imaging data. We show that this strategy enables robust and accurate registration of arbitrary MRI contrasts.
  arXiv  Detail & Related papers  (2020-04-21T20:29:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.