Deep learning facilitates fully automated brain image registration of optoacoustic tomography and magnetic resonance imaging

• URL: http://arxiv.org/abs/2109.01880v1
• Date: Sat, 4 Sep 2021 14:50:44 GMT
• Title: Deep learning facilitates fully automated brain image registration of optoacoustic tomography and magnetic resonance imaging
• Authors: Yexing Hu and Berkan Lafci and Artur Luzgin and Hao Wang and Jan Klohs and Xose Luis Dean-Ben and Ruiqing Ni and Daniel Razansky and Wuwei Ren
• Abstract summary: Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers excellent soft-tissue contrast and high-resolution brain anatomy. registration of multi-modal images remains challenging, chiefly due to the entirely different image contrast rendered by these modalities. Here we propose a fully automated registration method for MSOT-MRI multimodal imaging empowered by deep learning.
• Score: 6.9975936496083495
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-spectral optoacoustic tomography (MSOT) is an emerging optical imaging method providing multiplex molecular and functional information from the rodent brain. It can be greatly augmented by magnetic resonance imaging (MRI) that offers excellent soft-tissue contrast and high-resolution brain anatomy. Nevertheless, registration of multi-modal images remains challenging, chiefly due to the entirely different image contrast rendered by these modalities. Previously reported registration algorithms mostly relied on manual user-dependent brain segmentation, which compromised data interpretation and accurate quantification. Here we propose a fully automated registration method for MSOT-MRI multimodal imaging empowered by deep learning. The automated workflow includes neural network-based image segmentation to generate suitable masks, which are subsequently registered using an additional neural network. Performance of the algorithm is showcased with datasets acquired by cross-sectional MSOT and high-field MRI preclinical scanners. The automated registration method is further validated with manual and half-automated registration, demonstrating its robustness and accuracy.

Related papers

• Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
  Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements. Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements. We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Towards General Text-guided Image Synthesis for Customized Multimodal Brain MRI Generation [51.28453192441364]
  Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. Current MR image synthesis approaches are typically trained on independent datasets for specific tasks. We present TUMSyn, a Text-guided Universal MR image Synthesis model, which can flexibly generate brain MR images.
  arXiv  Detail & Related papers  (2024-09-25T11:14:47Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• Controllable Mind Visual Diffusion Model [58.83896307930354]
  Brain signal visualization has emerged as an active research area, serving as a critical interface between the human visual system and computer vision models. We propose a novel approach, referred to as Controllable Mind Visual Model Diffusion (CMVDM) CMVDM extracts semantic and silhouette information from fMRI data using attribute alignment and assistant networks. We then leverage a control model to fully exploit the extracted information for image synthesis, resulting in generated images that closely resemble the visual stimuli in terms of semantics and silhouette.
  arXiv  Detail & Related papers  (2023-05-17T11:36:40Z)
• A Survey of Feature detection methods for localisation of plain sections of Axial Brain Magnetic Resonance Imaging [0.0]
  Matching MRI brain images between patients or mapping patients' MRI slices to the simulated atlas of a brain is key to the automatic registration of MRI of a brain. In this work, we have introduced robustness, accuracy and cumulative distance metrics and methodology that allows us to compare different techniques and approaches in matching brain MRI of different patients or matching MRI brain slice to a position in the brain atlas.
  arXiv  Detail & Related papers  (2023-02-08T16:24:09Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• Global Multi-modal 2D/3D Registration via Local Descriptors Learning [0.3299877799532224]
  We present a novel approach to solve the problem of registration of an ultrasound sweep to a pre-operative image. We learn dense keypoint descriptors from which we then estimate the registration. Our approach is evaluated on a clinical dataset of paired MR volumes and ultrasound sequences.
  arXiv  Detail & Related papers  (2022-05-06T18:24:19Z)
• Deep Learning for Ultrasound Beamforming [120.12255978513912]
  Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain. Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing. Deep learning methods can play a compelling role in the digital beamforming pipeline.
  arXiv  Detail & Related papers  (2021-09-23T15:15:21Z)
• Deep Learning-based Type Identification of Volumetric MRI Sequences [5.407839873345339]
  Unstandardized naming of MRI sequences makes their identification difficult for automated systems. We propose a system for identifying types of brain MRI sequences based on deep learning. Our system can classify among sequence types with an accuracy of 96.81%.
  arXiv  Detail & Related papers  (2021-06-06T18:34:47Z)
• A deep learning pipeline for identification of motor units in musculoskeletal ultrasound [0.5249805590164902]
  It has been shown that ultrafast ultrasound can be used to record and analyze the mechanical response of individual MUs. We present an alternative method - a deep learning pipeline - to identify active MUs in ultrasound image sequences. We train evaluate the model using simulated data mimicking the complex activation pattern and overlapping territories.
  arXiv  Detail & Related papers  (2020-09-23T20:44:29Z)
• Transfer Learning for Brain Tumor Segmentation [0.6408773096179187]
  Gliomas are the most common malignant brain tumors that are treated with chemoradiotherapy and surgery. Recent advances in deep learning have led to convolutional neural network architectures that excel at various visual recognition tasks. In this work, we construct FCNs with pretrained convolutional encoders. We show that we can stabilize the training process this way and achieve an improvement with respect to dice scores and Hausdorff distances.
  arXiv  Detail & Related papers  (2019-12-28T12:45:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.