Recognition and standardization of cardiac MRI orientation via multi-tasking learning and deep neural networks

• URL: http://arxiv.org/abs/2011.08761v1
• Date: Tue, 17 Nov 2020 16:41:31 GMT
• Title: Recognition and standardization of cardiac MRI orientation via multi-tasking learning and deep neural networks
• Authors: Ke Zhang and Xiahai Zhuang
• Abstract summary: We study the problem of imaging orientation in cardiac MRI, and propose a framework to categorize the orientation for recognition and standardization via deep neural networks. The method uses a new multi-tasking strategy, where both the tasks of cardiac segmentation and orientation recognition are simultaneously achieved. For multiple sequences and modalities of MRI, we propose a transfer learning strategy, which adapts our proposed model from a single modality to multiple modalities.
• Score: 16.188681108101196
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we study the problem of imaging orientation in cardiac MRI, and propose a framework to categorize the orientation for recognition and standardization via deep neural networks. The method uses a new multi-tasking strategy, where both the tasks of cardiac segmentation and orientation recognition are simultaneously achieved. For multiple sequences and modalities of MRI, we propose a transfer learning strategy, which adapts our proposed model from a single modality to multiple modalities. We embed the orientation recognition network in a Cardiac MRI Orientation Adjust Tool, i.e., CMRadjustNet. We implemented two versions of CMRadjustNet, including a user-interface (UI) software, and a command-line tool. The former version supports MRI image visualization, orientation prediction, adjustment, and storage operations; and the latter version enables the batch operations. The source code, neural network models and tools have been released and open via https://zmiclab.github.io/projects.html.

Related papers

• MindFormer: Semantic Alignment of Multi-Subject fMRI for Brain Decoding [50.55024115943266]
  We introduce a novel semantic alignment method of multi-subject fMRI signals using so-called MindFormer. This model is specifically designed to generate fMRI-conditioned feature vectors that can be used for conditioning Stable Diffusion model for fMRI- to-image generation or large language model (LLM) for fMRI-to-text generation. Our experimental results demonstrate that MindFormer generates semantically consistent images and text across different subjects.
  arXiv  Detail & Related papers  (2024-05-28T00:36:25Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding [54.17776744076334]
  We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training. Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns. Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
  arXiv  Detail & Related papers  (2023-11-01T07:24:22Z)
• Cardiac MRI Orientation Recognition and Standardization using Deep Neural Networks [0.0]
  We present a method that employs deep neural networks to categorize and standardize the orientation of cardiac MRI images. We conducted comprehensive experiments on CMR images from various modalities, including bSSFP, T2, and LGE. The validation accuracies achieved were 100.0%, 100.0%, and 99.4%, confirming the robustness and effectiveness of our model.
  arXiv  Detail & Related papers  (2023-07-31T00:01:49Z)
• BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus Decoding [51.911473457195555]
  BrainCLIP is a task-agnostic fMRI-based brain decoding model. It bridges the modality gap between brain activity, image, and text. BrainCLIP can reconstruct visual stimuli with high semantic fidelity.
  arXiv  Detail & Related papers  (2023-02-25T03:28:54Z)
• Orientation recognition and correction of Cardiac MRI with deep neural network [0.0]
  In this paper, the problem of orientation correction in cardiac MRI images is investigated and a framework for orientation recognition via deep neural networks is proposed. For multi-modality MRI, we introduce a transfer learning strategy to transfer our proposed model from single modality to multi-modality. We embed the proposed network into the orientation correction command-line tool, which can implement orientation correction on 2D DICOM and 3D NIFTI images.
  arXiv  Detail & Related papers  (2022-11-21T10:37:50Z)
• Recognition of Cardiac MRI Orientation via Deep Neural Networks and a Method to Improve Prediction Accuracy [0.0]
  In most medical image processing tasks, the orientation of an image would affect computing result. We study the problem of recognizing orientation in cardiac MRI and using deep neural network to solve this problem.
  arXiv  Detail & Related papers  (2022-11-14T03:35:15Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• Deep Learning-based Type Identification of Volumetric MRI Sequences [5.407839873345339]
  Unstandardized naming of MRI sequences makes their identification difficult for automated systems. We propose a system for identifying types of brain MRI sequences based on deep learning. Our system can classify among sequence types with an accuracy of 96.81%.
  arXiv  Detail & Related papers  (2021-06-06T18:34:47Z)
• Rotation-Equivariant Deep Learning for Diffusion MRI [49.321304988619865]
  Convolutional networks are successful, but they have recently been outperformed by new neural networks that are equivariant under rotations and translations. Here we generalize them to 6D diffusion MRI data, ensuring joint equivariance under 3D roto-translations in image space and the matching 3D rotations in $q$-space. Our proposed neural networks yield better results and require fewer scans for training compared to non-rotation-equivariant deep learning.
  arXiv  Detail & Related papers  (2021-02-13T15:18:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.