Deformation-Aware Segmentation Network Robust to Motion Artifacts for Brain Tissue Segmentation using Disentanglement Learning
- URL: http://arxiv.org/abs/2412.03922v1
- Date: Thu, 05 Dec 2024 06:52:42 GMT
- Title: Deformation-Aware Segmentation Network Robust to Motion Artifacts for Brain Tissue Segmentation using Disentanglement Learning
- Authors: Sunyoung Jung, Yoonseok Choi, Mohammed A. Al-masni, Minyoung Jung, Dong-Hyun Kim,
- Abstract summary: Motion artifacts are a significant challenge in Magnetic Resonance Imaging (MRI)<n>This study proposes a novel deep learning framework that demonstrates superior performance in both motion correction and robust brain tissue segmentation.<n>In-vivo experiments on pediatric motion data demonstrate that our proposed framework outperforms state-of-the-art methods in segmenting motion-corrupted MRI scans.
- Score: 5.354351782195383
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances, making segmentation difficult. This study proposes a novel deep learning framework that demonstrates superior performance in both motion correction and robust brain tissue segmentation in the presence of artifacts. The core concept lies in a complementary process: a disentanglement learning network progressively removes artifacts, leading to cleaner images and consequently, more accurate segmentation by a jointly trained motion estimation and segmentation network. This network generates three outputs: a motioncorrected image, a motion deformation map that identifies artifact-affected regions, and a brain tissue segmentation mask. This deformation serves as a guidance mechanism for the disentanglement process, aiding the model in recovering lost information or removing artificial structures introduced by the artifacts. Extensive in-vivo experiments on pediatric motion data demonstrate that our proposed framework outperforms state-of-the-art methods in segmenting motion-corrupted MRI scans.
Related papers
- DIMA: DIffusing Motion Artifacts for unsupervised correction in brain MRI images [4.117232425638352]
DIMA (DIffusing Motion Artifacts) is a novel framework that leverages diffusion models to enable unsupervised motion artifact correction in brain MRI.
Our two-phase approach first trains a diffusion model on unpaired motion-affected images to learn the distribution of motion artifacts.
This model then generates realistic motion artifacts on clean images, creating paired datasets suitable for supervised training of correction networks.
arXiv Detail & Related papers (2025-04-09T10:43:38Z) - Learning to segment anatomy and lesions from disparately labeled sources in brain MRI [10.009002368953036]
We propose a method that is robust to lesion-caused disruptions and can be trained from disparately labeled training sets.
Our model shows an improved performance on several anatomical structures and lesions on a publicly available brain glioblastoma dataset.
arXiv Detail & Related papers (2025-03-24T16:13:04Z) - DDO-IN: Dual Domains Optimization for Implicit Neural Network to Eliminate Motion Artifact in Magnetic Resonance Imaging [1.0951772570165874]
We present a novel dual-domain optimization (DDO) approach that integrates information from the pixel and frequency domains.
Experimental results on the NYU fastMRI dataset demonstrate that our method outperforms existing approaches in multiple evaluation metrics.
arXiv Detail & Related papers (2025-03-11T05:26:03Z) - Motion Artifact Removal in Pixel-Frequency Domain via Alternate Masks and Diffusion Model [58.694932010573346]
Motion artifacts present in magnetic resonance imaging (MRI) can seriously interfere with clinical diagnosis.
We propose a novel unsupervised purification method which leverages pixel-frequency information of noisy MRI images to guide a pre-trained diffusion model to recover clean MRI images.
arXiv Detail & Related papers (2024-12-10T15:25:18Z) - Advancing Medical Image Segmentation: Morphology-Driven Learning with Diffusion Transformer [4.672688418357066]
We propose a novel Transformer Diffusion (DTS) model for robust segmentation in the presence of noise.
Our model, which analyzes the morphological representation of images, shows better results than the previous models in various medical imaging modalities.
arXiv Detail & Related papers (2024-08-01T07:35:54Z) - Motion-Informed Deep Learning for Brain MR Image Reconstruction Framework [7.639405634241267]
Motion is estimated to be present in approximately 30% of clinical MRI scans.
Deep learning algorithms have been demonstrated to be effective for both the image reconstruction task and the motion correction task.
We propose a novel method to simultaneously accelerate imaging and correct motion.
arXiv Detail & Related papers (2024-05-28T02:16:35Z) - Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images [39.94162291765236]
We present a weakly supervised method to generate a healthy version of a diseased image and then use it to obtain a pixel-wise anomaly map.
We employ a diffusion model trained on healthy samples and combine Denoising Diffusion Probabilistic Model (DDPM) and Denoising Implicit Model (DDIM) at each step of the sampling process.
arXiv Detail & Related papers (2023-08-03T21:56:50Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Deep learning network to correct axial and coronal eye motion in 3D OCT
retinal imaging [65.47834983591957]
We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan.
The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
arXiv Detail & Related papers (2023-05-27T03:55:19Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - Explicit Abnormality Extraction for Unsupervised Motion Artifact Reduction in Magnetic Resonance Imaging [41.587861167935785]
Motion artifacts compromise the quality of magnetic resonance imaging (MRI)
Deep learning approaches have emerged as successful solutions for motion artifact reduction (MAR)
One disadvantage of these methods is their dependency on acquiring paired sets of motion artifact-corrupted (MA-corrupted) and motion artifact-free (MA-free) MR images for training purposes.
We propose a novel UN Abnormality Extraction Network (UNAEN) to alleviate this problem.
arXiv Detail & Related papers (2023-01-04T18:02:59Z) - Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network.
We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module.
Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
arXiv Detail & Related papers (2022-12-01T07:32:56Z) - Reducing Textural Bias Improves Robustness of Deep Segmentation CNNs [8.736194193307451]
Recent findings on natural images suggest that deep neural models can show a textural bias when carrying out image classification tasks.
This study aims to investigate ways in which addressing the textural bias phenomenon could be used to bring up the robustness and transferability of deep segmentation models.
arXiv Detail & Related papers (2020-11-30T18:29:53Z) - Retinal Image Segmentation with a Structure-Texture Demixing Network [62.69128827622726]
The complex structure and texture information are mixed in a retinal image, and distinguishing the information is difficult.
Existing methods handle texture and structure jointly, which may lead biased models toward recognizing textures and thus results in inferior segmentation performance.
We propose a segmentation strategy that seeks to separate structure and texture components and significantly improve the performance.
arXiv Detail & Related papers (2020-07-15T12:19:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.