On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis
- URL: http://arxiv.org/abs/2306.13276v1
- Date: Fri, 23 Jun 2023 03:09:03 GMT
- Title: On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis
- Authors: Divyam Madaan, Daniel Sodickson, Kyunghyun Cho, Sumit Chopra
- Abstract summary: Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
- Score: 58.634791552376235
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Magnetic Resonance Imaging (MRI) is considered the gold standard of medical
imaging because of the excellent soft-tissue contrast exhibited in the images
reconstructed by the MRI pipeline, which in-turn enables the human radiologist
to discern many pathologies easily. More recently, Deep Learning (DL) models
have also achieved state-of-the-art performance in diagnosing multiple diseases
using these reconstructed images as input. However, the image reconstruction
process within the MRI pipeline, which requires the use of complex hardware and
adjustment of a large number of scanner parameters, is highly susceptible to
noise of various forms, resulting in arbitrary artifacts within the images.
Furthermore, the noise distribution is not stationary and varies within a
machine, across machines, and patients, leading to varying artifacts within the
images. Unfortunately, DL models are quite sensitive to these varying artifacts
as it leads to changes in the input data distribution between the training and
testing phases. The lack of robustness of these models against varying
artifacts impedes their use in medical applications where safety is critical.
In this work, we focus on improving the generalization performance of these
models in the presence of multiple varying artifacts that manifest due to the
complexity of the MR data acquisition. In our experiments, we observe that
Batch Normalization, a widely used technique during the training of DL models
for medical image analysis, is a significant cause of performance degradation
in these changing environments. As a solution, we propose to use other
normalization techniques, such as Group Normalization and Layer Normalization
(LN), to inject robustness into model performance against varying image
artifacts. Through a systematic set of experiments, we show that GN and LN
provide better accuracy for various MR artifacts and distribution shifts.
Related papers
- Understanding differences in applying DETR to natural and medical images [16.200340490559338]
Transformer-based detectors have shown success in computer vision tasks with natural images.
Medical imaging data presents unique challenges such as extremely large image sizes, fewer and smaller regions of interest, and object classes which can be differentiated only through subtle differences.
This study evaluates the applicability of these transformer-based design choices when applied to a screening mammography dataset.
arXiv Detail & Related papers (2024-05-27T22:06:42Z) - NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
This paper proposes to directly modulate the generation process of diffusion models using fMRI signals.
By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
arXiv Detail & Related papers (2024-03-27T02:42:52Z) - Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection.
Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels.
Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
arXiv Detail & Related papers (2024-03-19T09:28:19Z) - Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and
Dynamic PROPELLER MRI [76.60362295758596]
Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information.
We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
arXiv Detail & Related papers (2023-11-22T05:44:51Z) - Realistic Restorer: artifact-free flow restorer(AF2R) for MRI motion
artifact removal [3.8103327351507255]
Motion artifact severely degrades image quality, reduces examination efficiency, and makes accurate diagnosis difficult.
Previous methods often relied on implicit models for artifact correction, resulting in biases in modeling the artifact formation mechanism.
We incorporate the artifact generation mechanism to reestablish the relationship between artifacts and anatomical content in the image domain.
arXiv Detail & Related papers (2023-06-19T04:02:01Z) - The role of noise in denoising models for anomaly detection in medical
images [62.0532151156057]
Pathological brain lesions exhibit diverse appearance in brain images.
Unsupervised anomaly detection approaches have been proposed using only normal data for training.
We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
arXiv Detail & Related papers (2023-01-19T21:39:38Z) - Interpretability Aware Model Training to Improve Robustness against
Out-of-Distribution Magnetic Resonance Images in Alzheimer's Disease
Classification [8.050897403457995]
We propose an interpretability aware adversarial training regime to improve robustness against out-of-distribution samples originating from different MRI hardware.
We present preliminary results showing promising performance on out-of-distribution samples.
arXiv Detail & Related papers (2021-11-15T04:42:47Z) - Multimodal-Boost: Multimodal Medical Image Super-Resolution using
Multi-Attention Network with Wavelet Transform [5.416279158834623]
Loss of corresponding image resolution degrades the overall performance of medical image diagnosis.
Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework.
This work proposes generative adversarial network (GAN) with deep multi-attention modules to learn high-frequency information from low-frequency data.
arXiv Detail & Related papers (2021-10-22T10:13:46Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - Robust Image Reconstruction with Misaligned Structural Information [0.27074235008521236]
We propose a variational framework which jointly performs reconstruction and registration.
Our approach is the first to achieve this for different modalities and outranks established approaches in terms of accuracy of both reconstruction and registration.
arXiv Detail & Related papers (2020-04-01T17:21:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.