Task-Based Assessment for Neural Networks: Evaluating Undersampled MRI Reconstructions based on Human Observer Signal Detection

• URL: http://arxiv.org/abs/2210.12161v1
• Date: Fri, 21 Oct 2022 16:39:04 GMT
• Title: Task-Based Assessment for Neural Networks: Evaluating Undersampled MRI Reconstructions based on Human Observer Signal Detection
• Authors: Joshua D. Herman (1), Rachel E. Roca (1), Alexandra G. O'Neill (1), Marcus L. Wong (1), Sajan G. Lingala (2), Angel R. Pineda (1) ((1) Mathematics Department, Manhattan College, NY, (2) Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa City)
• Abstract summary: Common metrics for evaluating image quality like the normalized root mean squared error (NRMSE) and structural similarity (SSIM) are global metrics which average out impact of subtle features in the images. We used measures of image quality which incorporate a subtle signal for a specific task allow for image quality assessment which locally evaluates the effect of undersampling on a signal.
• Score: 45.82374977939355
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent research has explored using neural networks to reconstruct undersampled magnetic resonance imaging (MRI) data. Because of the complexity of the artifacts in the reconstructed images, there is a need to develop task-based approaches of image quality. Common metrics for evaluating image quality like the normalized root mean squared error (NRMSE) and structural similarity (SSIM) are global metrics which average out impact of subtle features in the images. Using measures of image quality which incorporate a subtle signal for a specific task allow for image quality assessment which locally evaluates the effect of undersampling on a signal. We used a U-Net to reconstruct under-sampled images with 2x, 3x, 4x and 5x fold 1-D undersampling rates. Cross validation was performed for a 500 and a 4000 image training set with both structural similarity (SSIM) and mean squared error (MSE) losses. A two alternative forced choice (2-AFC) observer study was carried out for detecting a subtle signal (small blurred disk) from images with the 4000 image training set. We found that for both loss functions and training set sizes, the human observer performance on the 2-AFC studies led to a choice of a 2x undersampling but the SSIM and NRMSE led to a choice of a 3x undersampling. For this task, SSIM and NRMSE led to an overestimate of the achievable undersampling using a U-Net before a steep loss of image quality when compared to the performance of human observers in the detection of a subtle lesion.

Related papers

• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)
• A No-Reference Deep Learning Quality Assessment Method for Super-resolution Images Based on Frequency Maps [39.58198651685851]
  We propose a no-reference deep-learning image quality assessment method based on frequency maps. We first obtain the high-frequency map (HM) and low-frequency map (LM) of SRI by using Sobel operator and piecewise smooth image approximation. Our method outperforms all compared IQA models on the selected three super-resolution quality assessment (SRQA) databases.
  arXiv  Detail & Related papers  (2022-06-09T05:43:37Z)
• Image Quality Assessment using Contrastive Learning [50.265638572116984]
  We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem. We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models. Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
  arXiv  Detail & Related papers  (2021-10-25T21:01:00Z)
• Blind microscopy image denoising with a deep residual and multiscale encoder/decoder network [0.0]
  Deep multiscale convolutional encoder-decoder neural network is proposed. The proposed model reaches on average 38.38 of PSNR and 0.98 of SSIM on a test set of 57458 images.
  arXiv  Detail & Related papers  (2021-05-01T14:54:57Z)
• Towards Ultrafast MRI via Extreme k-Space Undersampling and Superresolution [65.25508348574974]
  We go below the MRI acceleration factors reported by all published papers that reference the original fastMRI challenge. We consider powerful deep learning based image enhancement methods to compensate for the underresolved images. The quality of the reconstructed images surpasses that of the other methods, yielding an MSE of 0.00114, a PSNR of 29.6 dB, and an SSIM of 0.956 at x16 acceleration factor.
  arXiv  Detail & Related papers  (2021-03-04T10:45:01Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• W2S: Microscopy Data with Joint Denoising and Super-Resolution for Widefield to SIM Mapping [17.317001872212543]
  In fluorescence microscopy live-cell imaging, there is a critical trade-off between the signal-to-noise ratio and spatial resolution. To obtain clean high-resolution (HR) images, one can either use microscopy techniques, such as structured-illumination microscopy (SIM) or apply denoising and super-resolution (SR) algorithms. We show that state-of-the-art SR networks perform very poorly on noisy inputs.
  arXiv  Detail & Related papers  (2020-03-12T18:15:09Z)
• 1D Probabilistic Undersampling Pattern Optimization for MR Image Reconstruction [3.46218629010647]
  We propose a cross-domain network for MR image reconstruction, in a retrospective data-driven manner, under limited sampling rates. Our method can simultaneously obtain the optimal undersampling pattern (in k-space) and the reconstruction model, which are customized to the type of training data.
  arXiv  Detail & Related papers  (2020-03-08T15:15:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.