Autoencoding Low-Resolution MRI for Semantically Smooth Interpolation of Anisotropic MRI

• URL: http://arxiv.org/abs/2202.09258v1
• Date: Fri, 18 Feb 2022 15:40:00 GMT
• Title: Autoencoding Low-Resolution MRI for Semantically Smooth Interpolation of Anisotropic MRI
• Authors: J\"org Sander, Bob D. de Vos and Ivana I\v{s}gum
• Abstract summary: We propose an unsupervised deep learning semantic approach that synthesizes new intermediate slices from encoded low-resolution examples. The method produces significantly better results in terms of Structural Similarity Index Measure and Peak Signal-to-Noise Ratio than a cubic B-spline approach.
• Score: 1.281734910003263
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High-resolution medical images are beneficial for analysis but their acquisition may not always be feasible. Alternatively, high-resolution images can be created from low-resolution acquisitions using conventional upsampling methods, but such methods cannot exploit high-level contextual information contained in the images. Recently, better performing deep-learning based super-resolution methods have been introduced. However, these methods are limited by their supervised character, i.e. they require high-resolution examples for training. Instead, we propose an unsupervised deep learning semantic interpolation approach that synthesizes new intermediate slices from encoded low-resolution examples. To achieve semantically smooth interpolation in through-plane direction, the method exploits the latent space generated by autoencoders. To generate new intermediate slices, latent space encodings of two spatially adjacent slices are combined using their convex combination. Subsequently, the combined encoding is decoded to an intermediate slice. To constrain the model, a notion of semantic similarity is defined for a given dataset. For this, a new loss is introduced that exploits the spatial relationship between slices of the same volume. During training, an existing in-between slice is generated using a convex combination of its neighboring slice encodings. The method was trained and evaluated using publicly available cardiac cine, neonatal brain and adult brain MRI scans. In all evaluations, the new method produces significantly better results in terms of Structural Similarity Index Measure and Peak Signal-to-Noise Ratio (p< 0.001 using one-sided Wilcoxon signed-rank test) than a cubic B-spline interpolation approach. Given the unsupervised nature of the method, high-resolution training data is not required and hence, the method can be readily applied in clinical settings.

Related papers

• Enhanced Sharp-GAN For Histopathology Image Synthesis [63.845552349914186]
  Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection. We propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization. The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets.
  arXiv  Detail & Related papers  (2023-01-24T17:54:01Z)
• Data-Driven Interpolation for Super-Scarce X-Ray Computed Tomography [1.3535770763481902]
  We train shallow neural networks to combine two neighbouring acquisitions into an estimated measurement at an intermediate angle. This yields an enhanced sequence of measurements that can be reconstructed using standard methods. Results are obtained for 2D and 3D imaging, on large biomedical datasets.
  arXiv  Detail & Related papers  (2022-05-16T15:42:41Z)
• An Embarrassingly Simple Consistency Regularization Method for Semi-Supervised Medical Image Segmentation [0.0]
  The scarcity of pixel-level annotation is a prevalent problem in medical image segmentation tasks. We introduce a novel regularization strategy involving computation-based mixing for semi-supervised medical image segmentation.
  arXiv  Detail & Related papers  (2022-02-01T16:21:14Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• MetaSDF: Meta-learning Signed Distance Functions [85.81290552559817]
  Generalizing across shapes with neural implicit representations amounts to learning priors over the respective function space. We formalize learning of a shape space as a meta-learning problem and leverage gradient-based meta-learning algorithms to solve this task.
  arXiv  Detail & Related papers  (2020-06-17T05:14:53Z)
• MetricUNet: Synergistic Image- and Voxel-Level Learning for Precise CT Prostate Segmentation via Online Sampling [66.01558025094333]
  We propose a two-stage framework, with the first stage to quickly localize the prostate region and the second stage to precisely segment the prostate. We introduce a novel online metric learning module through voxel-wise sampling in the multi-task network. Our method can effectively learn more representative voxel-level features compared with the conventional learning methods with cross-entropy or Dice loss.
  arXiv  Detail & Related papers  (2020-05-15T10:37:02Z)
• Belief Propagation Reloaded: Learning BP-Layers for Labeling Problems [83.98774574197613]
  We take one of the simplest inference methods, a truncated max-product Belief propagation, and add what is necessary to make it a proper component of a deep learning model. This BP-Layer can be used as the final or an intermediate block in convolutional neural networks (CNNs) The model is applicable to a range of dense prediction problems, is well-trainable and provides parameter-efficient and robust solutions in stereo, optical flow and semantic segmentation.
  arXiv  Detail & Related papers  (2020-03-13T13:11:35Z)
• Weighted Encoding Based Image Interpolation With Nonlocal Linear Regression Model [8.013127492678272]
  In image super-resolution, the low-resolution image is directly down-sampled from its high-resolution counterpart without blurring and noise. To address this problem, we propose a novel image model based on sparse representation. New approach to learn adaptive sub-dictionary online instead of clustering.
  arXiv  Detail & Related papers  (2020-03-04T03:20:21Z)
• Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning [86.45526827323954]
  Weakly-supervised semantic segmentation is a challenging task as no pixel-wise label information is provided for training. We propose an iterative algorithm to learn such pairwise relations. We show that the proposed algorithm performs favorably against the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-02-19T10:32:03Z)
• A deep learning approach for the computation of curvature in the level-set method [0.0]
  We propose a strategy to estimate the mean curvature of two-dimensional implicit in the level-set method. Our approach is based on fitting feed-forward neural networks to synthetic data sets constructed from circular immersed in uniform grids of various resolutions.
  arXiv  Detail & Related papers  (2020-02-04T00:49:47Z)
• Compressive MRI quantification using convex spatiotemporal priors and deep auto-encoders [2.5060548079588516]
  We propose a dictionary-free pipeline for multi-parametric image computing. Our approach has two stages based on compressed sensing reconstruction and learned quantitative inference.
  arXiv  Detail & Related papers  (2020-01-23T17:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.