SAFRON: Stitching Across the Frontier for Generating Colorectal Cancer Histology Images

• URL: http://arxiv.org/abs/2008.04526v2
• Date: Fri, 26 Mar 2021 16:08:45 GMT
• Title: SAFRON: Stitching Across the Frontier for Generating Colorectal Cancer Histology Images
• Authors: Srijay Deshpande, Fayyaz Minhas, Simon Graham, Nasir Rajpoot
• Abstract summary: Synthetic images can be used for the development and evaluation of deep learning algorithms in the context of limited availability of data. We propose a novel SAFRON framework to construct realistic, large high resolution tissue image tiles from ground truth annotations. We show that the proposed method can generate realistic image tiles of arbitrarily large size after training it on relatively small image patches.
• Score: 2.486942181212742
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Synthetic images can be used for the development and evaluation of deep learning algorithms in the context of limited availability of data. In the field of computational pathology, where histology images are large in size and visual context is crucial, synthesis of large high resolution images via generative modeling is a challenging task. This is due to memory and computational constraints hindering the generation of large images. To address this challenge, we propose a novel SAFRON (Stitching Across the FRONtiers) framework to construct realistic, large high resolution tissue image tiles from ground truth annotations while preserving morphological features and with minimal boundary artifacts. We show that the proposed method can generate realistic image tiles of arbitrarily large size after training it on relatively small image patches. We demonstrate that our model can generate high quality images, both visually and in terms of the Frechet Inception Distance. Compared to other existing approaches, our framework is efficient in terms of the memory requirements for training and also in terms of the number of computations to construct a large high-resolution image. We also show that training on synthetic data generated by SAFRON can significantly boost the performance of a state-of-the-art algorithm for gland segmentation in colorectal cancer histology images. Sample high resolution images generated using SAFRON are available at the URL: https://warwick.ac.uk/TIALab/SAFRON

Related papers

• Realistic Extreme Image Rescaling via Generative Latent Space Learning [51.85790402171696]
  We propose a novel framework called Latent Space Based Image Rescaling (LSBIR) for extreme image rescaling tasks. LSBIR effectively leverages powerful natural image priors learned by a pre-trained text-to-image diffusion model to generate realistic HR images. In the first stage, a pseudo-invertible encoder-decoder models the bidirectional mapping between the latent features of the HR image and the target-sized LR image. In the second stage, the reconstructed features from the first stage are refined by a pre-trained diffusion model to generate more faithful and visually pleasing details.
  arXiv  Detail & Related papers  (2024-08-17T09:51:42Z)
• Learned representation-guided diffusion models for large-image generation [58.192263311786824]
  We introduce a novel approach that trains diffusion models conditioned on embeddings from self-supervised learning (SSL) Our diffusion models successfully project these features back to high-quality histopathology and remote sensing images. Augmenting real data by generating variations of real images improves downstream accuracy for patch-level and larger, image-scale classification tasks.
  arXiv  Detail & Related papers  (2023-12-12T14:45:45Z)
• Connecting the Dots: Graph Neural Network Powered Ensemble and Classification of Medical Images [0.0]
  Deep learning for medical imaging is limited due to the requirement for large amounts of training data. We employ the Image Foresting Transform to optimally segment images into superpixels. These superpixels are subsequently transformed into graph-structured data, enabling the proficient extraction of features and modeling of relationships.
  arXiv  Detail & Related papers  (2023-11-13T13:20:54Z)
• Distance Weighted Trans Network for Image Completion [52.318730994423106]
  We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components. CNNs are used to augment the local texture information of coarse priors. DWT blocks are used to recover certain coarse textures and coherent visual structures.
  arXiv  Detail & Related papers  (2023-10-11T12:46:11Z)
• Synthesis of Annotated Colorectal Cancer Tissue Images from Gland Layout [0.0]
  Synthetically generated images and annotations are valuable for training and evaluating algorithms in this domain. We propose an interactive framework generating pairs of realistic colorectal cancer histology images with corresponding glandular masks from glandular structure layouts.
  arXiv  Detail & Related papers  (2023-05-08T19:25:50Z)
• Histopathology DatasetGAN: Synthesizing Large-Resolution Histopathology Datasets [0.0]
  Histopathology datasetGAN (HDGAN) is a framework for image generation and segmentation that scales well to large-resolution histopathology images. We make several adaptations from the original framework, including updating the generative backbone, selectively extracting latent features from the generator, and switching to memory-mapped arrays. We evaluate HDGAN on a thrombotic microangiopathy high-resolution tile dataset, demonstrating strong performance on the high-resolution image-annotation generation task.
  arXiv  Detail & Related papers  (2022-07-06T14:33:50Z)
• Sharp-GAN: Sharpness Loss Regularized GAN for Histopathology Image Synthesis [65.47507533905188]
  Conditional generative adversarial networks have been applied to generate synthetic histopathology images. We propose a sharpness loss regularized generative adversarial network to synthesize realistic histopathology images.
  arXiv  Detail & Related papers  (2021-10-27T18:54:25Z)
• InfinityGAN: Towards Infinite-Resolution Image Synthesis [92.40782797030977]
  We present InfinityGAN, a method to generate arbitrary-resolution images. We show how it trains and infers patch-by-patch seamlessly with low computational resources.
  arXiv  Detail & Related papers  (2021-04-08T17:59:30Z)
• Efficient texture-aware multi-GAN for image inpainting [5.33024001730262]
  Recent GAN-based (Generative adversarial networks) inpainting methods show remarkable improvements. We propose a multi-GAN architecture improving both the performance and rendering efficiency.
  arXiv  Detail & Related papers  (2020-09-30T14:58:03Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.