F2FLDM: Latent Diffusion Models with Histopathology Pre-Trained Embeddings for Unpaired Frozen Section to FFPE Translation

• URL: http://arxiv.org/abs/2404.12650v1
• Date: Fri, 19 Apr 2024 06:32:21 GMT
• Title: F2FLDM: Latent Diffusion Models with Histopathology Pre-Trained Embeddings for Unpaired Frozen Section to FFPE Translation
• Authors: Man M. Ho, Shikha Dubey, Yosep Chong, Beatrice Knudsen, Tolga Tasdizen,
• Abstract summary: The Frozen Section (FS) technique is a rapid and efficient method, taking only 15-30 minutes to prepare slides for pathologists' evaluation during surgery. FS process often introduces artifacts and distortions like folds and ice-crystal effects. These artifacts are absent in the higher-quality formalin-fixed paraffin-embedded (FFPE) slides, which require 2-3 days to prepare. We introduce a novel approach that combines LDMs with Histopathology Pre-Trained Embeddings to enhance restoration of FS images.
• Score: 2.435021773579434
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The Frozen Section (FS) technique is a rapid and efficient method, taking only 15-30 minutes to prepare slides for pathologists' evaluation during surgery, enabling immediate decisions on further surgical interventions. However, FS process often introduces artifacts and distortions like folds and ice-crystal effects. In contrast, these artifacts and distortions are absent in the higher-quality formalin-fixed paraffin-embedded (FFPE) slides, which require 2-3 days to prepare. While Generative Adversarial Network (GAN)-based methods have been used to translate FS to FFPE images (F2F), they may leave morphological inaccuracies with remaining FS artifacts or introduce new artifacts, reducing the quality of these translations for clinical assessments. In this study, we benchmark recent generative models, focusing on GANs and Latent Diffusion Models (LDMs), to overcome these limitations. We introduce a novel approach that combines LDMs with Histopathology Pre-Trained Embeddings to enhance restoration of FS images. Our framework leverages LDMs conditioned by both text and pre-trained embeddings to learn meaningful features of FS and FFPE histopathology images. Through diffusion and denoising techniques, our approach not only preserves essential diagnostic attributes like color staining and tissue morphology but also proposes an embedding translation mechanism to better predict the targeted FFPE representation of input FS images. As a result, this work achieves a significant improvement in classification performance, with the Area Under the Curve rising from 81.99% to 94.64%, accompanied by an advantageous CaseFD. This work establishes a new benchmark for FS to FFPE image translation quality, promising enhanced reliability and accuracy in histopathology FS image analysis. Our work is available at https://minhmanho.github.io/f2f_ldm/.

Related papers

• Fundus image enhancement through direct diffusion bridges [44.31666331817371]
  We propose FD3, a fundus image enhancement method based on direct diffusion bridges. We first propose a synthetic forward model through a human feedback loop with board-certified ophthalmologists. We train a robust and flexible diffusion-based image enhancement network that is highly effective as a stand-alone method.
  arXiv  Detail & Related papers  (2024-09-19T00:26:14Z)
• LPUWF-LDM: Enhanced Latent Diffusion Model for Precise Late-phase UWF-FA Generation on Limited Dataset [8.612128994023832]
  Ultra-Wide-Field Fluorescein Angiography (UWF-FA) enables precise identification of ocular diseases using sodium fluorescein. Existing research has developed methods to generate UWF-FA from Ultra-Wide-Phase Scanning Laser Ophthalmoscopy (UWF-SLO) to reduce the adverse reactions associated with injections. Two primary challenges hinder the generation of high-quality late-phase UWF-FA: the scarcity of paired UWF-SLO and early/late-phase UWF-FA datasets, and the need for realistic generation at lesion sites and potential blood leakage regions
  arXiv  Detail & Related papers  (2024-09-01T14:09:00Z)
• LatentArtiFusion: An Effective and Efficient Histological Artifacts Restoration Framework [22.525991027687084]
  Current approaches for histological artifact restoration, based on Generative Adversarial Networks (GANs) and pixel-level Diffusion Models, suffer from performance limitations and computational inefficiencies. We propose a novel framework, LatentArtiFusion, which leverages the latent diffusion model (LDM) to reconstruct histological artifacts with high performance and computational efficiency.
  arXiv  Detail & Related papers  (2024-07-29T17:00:32Z)
• Leveraging Pre-trained Models for FF-to-FFPE Histopathological Image Translation [6.108290302640328]
  Diffusion-FFPE is a method to translate Formalin-Fixed Paraffin-Embedded (FFPE) images into Fresh Frozen (FF) images. We employ a one-step diffusion model as the generator and fine-tune it with LoRA adapters using adversarial learning objectives. We conducted FF-to-FFPE translation experiments on the TCGA-NSCLC datasets, and our method achieved better performance compared to other methods.
  arXiv  Detail & Related papers  (2024-06-26T04:12:34Z)
• CriDiff: Criss-cross Injection Diffusion Framework via Generative Pre-train for Prostate Segmentation [60.61972883059688]
  CriDiff is a two-stage feature injecting framework with a Crisscross Injection Strategy (CIS) and a Generative Pre-train (GP) approach for prostate segmentation. To effectively learn multi-level of edge features and non-edge features, we proposed two parallel conditioners in the CIS. The GP approach eases the inconsistency between the images features and the diffusion model without adding additional parameters.
  arXiv  Detail & Related papers  (2024-06-20T10:46:50Z)
• Orientation-Shared Convolution Representation for CT Metal Artifact Learning [63.67718355820655]
  During X-ray computed tomography (CT) scanning, metallic implants carrying with patients often lead to adverse artifacts. Existing deep-learning-based methods have gained promising reconstruction performance. We propose an orientation-shared convolution representation strategy to adapt the physical prior structures of artifacts.
  arXiv  Detail & Related papers  (2022-12-26T13:56:12Z)
• MS Lesion Segmentation: Revisiting Weighting Mechanisms for Federated Learning [92.91544082745196]
  Federated learning (FL) has been widely employed for medical image analysis. FL's performance is limited for multiple sclerosis (MS) lesion segmentation tasks. We propose the first FL MS lesion segmentation framework via two effective re-weighting mechanisms.
  arXiv  Detail & Related papers  (2022-05-03T14:06:03Z)
• Mutual Contrastive Learning to Disentangle Whole Slide Image Representations for Glioma Grading [10.65788461379405]
  Whole slide images (WSI) provide valuable phenotypic information for histological malignancy assessment and grading of tumors. The most commonly used WSI are derived from formalin-fixed paraffin-embedded (FFPE) and frozen sections. Here we propose a mutual contrastive learning scheme to integrate FFPE and frozen sections and disentangle cross-modality representations for glioma grading.
  arXiv  Detail & Related papers  (2022-03-08T11:08:44Z)
• Deep Learning-based Frozen Section to FFPE Translation [4.221354566366119]
  Frozen sectioning (FS) is the preparation method of choice for microscopic evaluation of tissues during surgical operations. FS is prone to introducing misleading artificial structures, such as nuclear ice crystals, compression, and cutting artefacts. We propose an artificial intelligence (AI) method that improves FS image quality by computationally transforming frozen-sectioned whole-slide images (FS-WSIs) into whole-slide FFPE-style images in minutes.
  arXiv  Detail & Related papers  (2021-07-25T11:32:57Z)
• Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
  Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis. We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors. Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
  arXiv  Detail & Related papers  (2020-05-12T08:01:16Z)
• Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks [68.96150598294072]
  Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights. It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness. In recent years, there has been a significant effort to automate the diagnosis using deep learning. This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN) Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
  arXiv  Detail & Related papers  (2020-04-03T14:07:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.