Polyp-DDPM: Diffusion-Based Semantic Polyp Synthesis for Enhanced
Segmentation
- URL: http://arxiv.org/abs/2402.04031v1
- Date: Tue, 6 Feb 2024 14:26:02 GMT
- Title: Polyp-DDPM: Diffusion-Based Semantic Polyp Synthesis for Enhanced
Segmentation
- Authors: Zolnamar Dorjsembe, Hsing-Kuo Pao and Furen Xiao
- Abstract summary: Polyp-DDPM is a diffusion-based method for generating realistic images of polyps conditioned on masks.
Our approach addresses the challenges of data limitations, high annotation costs, and privacy concerns associated with medical images.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This study introduces Polyp-DDPM, a diffusion-based method for generating
realistic images of polyps conditioned on masks, aimed at enhancing the
segmentation of gastrointestinal (GI) tract polyps. Our approach addresses the
challenges of data limitations, high annotation costs, and privacy concerns
associated with medical images. By conditioning the diffusion model on
segmentation masks-binary masks that represent abnormal areas-Polyp-DDPM
outperforms state-of-the-art methods in terms of image quality (achieving a
Frechet Inception Distance (FID) score of 78.47, compared to scores above
83.79) and segmentation performance (achieving an Intersection over Union (IoU)
of 0.7156, versus less than 0.6694 for synthetic images from baseline models
and 0.7067 for real data). Our method generates a high-quality, diverse
synthetic dataset for training, thereby enhancing polyp segmentation models to
be comparable with real images and offering greater data augmentation
capabilities to improve segmentation models. The source code and pretrained
weights for Polyp-DDPM are made publicly available at
https://github.com/mobaidoctor/polyp-ddpm.
Related papers
- ASPS: Augmented Segment Anything Model for Polyp Segmentation [77.25557224490075]
The Segment Anything Model (SAM) has introduced unprecedented potential for polyp segmentation.
SAM's Transformer-based structure prioritizes global and low-frequency information.
CFA integrates a trainable CNN encoder branch with a frozen ViT encoder, enabling the integration of domain-specific knowledge.
arXiv Detail & Related papers (2024-06-30T14:55:32Z) - ECC-PolypDet: Enhanced CenterNet with Contrastive Learning for Automatic
Polyp Detection [88.4359020192429]
Existing methods either involve computationally expensive context aggregation or lack prior modeling of polyps, resulting in poor performance in challenging cases.
In this paper, we propose the Enhanced CenterNet with Contrastive Learning (ECC-PolypDet), a two-stage training & end-to-end inference framework.
Box-assisted Contrastive Learning (BCL) during training to minimize the intra-class difference and maximize the inter-class difference between foreground polyps and backgrounds, enabling our model to capture concealed polyps.
In the fine-tuning stage, we introduce the IoU-guided Sample Re-weighting
arXiv Detail & Related papers (2024-01-10T07:03:41Z) - ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic
Diffusion Models [69.9178140563928]
Colonoscopy analysis is essential for assisting clinical diagnosis and treatment.
The scarcity of annotated data limits the effectiveness and generalization of existing methods.
We propose an Adaptive Refinement Semantic Diffusion Model (ArSDM) to generate colonoscopy images that benefit the downstream tasks.
arXiv Detail & Related papers (2023-09-03T07:55:46Z) - Mask-conditioned latent diffusion for generating gastrointestinal polyp
images [2.027538200191349]
This study proposes a conditional DPM framework to generate synthetic GI polyp images conditioned on given segmentation masks.
Our system can generate an unlimited number of high-fidelity synthetic polyp images with the corresponding ground truth masks of polyps.
Results show that the best micro-imagewise IOU of 0.7751 was achieved from DeepLabv3+ when the training data consists of both real data and synthetic data.
arXiv Detail & Related papers (2023-04-11T14:11:17Z) - Simple U-net Based Synthetic Polyp Image Generation: Polyp to Negative
and Negative to Polyp [5.943584566266871]
Synthetic polyp generation is a good alternative to overcome the privacy problem of medical data.
We propose a deep learning-based polyp image generation framework that generates synthetic polyp images similar to real ones.
arXiv Detail & Related papers (2023-02-20T08:47:44Z) - Lesion-aware Dynamic Kernel for Polyp Segmentation [49.63274623103663]
We propose a lesion-aware dynamic network (LDNet) for polyp segmentation.
It is a traditional u-shape encoder-decoder structure incorporated with a dynamic kernel generation and updating scheme.
This simple but effective scheme endows our model with powerful segmentation performance and generalization capability.
arXiv Detail & Related papers (2023-01-12T09:53:57Z) - BoxPolyp:Boost Generalized Polyp Segmentation Using Extra Coarse
Bounding Box Annotations [79.17754846553866]
We propose a boosted BoxPolyp model to make full use of both accurate mask and extra coarse box annotations.
In practice, box annotations are applied to alleviate the over-fitting issue of previous polyp segmentation models.
Our proposed model outperforms previous state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2022-12-07T07:45:50Z) - PolypConnect: Image inpainting for generating realistic gastrointestinal
tract images with polyps [1.7915968197912802]
Early identification of a polyp in the lower gastrointestinal (GI) tract can lead to prevention of life-threatening colorectal cancer.
CAD systems to detect polyps can improve detection accuracy and efficiency and save the time of the domain experts called endoscopists.
We propose the PolypConnect pipeline, which can convert non-polyp images into polyp images to increase the size of training datasets for training.
arXiv Detail & Related papers (2022-05-30T20:20:19Z) - BDG-Net: Boundary Distribution Guided Network for Accurate Polyp
Segmentation [9.175022232984709]
Polypectomy can effectively interrupt the progression of adenoma to adenocarcinoma.
Due to the different sizes of polyps and the unclear boundary between polyps and their surrounding mucosa, it is challenging to segment polyps accurately.
We design a Boundary Distribution Guided Network (BDG-Net) for accurate polyp segmentation.
arXiv Detail & Related papers (2022-01-03T17:15:18Z) - Colonoscopy Polyp Detection: Domain Adaptation From Medical Report
Images to Real-time Videos [76.37907640271806]
We propose an Image-video-joint polyp detection network (Ivy-Net) to address the domain gap between colonoscopy images from historical medical reports and real-time videos.
Experiments on the collected dataset demonstrate that our Ivy-Net achieves the state-of-the-art result on colonoscopy video.
arXiv Detail & Related papers (2020-12-31T10:33:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.