Two-stage Cytopathological Image Synthesis for Augmenting Cervical
Abnormality Screening
- URL: http://arxiv.org/abs/2402.14707v2
- Date: Sun, 25 Feb 2024 09:03:40 GMT
- Title: Two-stage Cytopathological Image Synthesis for Augmenting Cervical
Abnormality Screening
- Authors: Zhenrong Shen, Manman Fei, Xin Wang, Jiangdong Cai, Sheng Wang, Lichi
Zhang, Qian Wang
- Abstract summary: Pathological image synthesis is naturally raised to minimize the efforts in data collection and annotation.
We propose a two-stage image synthesis framework to create synthetic data for augmenting cervical abnormality screening.
Our experiments demonstrate the synthetic image quality, diversity, and controllability of the proposed synthesis framework.
- Score: 13.569003698448
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic thin-prep cytologic test (TCT) screening can assist pathologists in
finding cervical abnormality towards accurate and efficient cervical cancer
diagnosis. Current automatic TCT screening systems mostly involve abnormal
cervical cell detection, which generally requires large-scale and diverse
training data with high-quality annotations to achieve promising performance.
Pathological image synthesis is naturally raised to minimize the efforts in
data collection and annotation. However, it is challenging to generate
realistic large-size cytopathological images while simultaneously synthesizing
visually plausible appearances for small-size abnormal cervical cells. In this
paper, we propose a two-stage image synthesis framework to create synthetic
data for augmenting cervical abnormality screening. In the first Global Image
Generation stage, a Normal Image Generator is designed to generate
cytopathological images full of normal cervical cells. In the second Local Cell
Editing stage, normal cells are randomly selected from the generated images and
then are converted to different types of abnormal cells using the proposed
Abnormal Cell Synthesizer. Both Normal Image Generator and Abnormal Cell
Synthesizer are built upon Stable Diffusion, a pre-trained foundation model for
image synthesis, via parameter-efficient fine-tuning methods for customizing
cytopathological image contents and extending spatial layout controllability,
respectively. Our experiments demonstrate the synthetic image quality,
diversity, and controllability of the proposed synthesis framework, and
validate its data augmentation effectiveness in enhancing the performance of
abnormal cervical cell detection.
Related papers
- An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesis [8.01395073111961]
We introduce a novel family of models termed Generative Cellular Automata (GeCA)
GeCAs are evaluated as an effective augmentation tool for retinal disease classification across two imaging modalities: Fundus and Optical Coherence Tomography ( OCT)
In the context of OCT imaging, where data is scarce and the distribution of classes is inherently skewed, GeCA significantly boosts the performance of 11 different ophthalmological conditions.
arXiv Detail & Related papers (2024-07-03T11:26:09Z) - Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images.
SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images.
Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2024-05-21T15:41:34Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - CellGAN: Conditional Cervical Cell Synthesis for Augmenting
Cytopathological Image Classification [11.255093167227928]
Current solutions need to localize suspicious cells and classify abnormality based on local patches.
CellGAN is equipped with a non-linear class mapping network to effectively incorporate cell type information into image generation.
arXiv Detail & Related papers (2023-07-12T14:13:54Z) - Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule
Augmentation and Detection [52.93342510469636]
Lung nodule detection in chest X-ray (CXR) images is common to early screening of lung cancers.
Deep-learning-based Computer-Assisted Diagnosis (CAD) systems can support radiologists for nodule screening in CXR.
To alleviate the limited availability of such datasets, lung nodule synthesis methods are proposed for the sake of data augmentation.
arXiv Detail & Related papers (2022-07-19T16:38:48Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Selective Synthetic Augmentation with HistoGAN for Improved
Histopathology Image Classification [11.087537668968888]
We propose a conditional GAN model, namely HistoGAN, for synthesizing realistic histopathology image patches conditioned on class labels.
We also investigate a novel synthetic augmentation framework that selectively adds new synthetic image patches generated by our proposed HistoGAN.
Our models are evaluated on two datasets: a cervical histopathology image dataset with limited annotations, and another dataset of lymph node histopathology images with metastatic cancer.
arXiv Detail & Related papers (2021-11-10T23:25:39Z) - CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for
Non-Contrast to Contrast CT Translation [56.622832383316215]
We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans.
Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran.
Our empirical results show that CyTran outperforms all competing methods.
arXiv Detail & Related papers (2021-10-12T23:25:03Z) - From augmented microscopy to the topological transformer: a new approach
in cell image analysis for Alzheimer's research [0.0]
Cell image analysis is crucial in Alzheimer's research to detect the presence of A$beta$ protein inhibiting cell function.
We first found Unet is most suitable in augmented microscopy by comparing performance in multi-class semantics segmentation.
We develop the augmented microscopy method to capture nuclei in a brightfield image and the transformer using Unet model to convert an input image into a sequence of topological information.
arXiv Detail & Related papers (2021-08-03T16:59:33Z) - Where is the disease? Semi-supervised pseudo-normality synthesis from an
abnormal image [24.547317269668312]
We propose a Semi-supervised Medical Image generative LEarning network (SMILE) to generate realistic pseudo-normal images.
Our model outperforms the best state-of-the-art model by up to 6% for data augmentation task and 3% in generating high-quality images.
arXiv Detail & Related papers (2021-06-24T05:56:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.