Towards Generalizable Tumor Synthesis
- URL: http://arxiv.org/abs/2402.19470v2
- Date: Thu, 28 Mar 2024 16:52:45 GMT
- Title: Towards Generalizable Tumor Synthesis
- Authors: Qi Chen, Xiaoxi Chen, Haorui Song, Zhiwei Xiong, Alan Yuille, Chen Wei, Zongwei Zhou,
- Abstract summary: Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation.
This paper made a progressive stride toward generalizable tumor synthesis by leveraging a critical observation.
We have ascertained that generative AI models, e.g., Diffusion Models, can create realistic tumors generalized to a range of organs even when trained on a limited number of tumor examples from only one organ.
- Score: 48.45704270448412
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation. However, success in tumor synthesis hinges on creating visually realistic tumors that are generalizable across multiple organs and, furthermore, the resulting AI models being capable of detecting real tumors in images sourced from different domains (e.g., hospitals). This paper made a progressive stride toward generalizable tumor synthesis by leveraging a critical observation: early-stage tumors (< 2cm) tend to have similar imaging characteristics in computed tomography (CT), whether they originate in the liver, pancreas, or kidneys. We have ascertained that generative AI models, e.g., Diffusion Models, can create realistic tumors generalized to a range of organs even when trained on a limited number of tumor examples from only one organ. Moreover, we have shown that AI models trained on these synthetic tumors can be generalized to detect and segment real tumors from CT volumes, encompassing a broad spectrum of patient demographics, imaging protocols, and healthcare facilities.
Related papers
- Analyzing Tumors by Synthesis [11.942932753828854]
Tumor synthesis generates numerous tumor examples in medical images, aiding AI training for tumor detection and segmentation.
This chapter reviews AI development on real and synthetic data.
Case studies show that AI trained on synthetic tumors can achieve performance comparable to, or better than, AI only trained on real data.
arXiv Detail & Related papers (2024-09-09T19:51:44Z) - From Pixel to Cancer: Cellular Automata in Computed Tomography [12.524228287083888]
Tumor synthesis seeks to create artificial tumors in medical images.
This paper establishes a set of generic rules to simulate tumor development.
We integrate the tumor state into the original computed tomography (CT) images to generate synthetic tumors across different organs.
arXiv Detail & Related papers (2024-03-11T06:46:31Z) - Cross-modality Guidance-aided Multi-modal Learning with Dual Attention
for MRI Brain Tumor Grading [47.50733518140625]
Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly.
We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
arXiv Detail & Related papers (2024-01-17T07:54:49Z) - Early Detection and Localization of Pancreatic Cancer by Label-Free
Tumor Synthesis [11.86190788916592]
Early detection and localization of pancreatic cancer can increase the 5-year survival rate for patients from 8.5% to 20%.
Training AI models require a vast number of annotated examples, but the availability of CT scans obtaining early-stage tumors is constrained.
We develop a tumor synthesis method that can synthesize enormous examples of small pancreatic tumors in the healthy pancreas without the need for manual annotation.
arXiv Detail & Related papers (2023-08-06T03:37:34Z) - Label-Free Liver Tumor Segmentation [10.851067782021902]
We show that AI models can accurately segment liver tumors without the need for manual annotation by using synthetic tumors in CT scans.
Our synthetic tumors have two intriguing advantages: realistic in shape and texture, which even medical professionals can confuse with real tumors.
Our synthetic tumors can automatically generate many examples of small (or even tiny) synthetic tumors.
arXiv Detail & Related papers (2023-03-27T01:22:12Z) - CancerUniT: Towards a Single Unified Model for Effective Detection,
Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection
of CT Scans [45.83431075462771]
Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice.
Most medical AI systems are built to focus on single organs with a narrow list of a few diseases.
CancerUniT is a query-based Mask Transformer model with the output of multi-tumor prediction.
arXiv Detail & Related papers (2023-01-28T20:09:34Z) - Synthetic Tumors Make AI Segment Tumors Better [10.851067782021902]
We develop a novel strategy to generate synthetic tumors.
The tumors are realistic in shape and texture, which even medical professionals can confuse with real tumors.
Our synthetic tumors have the potential to improve the success rate of small tumor detection.
arXiv Detail & Related papers (2022-10-26T16:45:19Z) - SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on
Medical Images [47.35184075381965]
We present a data augmentation method for generating synthetic medical images using cycle-consistency Generative Adversarial Networks (GANs)
The proposed GANs-based model can generate a tumor image from a normal image, and in turn, it can also generate a normal image from a tumor image.
We train the classification model using real images with classic data augmentation methods and classification models using synthetic images.
arXiv Detail & Related papers (2020-11-15T14:01:24Z) - Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo
Hyperspectral Tumor Type Classification [49.32653090178743]
We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning.
Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
arXiv Detail & Related papers (2020-07-02T12:00:53Z) - Stan: Small tumor-aware network for breast ultrasound image segmentation [68.8204255655161]
We propose a novel deep learning architecture called Small Tumor-Aware Network (STAN) to improve the performance of segmenting tumors with different size.
The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors.
arXiv Detail & Related papers (2020-02-03T22:25:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.