Towards Generalizable Tumor Synthesis
- URL: http://arxiv.org/abs/2402.19470v2
- Date: Thu, 28 Mar 2024 16:52:45 GMT
- Title: Towards Generalizable Tumor Synthesis
- Authors: Qi Chen, Xiaoxi Chen, Haorui Song, Zhiwei Xiong, Alan Yuille, Chen Wei, Zongwei Zhou,
- Abstract summary: Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation.
This paper made a progressive stride toward generalizable tumor synthesis by leveraging a critical observation.
We have ascertained that generative AI models, e.g., Diffusion Models, can create realistic tumors generalized to a range of organs even when trained on a limited number of tumor examples from only one organ.
- Score: 48.45704270448412
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation. However, success in tumor synthesis hinges on creating visually realistic tumors that are generalizable across multiple organs and, furthermore, the resulting AI models being capable of detecting real tumors in images sourced from different domains (e.g., hospitals). This paper made a progressive stride toward generalizable tumor synthesis by leveraging a critical observation: early-stage tumors (< 2cm) tend to have similar imaging characteristics in computed tomography (CT), whether they originate in the liver, pancreas, or kidneys. We have ascertained that generative AI models, e.g., Diffusion Models, can create realistic tumors generalized to a range of organs even when trained on a limited number of tumor examples from only one organ. Moreover, we have shown that AI models trained on these synthetic tumors can be generalized to detect and segment real tumors from CT volumes, encompassing a broad spectrum of patient demographics, imaging protocols, and healthcare facilities.
Related papers
- Analyzing Tumors by Synthesis [11.942932753828854]
Tumor synthesis generates numerous tumor examples in medical images, aiding AI training for tumor detection and segmentation.
This chapter reviews AI development on real and synthetic data.
Case studies show that AI trained on synthetic tumors can achieve performance comparable to, or better than, AI only trained on real data.
arXiv Detail & Related papers (2024-09-09T19:51:44Z) - From Pixel to Cancer: Cellular Automata in Computed Tomography [12.524228287083888]
Tumor synthesis seeks to create artificial tumors in medical images.
This paper establishes a set of generic rules to simulate tumor development.
We integrate the tumor state into the original computed tomography (CT) images to generate synthetic tumors across different organs.
arXiv Detail & Related papers (2024-03-11T06:46:31Z) - Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - Early Detection and Localization of Pancreatic Cancer by Label-Free
Tumor Synthesis [11.86190788916592]
Early detection and localization of pancreatic cancer can increase the 5-year survival rate for patients from 8.5% to 20%.
Training AI models require a vast number of annotated examples, but the availability of CT scans obtaining early-stage tumors is constrained.
We develop a tumor synthesis method that can synthesize enormous examples of small pancreatic tumors in the healthy pancreas without the need for manual annotation.
arXiv Detail & Related papers (2023-08-06T03:37:34Z) - Label-Free Liver Tumor Segmentation [10.851067782021902]
We show that AI models can accurately segment liver tumors without the need for manual annotation by using synthetic tumors in CT scans.
Our synthetic tumors have two intriguing advantages: realistic in shape and texture, which even medical professionals can confuse with real tumors.
Our synthetic tumors can automatically generate many examples of small (or even tiny) synthetic tumors.
arXiv Detail & Related papers (2023-03-27T01:22:12Z) - CancerUniT: Towards a Single Unified Model for Effective Detection,
Segmentation, and Diagnosis of Eight Major Cancers Using a Large Collection
of CT Scans [45.83431075462771]
Human readers or radiologists routinely perform full-body multi-organ multi-disease detection and diagnosis in clinical practice.
Most medical AI systems are built to focus on single organs with a narrow list of a few diseases.
CancerUniT is a query-based Mask Transformer model with the output of multi-tumor prediction.
arXiv Detail & Related papers (2023-01-28T20:09:34Z) - Synthetic Tumors Make AI Segment Tumors Better [10.851067782021902]
We develop a novel strategy to generate synthetic tumors.
The tumors are realistic in shape and texture, which even medical professionals can confuse with real tumors.
Our synthetic tumors have the potential to improve the success rate of small tumor detection.
arXiv Detail & Related papers (2022-10-26T16:45:19Z) - Learned super resolution ultrasound for improved breast lesion
characterization [52.77024349608834]
Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level.
In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges.
By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
arXiv Detail & Related papers (2021-07-12T09:04:20Z) - Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo
Hyperspectral Tumor Type Classification [49.32653090178743]
We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning.
Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
arXiv Detail & Related papers (2020-07-02T12:00:53Z) - Stan: Small tumor-aware network for breast ultrasound image segmentation [68.8204255655161]
We propose a novel deep learning architecture called Small Tumor-Aware Network (STAN) to improve the performance of segmenting tumors with different size.
The proposed approach outperformed the state-of-the-art approaches in segmenting small breast tumors.
arXiv Detail & Related papers (2020-02-03T22:25:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.