Can SAM Segment Polyps?

• URL: http://arxiv.org/abs/2304.07583v1
• Date: Sat, 15 Apr 2023 15:41:10 GMT
• Title: Can SAM Segment Polyps?
• Authors: Tao Zhou, Yizhe Zhang, Yi Zhou, Ye Wu, Chen Gong
• Abstract summary: Recently, Meta AI Research releases a general Segment Anything Model (SAM), which has demonstrated promising performance in several segmentation tasks. In this report, we evaluate the performance of SAM in segmenting polyps, in which SAM is under unprompted settings.
• Score: 43.259797663208865
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, Meta AI Research releases a general Segment Anything Model (SAM), which has demonstrated promising performance in several segmentation tasks. As we know, polyp segmentation is a fundamental task in the medical imaging field, which plays a critical role in the diagnosis and cure of colorectal cancer. In particular, applying SAM to the polyp segmentation task is interesting. In this report, we evaluate the performance of SAM in segmenting polyps, in which SAM is under unprompted settings. We hope this report will provide insights to advance this polyp segmentation field and promote more interesting works in the future. This project is publicly at https://github.com/taozh2017/SAMPolyp.

Related papers

• DB-SAM: Delving into High Quality Universal Medical Image Segmentation [100.63434169944853]
  We propose a dual-branch adapted SAM framework, named DB-SAM, to bridge the gap between natural and 2D/3D medical data. Our proposed DB-SAM achieves an absolute gain of 8.8%, compared to a recent medical SAM adapter in the literature.
  arXiv  Detail & Related papers  (2024-10-05T14:36:43Z)
• Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detection [18.61909523131399]
  Polyp segmentation plays a crucial role in the early detection and diagnosis of colorectal cancer. Recently, Meta AI Research released a general Segment Anything Model 2 (SAM 2), which has demonstrated promising performance in several segmentation tasks. In this manuscript, we evaluate the performance of SAM 2 in segmenting polyps under various prompted settings.
  arXiv  Detail & Related papers  (2024-08-12T02:10:18Z)
• SAM-CP: Marrying SAM with Composable Prompts for Versatile Segmentation [88.80792308991867]
  Segment Anything model (SAM) has shown ability to group image pixels into patches, but applying it to semantic-aware segmentation still faces major challenges. This paper presents SAM-CP, a simple approach that establishes two types of composable prompts beyond SAM and composes them for versatile segmentation. Experiments show that SAM-CP achieves semantic, instance, and panoptic segmentation in both open and closed domains.
  arXiv  Detail & Related papers  (2024-07-23T17:47:25Z)
• ASPS: Augmented Segment Anything Model for Polyp Segmentation [77.25557224490075]
  The Segment Anything Model (SAM) has introduced unprecedented potential for polyp segmentation. SAM's Transformer-based structure prioritizes global and low-frequency information. CFA integrates a trainable CNN encoder branch with a frozen ViT encoder, enabling the integration of domain-specific knowledge.
  arXiv  Detail & Related papers  (2024-06-30T14:55:32Z)
• Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentation [10.444726122035133]
  We propose a simple unified framework, SaLIP, for organ segmentation. SAM is used for part based segmentation within the image, followed by CLIP to retrieve the mask corresponding to the region of interest. Finally, SAM is prompted by the retrieved ROI to segment a specific organ.
  arXiv  Detail & Related papers  (2024-04-09T14:56:34Z)
• RAP-SAM: Towards Real-Time All-Purpose Segment Anything [120.17175256421622]
  Segment Anything Model (SAM) is one remarkable model that can achieve generalized segmentation. Current real-time segmentation mainly has one purpose, such as semantic segmentation on the driving scene. This work explores a new real-time segmentation setting, named all-purpose segmentation in real-time, to transfer VFMs in real-time deployment.
  arXiv  Detail & Related papers  (2024-01-18T18:59:30Z)
• Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation? [0.0]
  Polyp-SAM++, a text prompt-aided SAM, can better utilize a SAM using text prompting for robust and more precise polyp segmentation. We will evaluate the performance of a text-guided SAM on the polyp segmentation task on benchmark datasets.
  arXiv  Detail & Related papers  (2023-08-12T17:45:39Z)
• Polyp-SAM: Transfer SAM for Polyp Segmentation [2.4492242722754107]
  Segment Anything Model (SAM) has recently gained much attention in both natural and medical image segmentation. We propose Poly-SAM, a finetuned SAM model for polyp segmentation, and compare its performance to several state-of-the-art polyp segmentation models. Our Polyp-SAM achieves state-of-the-art performance on two datasets and impressive performance on three datasets, with dice scores all above 88%.
  arXiv  Detail & Related papers  (2023-04-29T16:11:06Z)
• Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation [51.770805270588625]
  The Segment Anything Model (SAM) has recently gained popularity in the field of image segmentation. Recent studies and individual experiments have shown that SAM underperforms in medical image segmentation. We propose the Medical SAM Adapter (Med-SA), which incorporates domain-specific medical knowledge into the segmentation model.
  arXiv  Detail & Related papers  (2023-04-25T07:34:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.