SCOPE: Structural Continuity Preservation for Medical Image Segmentation
- URL: http://arxiv.org/abs/2304.14572v1
- Date: Fri, 28 Apr 2023 00:11:35 GMT
- Title: SCOPE: Structural Continuity Preservation for Medical Image Segmentation
- Authors: Yousef Yeganeh, Azade Farshad, Goktug Guevercin, Amr Abu-zer, Rui
Xiao, Yongjian Tang, Ehsan Adeli, Nassir Navab
- Abstract summary: We propose a graph-based approach that enforces the continuity and connectivity of anatomical topology in medical images.
Our method encodes the continuity of shapes as a graph constraint, ensuring that the network's predictions maintain this continuity.
- Score: 41.43063476894447
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Although the preservation of shape continuity and physiological anatomy is a
natural assumption in the segmentation of medical images, it is often neglected
by deep learning methods that mostly aim for the statistical modeling of input
data as pixels rather than interconnected structures. In biological structures,
however, organs are not separate entities; for example, in reality, a severed
vessel is an indication of an underlying problem, but traditional segmentation
models are not designed to strictly enforce the continuity of anatomy,
potentially leading to inaccurate medical diagnoses. To address this issue, we
propose a graph-based approach that enforces the continuity and connectivity of
anatomical topology in medical images. Our method encodes the continuity of
shapes as a graph constraint, ensuring that the network's predictions maintain
this continuity. We evaluate our method on two public benchmarks on retinal
vessel segmentation, showing significant improvements in connectivity metrics
compared to traditional methods while getting better or on-par performance on
segmentation metrics.
Related papers
- CF-Seg: Counterfactuals meet Segmentation [15.886397919997538]
Segmenting anatomical structures in medical images plays an important role in the quantitative assessment of various diseases.<n>Disease patterns can alter the appearance of surrounding healthy tissues, introduce ambiguous boundaries, or obscure critical anatomical structures.<n>In this paper, we generate counterfactual (CF) images to simulate how the same anatomy would appear in the absence of disease without altering the underlying structure.
arXiv Detail & Related papers (2025-06-19T11:01:33Z) - Using Foundation Models as Pseudo-Label Generators for Pre-Clinical 4D Cardiac CT Segmentation [5.4689325272353955]
We propose a self-training approach to generate accurate pseudo-labels for pig cardiac CT.<n>Our method requires no manually annotated pig data, relying instead on iterative updates to improve segmentation quality.<n>Although our results are encouraging, there remains room for improvement, for example by incorporating more sophisticated self-training strategies and by exploring additional foundation models and other cardiac imaging technologies.
arXiv Detail & Related papers (2025-05-14T17:07:30Z) - Pitfalls of topology-aware image segmentation [81.19923502845441]
We identify critical pitfalls in model evaluation that include inadequate connectivity choices, overlooked topological artifacts, and inappropriate use of evaluation metrics.
We propose a set of actionable recommendations to establish fair and robust evaluation standards for topology-aware medical image segmentation methods.
arXiv Detail & Related papers (2024-12-19T08:11:42Z) - Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentation [10.776242801237862]
We propose a novel medical image segmentation method that combines diffusion models and Structure-Preserving Network for structure-aware one-shot image stylization.
Our approach effectively mitigates domain shifts by transforming images from various sources into a consistent style while maintaining the location, size, and shape of lesions.
arXiv Detail & Related papers (2024-12-05T16:15:32Z) - MedUHIP: Towards Human-In-the-Loop Medical Segmentation [5.520419627866446]
Medical image segmentation is particularly complicated by inherent uncertainties.
We propose a novel approach that integrates an textbfuncertainty-aware model with textbfhuman-in-the-loop interaction
Our method showcases superior segmentation capabilities, outperforming a wide range of deterministic and uncertainty-aware models.
arXiv Detail & Related papers (2024-08-03T01:06:02Z) - Anatomy-guided Pathology Segmentation [56.883822515800205]
We develop a generalist segmentation model that combines anatomical and pathological information, aiming to enhance the segmentation accuracy of pathological features.
Our Anatomy-Pathology Exchange (APEx) training utilizes a query-based segmentation transformer which decodes a joint feature space into query-representations for human anatomy.
In doing so, we are able to report the best results across the board on FDG-PET-CT and Chest X-Ray pathology segmentation tasks with a margin of up to 3.3% as compared to strong baseline methods.
arXiv Detail & Related papers (2024-07-08T11:44:15Z) - Implicit Anatomical Rendering for Medical Image Segmentation with
Stochastic Experts [11.007092387379078]
We propose MORSE, a generic implicit neural rendering framework designed at an anatomical level to assist learning in medical image segmentation.
Our approach is to formulate medical image segmentation as a rendering problem in an end-to-end manner.
Our experiments demonstrate that MORSE can work well with different medical segmentation backbones.
arXiv Detail & Related papers (2023-04-06T16:44:03Z) - Latent Graph Representations for Critical View of Safety Assessment [2.9724186623561435]
We propose a method for CVS prediction wherein we first represent a surgical image using a disentangled latent scene graph, then process this representation using a graph neural network.
Our graph representations explicitly encode semantic information to improve anatomy-driven reasoning, as well as visual features to retain differentiability and thereby provide robustness to semantic errors.
We show that our method not only outperforms several baseline methods when trained with bounding box annotations, but also scales effectively when trained with segmentation masks, maintaining state-of-the-art performance.
arXiv Detail & Related papers (2022-12-08T09:21:09Z) - Automated Coronary Arteries Labeling Via Geometric Deep Learning [13.515293812745343]
We propose an intuitive graph representation method, well suited to use with 3D coordinate data obtained from angiography scans.
We subsequently seek to analyze subject-specific graphs using geometric deep learning.
The proposed models leverage expert annotated labels from 141 patients to learn representations of each coronary segment, while capturing the effects of anatomical variability within the training data.
arXiv Detail & Related papers (2022-12-01T09:31:08Z) - Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels [54.58539616385138]
We introduce a novel semi-supervised 2D medical image segmentation framework termed Mine yOur owN Anatomy (MONA)
First, prior work argues that every pixel equally matters to the model training; we observe empirically that this alone is unlikely to define meaningful anatomical features.
Second, we construct a set of objectives that encourage the model to be capable of decomposing medical images into a collection of anatomical features.
arXiv Detail & Related papers (2022-09-27T15:50:31Z) - Inconsistency-aware Uncertainty Estimation for Semi-supervised Medical
Image Segmentation [92.9634065964963]
We present a new semi-supervised segmentation model, namely, conservative-radical network (CoraNet) based on our uncertainty estimation and separate self-training strategy.
Compared with the current state of the art, our CoraNet has demonstrated superior performance.
arXiv Detail & Related papers (2021-10-17T08:49:33Z) - A survey on shape-constraint deep learning for medical image
segmentation [0.46023882211671957]
convolutional deep neural networks and its many variants have completely changed the modern landscape of deep learning based medical image segmentation.
The over dependence of these methods on pixel level classification and regression has been identified early on as a problem.
To ensure the segmentation result is anatomically consistent, approaches based on Markov/ Conditional Random Fields, Statistical Shape Models are becoming increasingly popular.
arXiv Detail & Related papers (2021-01-19T16:52:10Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.