Improving anatomical plausibility in medical image segmentation via
hybrid graph neural networks: applications to chest x-ray analysis
- URL: http://arxiv.org/abs/2203.10977v1
- Date: Mon, 21 Mar 2022 13:37:23 GMT
- Title: Improving anatomical plausibility in medical image segmentation via
hybrid graph neural networks: applications to chest x-ray analysis
- Authors: Nicol\'as Gaggion, Lucas Mansilla, Candelaria Mosquera, Diego H.
Milone and Enzo Ferrante
- Abstract summary: We introduce HybridGNet, an encoder-decoder neural architecture that leverages standard convolutions for image feature encoding and graph convolutional neural networks (GCNNs) to decode plausible representations of anatomical structures.
A novel image-to-graph skip connection layer allows localized features to flow from standard convolutional blocks to GCNN blocks, and show that it improves segmentation accuracy.
- Score: 3.3382651833270587
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Anatomical segmentation is a fundamental task in medical image computing,
generally tackled with fully convolutional neural networks which produce dense
segmentation masks. These models are often trained with loss functions such as
cross-entropy or Dice, which assume pixels to be independent of each other,
thus ignoring topological errors and anatomical inconsistencies. We address
this limitation by moving from pixel-level to graph representations, which
allow to naturally incorporate anatomical constraints by construction. To this
end, we introduce HybridGNet, an encoder-decoder neural architecture that
leverages standard convolutions for image feature encoding and graph
convolutional neural networks (GCNNs) to decode plausible representations of
anatomical structures. We also propose a novel image-to-graph skip connection
layer which allows localized features to flow from standard convolutional
blocks to GCNN blocks, and show that it improves segmentation accuracy. The
proposed architecture is extensively evaluated in a variety of domain shift and
image occlusion scenarios, and audited considering different types of
demographic domain shift. Our comprehensive experimental setup compares
HybridGNet with other landmark and pixel-based models for anatomical
segmentation in chest x-ray images, and shows that it produces anatomically
plausible results in challenging scenarios where other models tend to fail.
Related papers
- Graph Neural Networks for Learning Equivariant Representations of Neural Networks [55.04145324152541]
We propose to represent neural networks as computational graphs of parameters.
Our approach enables a single model to encode neural computational graphs with diverse architectures.
We showcase the effectiveness of our method on a wide range of tasks, including classification and editing of implicit neural representations.
arXiv Detail & Related papers (2024-03-18T18:01:01Z) - Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing [72.45257414889478]
We aim to reduce human workload by predicting connectivity between over-segmented neuron pieces.
We first construct a dataset, named FlyTracing, that contains millions of pairwise connections of segments expanding the whole fly brain.
We propose a novel connectivity-aware contrastive learning method to generate dense volumetric EM image embedding.
arXiv Detail & Related papers (2024-01-05T19:45:12Z) - NexToU: Efficient Topology-Aware U-Net for Medical Image Segmentation [3.8336080345323227]
CNN and Transformer variants have emerged as the leading medical image segmentation backbones.
We propose NexToU, a novel hybrid architecture for medical image segmentation.
Our method consistently outperforms other state-of-the-art (SOTA) architectures.
arXiv Detail & Related papers (2023-05-25T10:18:57Z) - Omni-Seg+: A Scale-aware Dynamic Network for Pathological Image
Segmentation [13.182646724406291]
The cross-sectional areas of glomeruli can be 64 times larger than that of peritubular capillaries.
We propose the Omni-Seg+ network, a scale-aware dynamic neural network that achieves multi-object (six tissue types) and multi-scale (5X to 40X scale) pathological image segmentation.
arXiv Detail & Related papers (2022-06-27T21:09:55Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Automatic Semantic Segmentation of the Lumbar Spine. Clinical
Applicability in a Multi-parametric and Multi-centre MRI study [0.0]
This document describes the topologies and analyses the results of the neural network designs that obtained the most accurate segmentations.
Several of the proposed designs outperform the standard U-Net used as baseline, especially when used in ensembles where the output of multiple neural networks is combined according to different strategies.
arXiv Detail & Related papers (2021-11-16T17:33:05Z) - PSGR: Pixel-wise Sparse Graph Reasoning for COVID-19 Pneumonia
Segmentation in CT Images [83.26057031236965]
We propose a pixel-wise sparse graph reasoning (PSGR) module to enhance the modeling of long-range dependencies for COVID-19 infected region segmentation in CT images.
The PSGR module avoids imprecise pixel-to-node projections and preserves the inherent information of each pixel for global reasoning.
The solution has been evaluated against four widely-used segmentation models on three public datasets.
arXiv Detail & Related papers (2021-08-09T04:58:23Z) - Hybrid graph convolutional neural networks for landmark-based anatomical
segmentation [3.2513239513964978]
HybridGNet is an encoder-decoder neural architecture which combines standard convolutions for image feature encoding.
We show that it can be used to construct landmark-based segmentations from pixel level annotations.
arXiv Detail & Related papers (2021-06-17T22:04:44Z) - TransUNet: Transformers Make Strong Encoders for Medical Image
Segmentation [78.01570371790669]
Medical image segmentation is an essential prerequisite for developing healthcare systems.
On various medical image segmentation tasks, the u-shaped architecture, also known as U-Net, has become the de-facto standard.
We propose TransUNet, which merits both Transformers and U-Net, as a strong alternative for medical image segmentation.
arXiv Detail & Related papers (2021-02-08T16:10:50Z) - Spatio-Temporal Inception Graph Convolutional Networks for
Skeleton-Based Action Recognition [126.51241919472356]
We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition.
Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
arXiv Detail & Related papers (2020-11-26T14:43:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.