Hybrid graph convolutional neural networks for landmark-based anatomical segmentation

• URL: http://arxiv.org/abs/2106.09832v1
• Date: Thu, 17 Jun 2021 22:04:44 GMT
• Title: Hybrid graph convolutional neural networks for landmark-based anatomical segmentation
• Authors: Nicol\'as Gaggion, Lucas Mansilla, Diego Milone, Enzo Ferrante
• Abstract summary: HybridGNet is an encoder-decoder neural architecture which combines standard convolutions for image feature encoding. We show that it can be used to construct landmark-based segmentations from pixel level annotations.
• Score: 3.2513239513964978
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In this work we address the problem of landmark-based segmentation for anatomical structures. We propose HybridGNet, an encoder-decoder neural architecture which combines standard convolutions for image feature encoding, with graph convolutional neural networks to decode plausible representations of anatomical structures. We benchmark the proposed architecture considering other standard landmark and pixel-based models for anatomical segmentation in chest x-ray images, and found that HybridGNet is more robust to image occlusions. We also show that it can be used to construct landmark-based segmentations from pixel level annotations. Our experimental results suggest that HybridGNet produces accurate and anatomically plausible landmark-based segmentations, by naturally incorporating shape constraints within the decoding process via spectral convolutions.

Related papers

• GNN-LoFI: a Novel Graph Neural Network through Localized Feature-based Histogram Intersection [51.608147732998994]
  Graph neural networks are increasingly becoming the framework of choice for graph-based machine learning. We propose a new graph neural network architecture that substitutes classical message passing with an analysis of the local distribution of node features.
  arXiv  Detail & Related papers  (2024-01-17T13:04:23Z)
• PHG-Net: Persistent Homology Guided Medical Image Classification [14.450329809640422]
  We propose a persistent homology guided approach (PHG-Net) that explores topological features of objects for medical image classification. For an input image, we first compute its cubical persistence diagram and extract topological features into a vector representation. The extracted topological features are then incorporated into the feature map generated by CNN or Transformer for feature fusion.
  arXiv  Detail & Related papers  (2023-11-28T21:34:06Z)
• Image segmentation with traveling waves in an exactly solvable recurrent neural network [71.74150501418039]
  We show that a recurrent neural network can effectively divide an image into groups according to a scene's structural characteristics. We present a precise description of the mechanism underlying object segmentation in this network. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images.
  arXiv  Detail & Related papers  (2023-11-28T16:46:44Z)
• ViG-UNet: Vision Graph Neural Networks for Medical Image Segmentation [7.802846775068384]
  We propose a graph neural network-based U-shaped architecture with the encoder, the decoder, the bottleneck, and skip connections. The experimental results on ISIC 2016, ISIC 2017 and Kvasir-SEG datasets demonstrate that our proposed architecture outperforms most existing classic and state-of-the-art U-shaped networks.
  arXiv  Detail & Related papers  (2023-06-08T03:17:00Z)
• Structure Embedded Nucleus Classification for Histopathology Images [51.02953253067348]
  Most neural network based methods are affected by the local receptive field of convolutions. We propose a novel polygon-structure feature learning mechanism that transforms a nucleus contour into a sequence of points sampled in order. Next, we convert a histopathology image into a graph structure with nuclei as nodes, and build a graph neural network to embed the spatial distribution of nuclei into their representations.
  arXiv  Detail & Related papers  (2023-02-22T14:52:06Z)
• Multi-center anatomical segmentation with heterogeneous labels via landmark-based models [5.1618890441642]
  We show how state-of-the-art pixel-level segmentation models fail in naively learning this task due to domain issues and conflicting labels. We then propose to adopt HybridGNet, a landmark-based segmentation model which learns the available anatomical structures using graph-based representations.
  arXiv  Detail & Related papers  (2022-11-14T14:25:52Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Improving anatomical plausibility in medical image segmentation via hybrid graph neural networks: applications to chest x-ray analysis [3.3382651833270587]
  We introduce HybridGNet, an encoder-decoder neural architecture that leverages standard convolutions for image feature encoding and graph convolutional neural networks (GCNNs) to decode plausible representations of anatomical structures. A novel image-to-graph skip connection layer allows localized features to flow from standard convolutional blocks to GCNN blocks, and show that it improves segmentation accuracy.
  arXiv  Detail & Related papers  (2022-03-21T13:37:23Z)
• Automatic Semantic Segmentation of the Lumbar Spine. Clinical Applicability in a Multi-parametric and Multi-centre MRI study [0.0]
  This document describes the topologies and analyses the results of the neural network designs that obtained the most accurate segmentations. Several of the proposed designs outperform the standard U-Net used as baseline, especially when used in ensembles where the output of multiple neural networks is combined according to different strategies.
  arXiv  Detail & Related papers  (2021-11-16T17:33:05Z)
• Crosslink-Net: Double-branch Encoder Segmentation Network via Fusing Vertical and Horizontal Convolutions [58.71117402626524]
  We present a novel double-branch encoder architecture for medical image segmentation. Our architecture is inspired by two observations: 1) Since the discrimination of features learned via square convolutional kernels needs to be further improved, we propose to utilize non-square vertical and horizontal convolutional kernels. The experiments validate the effectiveness of our model on four datasets.
  arXiv  Detail & Related papers  (2021-07-24T02:58:32Z)
• The efficiency of deep learning algorithms for detecting anatomical reference points on radiological images of the head profile [55.41644538483948]
  A U-Net neural network allows performing the detection of anatomical reference points more accurately than a fully convolutional neural network. The results of the detection of anatomical reference points by the U-Net neural network are closer to the average results of the detection of reference points by a group of orthodontists.
  arXiv  Detail & Related papers  (2020-05-25T13:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.