Neuroplastic graph attention networks for nuclei segmentation in
histopathology images
- URL: http://arxiv.org/abs/2201.03669v1
- Date: Mon, 10 Jan 2022 22:19:14 GMT
- Title: Neuroplastic graph attention networks for nuclei segmentation in
histopathology images
- Authors: Yoav Alon, Huiyu Zhou
- Abstract summary: We propose a novel architecture for semantic segmentation of cell nuclei.
The architecture is comprised of a novel neuroplastic graph attention network.
In experimental evaluation, our framework outperforms ensembles of state-of-the-art neural networks.
- Score: 17.30043617044508
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Modern histopathological image analysis relies on the segmentation of cell
structures to derive quantitative metrics required in biomedical research and
clinical diagnostics. State-of-the-art deep learning approaches predominantly
apply convolutional layers in segmentation and are typically highly customized
for a specific experimental configuration; often unable to generalize to
unknown data. As the model capacity of classical convolutional layers is
limited by a finite set of learned kernels, our approach uses a graph
representation of the image and focuses on the node transitions in multiple
magnifications. We propose a novel architecture for semantic segmentation of
cell nuclei robust to differences in experimental configuration such as
staining and variation of cell types. The architecture is comprised of a novel
neuroplastic graph attention network based on residual graph attention layers
and concurrent optimization of the graph structure representing multiple
magnification levels of the histopathological image. The modification of graph
structure, which generates the node features by projection, is as important to
the architecture as the graph neural network itself. It determines the possible
message flow and critical properties to optimize attention, graph structure,
and node updates in a balanced magnification loss. In experimental evaluation,
our framework outperforms ensembles of state-of-the-art neural networks, with a
fraction of the neurons typically required, and sets new standards for the
segmentation of new nuclei datasets.
Related papers
- GNN-LoFI: a Novel Graph Neural Network through Localized Feature-based
Histogram Intersection [51.608147732998994]
Graph neural networks are increasingly becoming the framework of choice for graph-based machine learning.
We propose a new graph neural network architecture that substitutes classical message passing with an analysis of the local distribution of node features.
arXiv Detail & Related papers (2024-01-17T13:04:23Z) - Revealing Cortical Layers In Histological Brain Images With
Self-Supervised Graph Convolutional Networks Applied To Cell-Graphs [0.20971479389679332]
We introduce a self-supervised approach to detect layers in 2D Nissl-stained histological slices of the cerebral cortex.
A self-supervised graph convolutional network generates cell embeddings that encode morphological and structural traits of the cellular environment.
arXiv Detail & Related papers (2023-11-26T10:33:36Z) - Asymmetric Co-Training with Explainable Cell Graph Ensembling for
Histopathological Image Classification [28.949527817202984]
We propose an asymmetric co-training framework combining a deep graph convolutional network and a convolutional neural network.
We build a 14-layer deep graph convolutional network to handle cell graph data.
We evaluate our approach on the private LUAD7C and public colorectal cancer datasets.
arXiv Detail & Related papers (2023-08-24T12:27:03Z) - Structure Embedded Nucleus Classification for Histopathology Images [51.02953253067348]
Most neural network based methods are affected by the local receptive field of convolutions.
We propose a novel polygon-structure feature learning mechanism that transforms a nucleus contour into a sequence of points sampled in order.
Next, we convert a histopathology image into a graph structure with nuclei as nodes, and build a graph neural network to embed the spatial distribution of nuclei into their representations.
arXiv Detail & Related papers (2023-02-22T14:52:06Z) - Hyperbolic Graph Neural Networks: A Review of Methods and Applications [55.5502008501764]
Graph neural networks generalize conventional neural networks to graph-structured data.
The performance of Euclidean models in graph-related learning is still bounded and limited by the representation ability of Euclidean geometry.
Recently, hyperbolic space has gained increasing popularity in processing graph data with tree-like structure and power-law distribution.
arXiv Detail & Related papers (2022-02-28T15:08:48Z) - End-to-end Neuron Instance Segmentation based on Weakly Supervised
Efficient UNet and Morphological Post-processing [0.0]
We present an end-to-end weakly-supervised framework to automatically detect and segment NeuN stained neuronal cells on histological images.
We integrate the state-of-the-art network, EfficientNet, into our U-Net-like architecture.
arXiv Detail & Related papers (2022-02-17T14:35:45Z) - Self-Supervised Graph Representation Learning for Neuronal Morphologies [75.38832711445421]
We present GraphDINO, a data-driven approach to learn low-dimensional representations of 3D neuronal morphologies from unlabeled datasets.
We show, in two different species and across multiple brain areas, that this method yields morphological cell type clusterings on par with manual feature-based classification by experts.
Our method could potentially enable data-driven discovery of novel morphological features and cell types in large-scale datasets.
arXiv Detail & Related papers (2021-12-23T12:17:47Z) - Spatio-Temporal Inception Graph Convolutional Networks for
Skeleton-Based Action Recognition [126.51241919472356]
We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition.
Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
arXiv Detail & Related papers (2020-11-26T14:43:04Z) - Towards Deeper Graph Neural Networks [63.46470695525957]
Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations.
Several recent studies attribute this performance deterioration to the over-smoothing issue.
We propose Deep Adaptive Graph Neural Network (DAGNN) to adaptively incorporate information from large receptive fields.
arXiv Detail & Related papers (2020-07-18T01:11:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.