2D histology meets 3D topology: Cytoarchitectonic brain mapping with Graph Neural Networks

• URL: http://arxiv.org/abs/2103.05259v1
• Date: Tue, 9 Mar 2021 07:09:42 GMT
• Title: 2D histology meets 3D topology: Cytoarchitectonic brain mapping with Graph Neural Networks
• Authors: Christian Schiffer, Stefan Harmeling, Katrin Amunts, Timo Dickscheid
• Abstract summary: Cytoarchitecture describes the spatial organization of neuronal cells in the brain. It allows to segregate the brain into cortical areas and subcortical nuclei. mapping boundaries between areas requires to scan histological sections at microscopic resolution.
• Score: 0.8602553195689513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cytoarchitecture describes the spatial organization of neuronal cells in the brain, including their arrangement into layers and columns with respect to cell density, orientation, or presence of certain cell types. It allows to segregate the brain into cortical areas and subcortical nuclei, links structure with connectivity and function, and provides a microstructural reference for human brain atlases. Mapping boundaries between areas requires to scan histological sections at microscopic resolution. While recent high-throughput scanners allow to scan a complete human brain in the order of a year, it is practically impossible to delineate regions at the same pace using the established gold standard method. Researchers have recently addressed cytoarchitectonic mapping of cortical regions with deep neural networks, relying on image patches from individual 2D sections for classification. However, the 3D context, which is needed to disambiguate complex or obliquely cut brain regions, is not taken into account. In this work, we combine 2D histology with 3D topology by reformulating the mapping task as a node classification problem on an approximate 3D midsurface mesh through the isocortex. We extract deep features from cortical patches in 2D histological sections which are descriptive of cytoarchitecture, and assign them to the corresponding nodes on the 3D mesh to construct a large attributed graph. By solving the brain mapping problem on this graph using graph neural networks, we obtain significantly improved classification results. The proposed framework lends itself nicely to integration of additional neuroanatomical priors for mapping.

Related papers

• NeuroFly: A framework for whole-brain single neuron reconstruction [17.93211301158225]
  We introduce NeuroFly, a validated framework for large-scale automatic single neuron reconstruction. NeuroFly breaks down the process into three distinct stages: segmentation, connection, and proofreading. Our goal is to foster collaboration among researchers to address the neuron reconstruction challenge.
  arXiv  Detail & Related papers  (2024-11-07T13:56:13Z)
• Revealing Cortical Layers In Histological Brain Images With Self-Supervised Graph Convolutional Networks Applied To Cell-Graphs [0.20971479389679332]
  We introduce a self-supervised approach to detect layers in 2D Nissl-stained histological slices of the cerebral cortex. A self-supervised graph convolutional network generates cell embeddings that encode morphological and structural traits of the cellular environment.
  arXiv  Detail & Related papers  (2023-11-26T10:33:36Z)
• Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images [82.5266467869448]
  We propose an Inverse Graphics Capsule Network (IGC-Net) to learn the hierarchical 3D face representations from large-scale unlabeled images. IGC-Net first decomposes the objects into a set of semantic-consistent part-level descriptions and then assembles them into object-level descriptions to build the hierarchy.
  arXiv  Detail & Related papers  (2023-03-20T06:32:55Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Hierarchical Graph Networks for 3D Human Pose Estimation [50.600944798627786]
  Recent 2D-to-3D human pose estimation works tend to utilize the graph structure formed by the topology of the human skeleton. We argue that this skeletal topology is too sparse to reflect the body structure and suffer from serious 2D-to-3D ambiguity problem. We propose a novel graph convolution network architecture, Hierarchical Graph Networks, to overcome these weaknesses.
  arXiv  Detail & Related papers  (2021-11-23T15:09:03Z)
• TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
  We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes. We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
  arXiv  Detail & Related papers  (2020-12-26T08:02:56Z)
• Contrastive Representation Learning for Whole Brain Cytoarchitectonic Mapping in Histological Human Brain Sections [0.4588028371034407]
  We propose a contrastive learning objective for encoding microscopic image patches into robust microstructural features. We show that a model pre-trained using this learning task outperforms a model trained from scratch, as well as a model pre-trained on a recently proposed auxiliary task.
  arXiv  Detail & Related papers  (2020-11-25T16:44:23Z)
• Convolutional Neural Networks for cytoarchitectonic brain mapping at large scale [0.33727511459109777]
  We present a new workflow for mapping cytoarchitectonic areas in large series of cell-body stained histological sections of human postmortem brains. It is based on a Deep Convolutional Neural Network (CNN), which is trained on a pair of section images with annotations, with a large number of un-annotated sections in between. The new workflow does not require preceding 3D-reconstruction of sections, and is robust against histological artefacts.
  arXiv  Detail & Related papers  (2020-11-25T16:25:13Z)
• CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging [90.78899127463445]
  We propose a generic and unified convolution neural network for the segmentation of curvilinear structures. We introduce a new curvilinear structure segmentation network (CS2-Net), which includes a self-attention mechanism in the encoder and decoder.
  arXiv  Detail & Related papers  (2020-10-15T03:06:37Z)
• clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentation [57.20783326661043]
  We introduce a novel similarity measure termed centerlineDice (short clDice) We theoretically prove that clDice guarantees topology preservation up to homotopy equivalence for binary 2D and 3D segmentation. We benchmark the soft-clDice loss on five public datasets, including vessels, roads and neurons (2D and 3D)
  arXiv  Detail & Related papers  (2020-03-16T16:27:49Z)
• ACEnet: Anatomical Context-Encoding Network for Neuroanatomy Segmentation [1.7080853582489066]
  2D deep learning methods are favored for their computational efficiency. Existing 2D deep learning methods are not equipped to effectively capture 3D spatial contextual information. We develop an Anatomical Context- Network (ACEnet) to incorporate 3D spatial and anatomical contexts in 2D convolutional neural networks (CNNs) Our method achieves promising performance compared with state-of-the-art alternative methods for brain structure segmentation.
  arXiv  Detail & Related papers  (2020-02-13T20:48:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.