CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from
Brain Electron Microscopy
- URL: http://arxiv.org/abs/2101.04266v1
- Date: Tue, 12 Jan 2021 02:45:53 GMT
- Title: CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from
Brain Electron Microscopy
- Authors: Yi Liu, Shuiwang Ji
- Abstract summary: We propose a novel and augmented deep learning model, known as CleftNet, for improving synaptic cleft detection from brain EM images.
We first propose two novel network components, known as the feature augmentor and the label augmentor, for augmenting features and labels to improve cleft representations.
- Score: 49.3704402041314
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Detecting synaptic clefts is a crucial step to investigate the biological
function of synapses. The volume electron microscopy (EM) allows the
identification of synaptic clefts by photoing EM images with high resolution
and fine details. Machine learning approaches have been employed to
automatically predict synaptic clefts from EM images. In this work, we propose
a novel and augmented deep learning model, known as CleftNet, for improving
synaptic cleft detection from brain EM images. We first propose two novel
network components, known as the feature augmentor and the label augmentor, for
augmenting features and labels to improve cleft representations. The feature
augmentor can fuse global information from inputs and learn common
morphological patterns in clefts, leading to augmented cleft features. In
addition, it can generate outputs with varying dimensions, making it flexible
to be integrated in any deep network. The proposed label augmentor augments the
label of each voxel from a value to a vector, which contains both the
segmentation label and boundary label. This allows the network to learn
important shape information and to produce more informative cleft
representations. Based on the proposed feature augmentor and label augmentor,
We build the CleftNet as a U-Net like network. The effectiveness of our methods
is evaluated on both online and offline tasks. Our CleftNet currently ranks \#1
on the online task of the CREMI open challenge. In addition, both quantitative
and qualitative results in the offline tasks show that our method outperforms
the baseline approaches significantly.
Related papers
- Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI [58.809276442508256]
We propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers.
The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network superior performance than the state-of-the-art methods.
arXiv Detail & Related papers (2024-08-11T15:46:00Z) - BEFUnet: A Hybrid CNN-Transformer Architecture for Precise Medical Image
Segmentation [0.0]
This paper proposes an innovative U-shaped network called BEFUnet, which enhances the fusion of body and edge information for precise medical image segmentation.
The BEFUnet comprises three main modules, including a novel Local Cross-Attention Feature (LCAF) fusion module, a novel Double-Level Fusion (DLF) module, and dual-branch encoder.
The LCAF module efficiently fuses edge and body features by selectively performing local cross-attention on features that are spatially close between the two modalities.
arXiv Detail & Related papers (2024-02-13T21:03:36Z) - Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing [72.45257414889478]
We aim to reduce human workload by predicting connectivity between over-segmented neuron pieces.
We first construct a dataset, named FlyTracing, that contains millions of pairwise connections of segments expanding the whole fly brain.
We propose a novel connectivity-aware contrastive learning method to generate dense volumetric EM image embedding.
arXiv Detail & Related papers (2024-01-05T19:45:12Z) - U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation [14.450329809640422]
We introduce U-Net v2, a new robust and efficient U-Net variant for medical image segmentation.
It aims to augment the infusion of semantic information into low-level features while simultaneously refining high-level features with finer details.
arXiv Detail & Related papers (2023-11-29T16:35:24Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Spatio-Temporal Inception Graph Convolutional Networks for
Skeleton-Based Action Recognition [126.51241919472356]
We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition.
Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
arXiv Detail & Related papers (2020-11-26T14:43:04Z) - Comparisons among different stochastic selection of activation layers
for convolutional neural networks for healthcare [77.99636165307996]
We classify biomedical images using ensembles of neural networks.
We select our activations among the following ones: ReLU, leaky ReLU, Parametric ReLU, ELU, Adaptive Piecewice Linear Unit, S-Shaped ReLU, Swish, Mish, Mexican Linear Unit, Parametric Deformable Linear Unit, Soft Root Sign.
arXiv Detail & Related papers (2020-11-24T01:53:39Z) - Dual Convolutional Neural Networks for Breast Mass Segmentation and
Diagnosis in Mammography [18.979126709943085]
We introduce a novel deep learning framework for mammogram image processing, which computes mass segmentation and simultaneously predict diagnosis results.
Our method is constructed in a dual-path architecture that solves the mapping in a dual-problem manner.
Experimental results show that DualCoreNet achieves the best mammography segmentation and classification simultaneously, outperforming recent state-of-the-art models.
arXiv Detail & Related papers (2020-08-07T02:23:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.