PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics

• URL: http://arxiv.org/abs/2112.05754v1
• Date: Fri, 10 Dec 2021 04:02:23 GMT
• Title: PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics
• Authors: Zudi Lin, Donglai Wei, Jeff Lichtman and Hanspeter Pfister
• Abstract summary: PyTorch Connectomics (PyTC) is an open-source deep-learning framework for the semantic and instance segmentation of volumetric microscopy images. PyTC aims to segment neurons, synapses, and other organelles like mitochondria at nanometer resolution for understanding neuronal communication, metabolism, and development in animal brains.
• Score: 26.612749327414335
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present PyTorch Connectomics (PyTC), an open-source deep-learning framework for the semantic and instance segmentation of volumetric microscopy images, built upon PyTorch. We demonstrate the effectiveness of PyTC in the field of connectomics, which aims to segment and reconstruct neurons, synapses, and other organelles like mitochondria at nanometer resolution for understanding neuronal communication, metabolism, and development in animal brains. PyTC is a scalable and flexible toolbox that tackles datasets at different scales and supports multi-task and semi-supervised learning to better exploit expensive expert annotations and the vast amount of unlabeled data during training. Those functionalities can be easily realized in PyTC by changing the configuration options without coding and adapted to other 2D and 3D segmentation tasks for different tissues and imaging modalities. Quantitatively, our framework achieves the best performance in the CREMI challenge for synaptic cleft segmentation (outperforms existing best result by relatively 6.1$\%$) and competitive performance on mitochondria and neuronal nuclei segmentation. Code and tutorials are publicly available at https://connectomics.readthedocs.io.

Related papers

• Multi-Domain Data Aggregation for Axon and Myelin Segmentation in Histology Images [0.5825410941577593]
  Quantifying axon and myelin properties in histology images can provide useful information about microstructural changes caused by neurodegenerative diseases. Advances in deep learning have made this task quick and reliable with minimal overhead, but a deep learning model trained by one research group will hardly ever be usable by other groups. There is a pressing need to make AI accessible to researchers to facilitate and accelerate their workflow, but publicly available models are scarce and poorly maintained. Our approach is to aggregate data from multiple imaging modalities to create an open-source, durable tool for axon and myelin segmentation.
  arXiv  Detail & Related papers  (2024-09-17T20:47:32Z)
• GCtx-UNet: Efficient Network for Medical Image Segmentation [0.2353157426758003]
  GCtx-UNet is a lightweight segmentation architecture that can capture global and local image features with accuracy better than state-of-the-art approaches. GCtx-UNet is evaluated on the Synapse multi-organ abdominal CT dataset, the ACDC cardiac MRI dataset, and several polyp segmentation datasets.
  arXiv  Detail & Related papers  (2024-06-09T19:17:14Z)
• Diffusion-based Data Augmentation for Nuclei Image Segmentation [68.28350341833526]
  We introduce the first diffusion-based augmentation method for nuclei segmentation. The idea is to synthesize a large number of labeled images to facilitate training the segmentation model. The experimental results show that by augmenting 10% labeled real dataset with synthetic samples, one can achieve comparable segmentation results.
  arXiv  Detail & Related papers  (2023-10-22T06:16:16Z)
• Learning from partially labeled data for multi-organ and tumor segmentation [102.55303521877933]
  We propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple datasets. A dynamic head enables the network to accomplish multiple segmentation tasks flexibly. We create a large-scale partially labeled Multi-Organ and Tumor benchmark, termed MOTS, and demonstrate the superior performance of our TransDoDNet over other competitors.
  arXiv  Detail & Related papers  (2022-11-13T13:03:09Z)
• Learning Topological Interactions for Multi-Class Medical Image Segmentation [7.95994513875072]
  We introduce a novel topological interaction module to encode the topological interactions into a deep neural network. The implementation is completely convolution-based and thus can be very efficient. We demonstrate the generalizability of the method on both proprietary and public challenge datasets.
  arXiv  Detail & Related papers  (2022-07-20T05:09:43Z)
• Improving Across-Dataset Brain Tissue Segmentation Using Transformer [10.838458766450989]
  This study introduces a novel CNN-Transformer hybrid architecture designed for brain tissue segmentation. We validate our model's performance across four multi-site T1w MRI datasets.
  arXiv  Detail & Related papers  (2022-01-21T15:16:39Z)
• CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from Brain Electron Microscopy [49.3704402041314]
  We propose a novel and augmented deep learning model, known as CleftNet, for improving synaptic cleft detection from brain EM images. We first propose two novel network components, known as the feature augmentor and the label augmentor, for augmenting features and labels to improve cleft representations.
  arXiv  Detail & Related papers  (2021-01-12T02:45:53Z)
• PyHealth: A Python Library for Health Predictive Models [53.848478115284195]
  PyHealth is an open-source Python toolbox for developing various predictive models on healthcare data. The data preprocessing module enables the transformation of complex healthcare datasets into machine learning friendly formats. The predictive modeling module provides more than 30 machine learning models, including established ensemble trees and deep neural network-based approaches.
  arXiv  Detail & Related papers  (2021-01-11T22:02:08Z)
• DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets [102.55303521877933]
  We propose a dynamic on-demand network (DoDNet) that learns to segment multiple organs and tumors on partially labelled datasets. DoDNet consists of a shared encoder-decoder architecture, a task encoding module, a controller for generating dynamic convolution filters, and a single but dynamic segmentation head.
  arXiv  Detail & Related papers  (2020-11-20T04:56:39Z)
• 3D medical image segmentation with labeled and unlabeled data using autoencoders at the example of liver segmentation in CT images [58.720142291102135]
  This work investigates the potential of autoencoder-extracted features to improve segmentation with a convolutional neural network. A convolutional autoencoder was used to extract features from unlabeled data and a multi-scale, fully convolutional CNN was used to perform the target task of 3D liver segmentation in CT images.
  arXiv  Detail & Related papers  (2020-03-17T20:20:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.