CellTrack R-CNN: A Novel End-To-End Deep Neural Network for Cell
Segmentation and Tracking in Microscopy Images
- URL: http://arxiv.org/abs/2102.10377v1
- Date: Sat, 20 Feb 2021 15:55:40 GMT
- Title: CellTrack R-CNN: A Novel End-To-End Deep Neural Network for Cell
Segmentation and Tracking in Microscopy Images
- Authors: Yuqian Chen, Yang Song, Chaoyi Zhang, Fan Zhang, Lauren O'Donnell,
Wojciech Chrzanowski, Weidong Cai
- Abstract summary: We propose a novel approach to combine cell segmentation and cell tracking into a unified end-to-end deep learning based framework.
Our method outperforms state-of-the-art algorithms in terms of both cell segmentation and cell tracking accuracies.
- Score: 21.747994390120105
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Cell segmentation and tracking in microscopy images are of great significance
to new discoveries in biology and medicine. In this study, we propose a novel
approach to combine cell segmentation and cell tracking into a unified
end-to-end deep learning based framework, where cell detection and segmentation
are performed with a current instance segmentation pipeline and cell tracking
is implemented by integrating Siamese Network with the pipeline. Besides,
tracking performance is improved by incorporating spatial information into the
network and fusing spatial and visual prediction. Our approach was evaluated on
the DeepCell benchmark dataset. Despite being simple and efficient, our method
outperforms state-of-the-art algorithms in terms of both cell segmentation and
cell tracking accuracies.
Related papers
- Few-Shot Learning for Annotation-Efficient Nucleus Instance Segmentation [50.407071700154674]
We propose to formulate annotation-efficient nucleus instance segmentation from the perspective of few-shot learning (FSL)
Our work was motivated by that, with the prosperity of computational pathology, an increasing number of fully-annotated datasets are publicly accessible.
Extensive experiments on a couple of publicly accessible datasets demonstrate that SGFSIS can outperform other annotation-efficient learning baselines.
arXiv Detail & Related papers (2024-02-26T03:49:18Z) - Single-Cell Deep Clustering Method Assisted by Exogenous Gene
Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells.
During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation.
This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
arXiv Detail & Related papers (2023-11-28T09:14:55Z) - Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions.
We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training.
Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
arXiv Detail & Related papers (2023-10-22T02:27:02Z) - OCELOT: Overlapped Cell on Tissue Dataset for Histopathology [13.691924123273004]
We release OCELOT, a dataset dedicated to the study of cell-tissue relationships for cell detection in histopathology.
We propose multi-task learning approaches that benefit from learning both cell and tissue tasks simultaneously.
On the OCELOT test set in particular, we show up to 6.79 improvement in F1-score.
arXiv Detail & Related papers (2023-03-23T08:57:11Z) - Analysis of the performance of U-Net neural networks for the
segmentation of living cells [0.0]
This work has as goals the study of the performance of deep learning for segmenting microscopy images.
Deep learning techniques, mainly convolutional neural networks, have been applied to cell segmentation problems.
quasi-real-time image analysis was enabled, where 6.20GB of data was processed in 4 minutes.
arXiv Detail & Related papers (2022-10-04T11:48:59Z) - EmbedTrack -- Simultaneous Cell Segmentation and Tracking Through
Learning Offsets and Clustering Bandwidths [0.30458514384586405]
We present EmbedTrack, a single convolutional neural network for simultaneous cell segmentation and tracking.
As embeddings, offsets of cell pixels to their cell center and bandwidths are learned.
We benchmark our approach on nine 2D data sets from the Cell Tracking Challenge.
arXiv Detail & Related papers (2022-04-22T14:04:37Z) - Graph Neural Network for Cell Tracking in Microscopy Videos [0.0]
We present a novel graph neural network (GNN) approach for cell tracking in microscopy videos.
By modeling the entire time-lapse sequence as a direct graph, we extract the entire set of cell trajectories.
We exploit a deep metric learning algorithm to extract cell feature vectors that distinguish between instances of different biological cells.
arXiv Detail & Related papers (2022-02-09T21:21:48Z) - PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive
Learning [109.84770951839289]
We present PredRNN, a new recurrent network for learning visual dynamics from historical context.
We show that our approach obtains highly competitive results on three standard datasets.
arXiv Detail & Related papers (2021-03-17T08:28:30Z) - Towards an Automatic Analysis of CHO-K1 Suspension Growth in
Microfluidic Single-cell Cultivation [63.94623495501023]
We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data.
Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
arXiv Detail & Related papers (2020-10-20T08:36:51Z) - Split and Expand: An inference-time improvement for Weakly Supervised
Cell Instance Segmentation [71.50526869670716]
We propose a two-step post-processing procedure, Split and Expand, to improve the conversion of segmentation maps to instances.
In the Split step, we split clumps of cells from the segmentation map into individual cell instances with the guidance of cell-center predictions.
In the Expand step, we find missing small cells using the cell-center predictions.
arXiv Detail & Related papers (2020-07-21T14:05:09Z) - Cell Segmentation and Tracking using CNN-Based Distance Predictions and
a Graph-Based Matching Strategy [0.20999222360659608]
We present a method for the segmentation of touching cells in microscopy images.
By using a novel representation of cell borders, inspired by distance maps, our method is capable to utilize not only touching cells but also close cells in the training process.
This representation is notably robust to annotation errors and shows promising results for the segmentation of microscopy images containing in the training data underrepresented or not included cell types.
arXiv Detail & Related papers (2020-04-03T11:55:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.