From augmented microscopy to the topological transformer: a new approach
in cell image analysis for Alzheimer's research
- URL: http://arxiv.org/abs/2108.01625v1
- Date: Tue, 3 Aug 2021 16:59:33 GMT
- Title: From augmented microscopy to the topological transformer: a new approach
in cell image analysis for Alzheimer's research
- Authors: Wooseok Jung
- Abstract summary: Cell image analysis is crucial in Alzheimer's research to detect the presence of A$beta$ protein inhibiting cell function.
We first found Unet is most suitable in augmented microscopy by comparing performance in multi-class semantics segmentation.
We develop the augmented microscopy method to capture nuclei in a brightfield image and the transformer using Unet model to convert an input image into a sequence of topological information.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Cell image analysis is crucial in Alzheimer's research to detect the presence
of A$\beta$ protein inhibiting cell function. Deep learning speeds up the
process by making only low-level data sufficient for fruitful inspection. We
first found Unet is most suitable in augmented microscopy by comparing
performance in multi-class semantics segmentation. We develop the augmented
microscopy method to capture nuclei in a brightfield image and the transformer
using Unet model to convert an input image into a sequence of topological
information. The performance regarding Intersection-over-Union is consistent
concerning the choice of image preprocessing and ground-truth generation.
Training model with data of a specific cell type demonstrates transfer learning
applies to some extent.
The topological transformer aims to extract persistence silhouettes or
landscape signatures containing geometric information of a given image of
cells. This feature extraction facilitates studying an image as a collection of
one-dimensional data, substantially reducing computational costs. Using the
transformer, we attempt grouping cell images by their cell type relying solely
on topological features. Performances of the transformers followed by SVM,
XGBoost, LGBM, and simple convolutional neural network classifiers are inferior
to the conventional image classification. However, since this research
initiates a new perspective in biomedical research by combining deep learning
and topology for image analysis, we speculate follow-up investigation will
reinforce our genuine regime.
Related papers
- Practical Guidelines for Cell Segmentation Models Under Optical Aberrations in Microscopy [14.042884268397058]
This study evaluates cell image segmentation models under optical aberrations from fluorescence and bright field microscopy.
We train and test several segmentation models, including the Otsu threshold method and Mask R-CNN with different network heads.
In contrast, Cellpose 2.0 proves effective for complex cell images under similar conditions.
arXiv Detail & Related papers (2024-04-12T15:45:26Z) - Single-Cell Deep Clustering Method Assisted by Exogenous Gene
Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells.
During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation.
This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
arXiv Detail & Related papers (2023-11-28T09:14:55Z) - Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions.
We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training.
Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
arXiv Detail & Related papers (2023-10-22T02:27:02Z) - Learning multi-scale functional representations of proteins from
single-cell microscopy data [77.34726150561087]
We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information.
We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
arXiv Detail & Related papers (2022-05-24T00:00:07Z) - Search for temporal cell segmentation robustness in phase-contrast
microscopy videos [31.92922565397439]
In this work, we present a deep learning-based workflow to segment cancer cells embedded in 3D collagen matrices.
We also propose a geometrical-characterization approach to studying cancer cell morphology.
We introduce a new annotated dataset for 2D cell segmentation and tracking, and an open-source implementation to replicate the experiments or adapt them to new image processing problems.
arXiv Detail & Related papers (2021-12-16T12:03:28Z) - Multi-Modality Microscopy Image Style Transfer for Nuclei Segmentation [3.535158633337794]
We propose a microscopy-style augmentation technique based on a generative adversarial network (GAN)
Unlike other style transfer methods, it can not only deal with different cell assay types and lighting conditions, but also with different imaging modalities.
We evaluate our data augmentation on the 2018 Data Science Bowl dataset consisting of various cell assays, lighting conditions, and imaging modalities.
arXiv Detail & Related papers (2021-11-23T20:19:20Z) - Enforcing Morphological Information in Fully Convolutional Networks to
Improve Cell Instance Segmentation in Fluorescence Microscopy Images [1.408123603417833]
We propose a novel cell instance segmentation approach based on the well-known U-Net architecture.
To enforce the learning of morphological information per pixel, a deep distance transformer (DDT) acts as a back-bone model.
The obtained results suggest a performance boost over traditional U-Net architectures.
arXiv Detail & Related papers (2021-06-10T15:54:38Z) - Comparisons among different stochastic selection of activation layers
for convolutional neural networks for healthcare [77.99636165307996]
We classify biomedical images using ensembles of neural networks.
We select our activations among the following ones: ReLU, leaky ReLU, Parametric ReLU, ELU, Adaptive Piecewice Linear Unit, S-Shaped ReLU, Swish, Mish, Mexican Linear Unit, Parametric Deformable Linear Unit, Soft Root Sign.
arXiv Detail & Related papers (2020-11-24T01:53:39Z) - Towards an Automatic Analysis of CHO-K1 Suspension Growth in
Microfluidic Single-cell Cultivation [63.94623495501023]
We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data.
Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
arXiv Detail & Related papers (2020-10-20T08:36:51Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.