ChrSNet: Chromosome Straightening using Self-attention Guided Networks

• URL: http://arxiv.org/abs/2207.00147v1
• Date: Fri, 1 Jul 2022 02:19:49 GMT
• Title: ChrSNet: Chromosome Straightening using Self-attention Guided Networks
• Authors: Sunyi Zheng, Jingxiong Li, Zhongyi Shui, Chenglu Zhu, Yunlong Zhang, Pingyi Chen, Lin Yang
• Abstract summary: We present a self-attention guided framework to erase the curvature of chromosomes. The proposed framework extracts spatial information and local textures to preserve banding patterns. We propose two dedicated geometric constraints to maintain the length and restore the distortion of chromosomes.
• Score: 7.335018936053776
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Karyotyping is an important procedure to assess the possible existence of chromosomal abnormalities. However, because of the non-rigid nature, chromosomes are usually heavily curved in microscopic images and such deformed shapes hinder the chromosome analysis for cytogeneticists. In this paper, we present a self-attention guided framework to erase the curvature of chromosomes. The proposed framework extracts spatial information and local textures to preserve banding patterns in a regression module. With complementary information from the bent chromosome, a refinement module is designed to further improve fine details. In addition, we propose two dedicated geometric constraints to maintain the length and restore the distortion of chromosomes. To train our framework, we create a synthetic dataset where curved chromosomes are generated from the real-world straight chromosomes by grid-deformation. Quantitative and qualitative experiments are conducted on synthetic and real-world data. Experimental results show that our proposed method can effectively straighten bent chromosomes while keeping banding details and length.

Related papers

• Graph Generation via Spectral Diffusion [51.60814773299899]
  We present GRASP, a novel graph generative model based on 1) the spectral decomposition of the graph Laplacian matrix and 2) a diffusion process. Specifically, we propose to use a denoising model to sample eigenvectors and eigenvalues from which we can reconstruct the graph Laplacian and adjacency matrix. Our permutation invariant model can also handle node features by concatenating them to the eigenvectors of each node.
  arXiv  Detail & Related papers  (2024-02-29T09:26:46Z)
• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning [77.1421343649344]
  We propose a generalization of Transformers towards operating entirely on the product of constant curvature spaces. We also provide a kernelized approach to non-Euclidean attention, which enables our model to run in time and memory cost linear to the number of nodes and edges.
  arXiv  Detail & Related papers  (2023-09-08T02:44:37Z)
• Masked conditional variational autoencoders for chromosome straightening [14.665481276886194]
  Karyotyping is of importance for detecting chromosomal aberrations in human disease. chromosomes easily appear curved in microscopic images, which prevents cytogeneticists from analyzing chromosome types. We propose a framework for chromosome straightening, which comprises a preliminary processing algorithm and a generative model.
  arXiv  Detail & Related papers  (2023-06-25T05:11:41Z)
• AutoKary2022: A Large-Scale Densely Annotated Dataset for Chromosome Instance Segmentation [8.029213659494856]
  AutoKary2022 contains over 27,000 chromosome instances in 612 microscopic images from 50 patients. Each instance is annotated with a polygonal mask and a class label to assist in precise chromosome detection and segmentation.
  arXiv  Detail & Related papers  (2023-03-28T09:15:55Z)
• Graph Generation with Diffusion Mixture [57.78958552860948]
  Generation of graphs is a major challenge for real-world tasks that require understanding the complex nature of their non-Euclidean structures. We propose a generative framework that models the topology of graphs by explicitly learning the final graph structures of the diffusion process.
  arXiv  Detail & Related papers  (2023-02-07T17:07:46Z)
• The Manifold Hypothesis for Gradient-Based Explanations [55.01671263121624]
  gradient-based explanation algorithms provide perceptually-aligned explanations. We show that the more a feature attribution is aligned with the tangent space of the data, the more perceptually-aligned it tends to be. We suggest that explanation algorithms should actively strive to align their explanations with the data manifold.
  arXiv  Detail & Related papers  (2022-06-15T08:49:24Z)
• A Robust Framework of Chromosome Straightening with ViT-Patch GAN [5.657051014432275]
  Chromosome straightening is an important step for subsequent karyotype construction, pathological diagnosis and cytogenetic map development. In this paper, we propose a novel architecture, ViT-Patch GAN, consisting of a self-learned motion transformation generator and a Vision Transformer-based patch (ViT-Patch) discriminator. The proposed method achieves better performance on Fr'eche't Inception Distance (FID), Learned Perceptual Image Patch Similarity (LPIPS) and downstream chromosome classification accuracy, and shows excellent generalization capability on a large dataset.
  arXiv  Detail & Related papers  (2022-03-06T07:58:36Z)
• Deep Anomaly Generation: An Image Translation Approach of Synthesizing Abnormal Banded Chromosome Images [0.0]
  We implement a conditional adversarial network that allows generation of realistic single chromosome images. An image-to-image translation approach based on self-generated 2D chromosome segmentation label maps is used. We believe that this approach can be exploited for data augmentation of chromosome data sets with structural abnormalities.
  arXiv  Detail & Related papers  (2021-09-20T17:16:23Z)
• A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image [3.7769813168959527]
  chromosome straightening plays a significant role in the pathological study of chromosomes and in the development of cytogenetic maps. We propose a novel framework based on image-to-image translation to learn a pertinent mapping dependence for synthesizing straightened chromosomes.
  arXiv  Detail & Related papers  (2021-03-04T05:05:41Z)
• Constrained Multi-shape Evolution for Overlapping Cytoplasm Segmentation [49.992392231966015]
  We present a novel and effective shape prior-based approach, called constrained multi-shape evolution. It segments all overlapping cytoplasms in the clump simultaneously by jointly evolving each cytoplasm's shape guided by the modeled shape priors. In the shape evolution, we compensate intensity deficiency for the segmentation by introducing not only the modeled local shape priors but also global shape priors.
  arXiv  Detail & Related papers  (2020-04-08T09:08:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.