Masked conditional variational autoencoders for chromosome straightening

• URL: http://arxiv.org/abs/2306.14129v1
• Date: Sun, 25 Jun 2023 05:11:41 GMT
• Title: Masked conditional variational autoencoders for chromosome straightening
• Authors: Jingxiong Li, Sunyi Zheng, Zhongyi Shui, Shichuan Zhang, Linyi Yang, Yuxuan Sun, Yunlong Zhang, Honglin Li, Yuanxin Ye, Peter M.A. van Ooijen, Kang Li, Lin Yang
• Abstract summary: Karyotyping is of importance for detecting chromosomal aberrations in human disease. chromosomes easily appear curved in microscopic images, which prevents cytogeneticists from analyzing chromosome types. We propose a framework for chromosome straightening, which comprises a preliminary processing algorithm and a generative model.
• Score: 14.665481276886194
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Karyotyping is of importance for detecting chromosomal aberrations in human disease. However, chromosomes easily appear curved in microscopic images, which prevents cytogeneticists from analyzing chromosome types. To address this issue, we propose a framework for chromosome straightening, which comprises a preliminary processing algorithm and a generative model called masked conditional variational autoencoders (MC-VAE). The processing method utilizes patch rearrangement to address the difficulty in erasing low degrees of curvature, providing reasonable preliminary results for the MC-VAE. The MC-VAE further straightens the results by leveraging chromosome patches conditioned on their curvatures to learn the mapping between banding patterns and conditions. During model training, we apply a masking strategy with a high masking ratio to train the MC-VAE with eliminated redundancy. This yields a non-trivial reconstruction task, allowing the model to effectively preserve chromosome banding patterns and structure details in the reconstructed results. Extensive experiments on three public datasets with two stain styles show that our framework surpasses the performance of state-of-the-art methods in retaining banding patterns and structure details. Compared to using real-world bent chromosomes, the use of high-quality straightened chromosomes generated by our proposed method can improve the performance of various deep learning models for chromosome classification by a large margin. Such a straightening approach has the potential to be combined with other karyotyping systems to assist cytogeneticists in chromosome analysis.

Related papers

• Supervised Contrastive Learning for Fine-grained Chromosome Recognition [7.427070103487921]
  Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. Existing classification methods face significant challenges due to the inter-class similarity and intra-class variation of chromosomes. We propose a supervised contrastive learning strategy that is tailored to train model-agnostic deep networks for reliable chromosome classification.
  arXiv  Detail & Related papers  (2023-12-12T06:12:21Z)
• Optimizations of Autoencoders for Analysis and Classification of Microscopic In Situ Hybridization Images [68.8204255655161]
  We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression. The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
  arXiv  Detail & Related papers  (2023-04-19T13:45:28Z)
• Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Grading [72.45699658852304]
  This paper proposes a novel approach to train a generative Diffusion Autoencoder model as an unsupervised feature extractor. We model fracture grading as a continuous regression, which is more reflective of the smooth progression of fractures. Importantly, the generative nature of our method allows us to visualize different grades of a given vertebra, providing interpretability and insight into the features that contribute to automated grading.
  arXiv  Detail & Related papers  (2023-03-21T17:16:01Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• Improving Deep Facial Phenotyping for Ultra-rare Disorder Verification Using Model Ensembles [52.77024349608834]
  We analyze the influence of replacing a DCNN with a state-of-the-art face recognition approach, iResNet with ArcFace. Our proposed ensemble model achieves state-of-the-art performance on both seen and unseen disorders.
  arXiv  Detail & Related papers  (2022-11-12T23:28:54Z)
• ChrSNet: Chromosome Straightening using Self-attention Guided Networks [7.335018936053776]
  We present a self-attention guided framework to erase the curvature of chromosomes. The proposed framework extracts spatial information and local textures to preserve banding patterns. We propose two dedicated geometric constraints to maintain the length and restore the distortion of chromosomes.
  arXiv  Detail & Related papers  (2022-07-01T02:19:49Z)
• A Robust Framework of Chromosome Straightening with ViT-Patch GAN [5.657051014432275]
  Chromosome straightening is an important step for subsequent karyotype construction, pathological diagnosis and cytogenetic map development. In this paper, we propose a novel architecture, ViT-Patch GAN, consisting of a self-learned motion transformation generator and a Vision Transformer-based patch (ViT-Patch) discriminator. The proposed method achieves better performance on Fr'eche't Inception Distance (FID), Learned Perceptual Image Patch Similarity (LPIPS) and downstream chromosome classification accuracy, and shows excellent generalization capability on a large dataset.
  arXiv  Detail & Related papers  (2022-03-06T07:58:36Z)
• A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image [3.7769813168959527]
  chromosome straightening plays a significant role in the pathological study of chromosomes and in the development of cytogenetic maps. We propose a novel framework based on image-to-image translation to learn a pertinent mapping dependence for synthesizing straightened chromosomes.
  arXiv  Detail & Related papers  (2021-03-04T05:05:41Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Adversarial Multiscale Feature Learning for Overlapping Chromosome Segmentation [6.180155406275231]
  Chromosome karyotype analysis is of great clinical importance in the diagnosis and treatment of diseases. Due to the strip shape of the chromosomes, they easily get overlapped with each other when imaged. We present an adversarial multiscale feature learning framework to improve the accuracy and adaptability of overlapping chromosome segmentation.
  arXiv  Detail & Related papers  (2020-12-22T06:04:22Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.