A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image

• URL: http://arxiv.org/abs/2103.02835v1
• Date: Thu, 4 Mar 2021 05:05:41 GMT
• Title: A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image
• Authors: Sifan Song, Daiyun Huang, Yalun Hu, Chunxiao Yang, Jia Meng, Fei Ma, Jiaming Zhang, Jionglong Su
• Abstract summary: chromosome straightening plays a significant role in the pathological study of chromosomes and in the development of cytogenetic maps. We propose a novel framework based on image-to-image translation to learn a pertinent mapping dependence for synthesizing straightened chromosomes.
• Score: 3.7769813168959527
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In medical imaging, chromosome straightening plays a significant role in the pathological study of chromosomes and in the development of cytogenetic maps. Whereas different approaches exist for the straightening task, they are mostly geometric algorithms whose outputs are characterized by jagged edges or fragments with discontinued banding patterns. To address the flaws in the geometric algorithms, we propose a novel framework based on image-to-image translation to learn a pertinent mapping dependence for synthesizing straightened chromosomes with uninterrupted banding patterns and preserved details. In addition, to avoid the pitfall of deficient input chromosomes, we construct an augmented dataset using only one single curved chromosome image for training models. Based on this framework, we apply two popular image-to-image translation architectures, U-shape networks and conditional generative adversarial networks, to assess its efficacy. Experiments on a dataset comprising of 642 real-world chromosomes demonstrate the superiority of our framework as compared to the geometric method in straightening performance by rendering realistic and continued chromosome details. Furthermore, our straightened results improve the chromosome classification, achieving 0.98%-1.39% in mean accuracy.

Related papers

• Masked conditional variational autoencoders for chromosome straightening [14.665481276886194]
  Karyotyping is of importance for detecting chromosomal aberrations in human disease. chromosomes easily appear curved in microscopic images, which prevents cytogeneticists from analyzing chromosome types. We propose a framework for chromosome straightening, which comprises a preliminary processing algorithm and a generative model.
  arXiv  Detail & Related papers  (2023-06-25T05:11:41Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Chromosome Segmentation Analysis Using Image Processing Techniques and Autoencoders [0.0]
  Chromosome analysis and identification from metaphase images is a critical part of cytogenetics based medical diagnosis. Process of identification of chromosomes from metaphase is a tedious one and requires trained personnel and several hours to perform. We propose a method to automate the process of detection and segmentation of chromosomes from a given metaphase image.
  arXiv  Detail & Related papers  (2022-09-12T17:06:42Z)
• ChrSNet: Chromosome Straightening using Self-attention Guided Networks [7.335018936053776]
  We present a self-attention guided framework to erase the curvature of chromosomes. The proposed framework extracts spatial information and local textures to preserve banding patterns. We propose two dedicated geometric constraints to maintain the length and restore the distortion of chromosomes.
  arXiv  Detail & Related papers  (2022-07-01T02:19:49Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Deep Anomaly Generation: An Image Translation Approach of Synthesizing Abnormal Banded Chromosome Images [0.0]
  We implement a conditional adversarial network that allows generation of realistic single chromosome images. An image-to-image translation approach based on self-generated 2D chromosome segmentation label maps is used. We believe that this approach can be exploited for data augmentation of chromosome data sets with structural abnormalities.
  arXiv  Detail & Related papers  (2021-09-20T17:16:23Z)
• Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization [112.68171734288237]
  We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels. We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images. We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
  arXiv  Detail & Related papers  (2021-04-12T21:41:25Z)
• Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
  We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images. We first apply an image encoder to classify the chest X-rays and to generate the image features. The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
  arXiv  Detail & Related papers  (2021-04-11T09:16:29Z)
• Cascaded Robust Learning at Imperfect Labels for Chest X-ray Segmentation [61.09321488002978]
  We present a novel cascaded robust learning framework for chest X-ray segmentation with imperfect annotation. Our model consists of three independent network, which can effectively learn useful information from the peer networks. Our methods could achieve a significant improvement on the accuracy in segmentation tasks compared to the previous methods.
  arXiv  Detail & Related papers  (2021-04-05T15:50:16Z)
• Adversarial Multiscale Feature Learning for Overlapping Chromosome Segmentation [6.180155406275231]
  Chromosome karyotype analysis is of great clinical importance in the diagnosis and treatment of diseases. Due to the strip shape of the chromosomes, they easily get overlapped with each other when imaged. We present an adversarial multiscale feature learning framework to improve the accuracy and adaptability of overlapping chromosome segmentation.
  arXiv  Detail & Related papers  (2020-12-22T06:04:22Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.