Dermoscopic Image Classification with Neural Style Transfer

• URL: http://arxiv.org/abs/2105.07592v1
• Date: Mon, 17 May 2021 03:50:51 GMT
• Title: Dermoscopic Image Classification with Neural Style Transfer
• Authors: Yutong Li, Ruoqing Zhu, Annie Qu and Mike Yeh
• Abstract summary: We propose an adaptation of the Neural Style Transfer (NST) as a novel image pre-processing step for skin lesion classification problems. We represent each dermoscopic image as the style image and transfer the style of the lesion onto a homogeneous content image. This transfers the main variability of each lesion onto the same localized region, which allows us to integrate the generated images together and extract latent, low-rank style features.
• Score: 5.314466196448187
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Skin cancer, the most commonly found human malignancy, is primarily diagnosed visually via dermoscopic analysis, biopsy, and histopathological examination. However, unlike other types of cancer, automated image classification of skin lesions is deemed more challenging due to the irregularity and variability in the lesions' appearances. In this work, we propose an adaptation of the Neural Style Transfer (NST) as a novel image pre-processing step for skin lesion classification problems. We represent each dermoscopic image as the style image and transfer the style of the lesion onto a homogeneous content image. This transfers the main variability of each lesion onto the same localized region, which allows us to integrate the generated images together and extract latent, low-rank style features via tensor decomposition. We train and cross-validate our model on a dermoscopic data set collected and preprocessed from the International Skin Imaging Collaboration (ISIC) database. We show that the classification performance based on the extracted tensor features using the style-transferred images significantly outperforms that of the raw images by more than 10%, and is also competitive with well-studied, pre-trained CNN models through transfer learning. Additionally, the tensor decomposition further identifies latent style clusters, which may provide clinical interpretation and insights.

Related papers

• Deep Learning Method to Predict Wound Healing Progress Based on Collagen Fibers in Wound Tissue [5.91170345684227]
  We propose an innovative approach based on deep learning to predict the progression of wound healing. Our model achieves 82% accuracy in classifying six stages of wound healing. To the best of our knowledge, our proposed model is the first deep learning-based classification model used for predicting wound healing stages.
  arXiv  Detail & Related papers  (2024-05-08T13:33:32Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• LesionAid: Vision Transformers-based Skin Lesion Generation and Classification [0.0]
  This research proposes a novel multi-class prediction framework that classifies skin lesions based on ViT and ViTGAN. The framework consists of four main phases: ViTGANs, Image processing, and explainable AI.
  arXiv  Detail & Related papers  (2023-02-02T13:52:54Z)
• GraVIS: Grouping Augmented Views from Independent Sources for Dermatology Analysis [52.04899592688968]
  We propose GraVIS, which is specifically optimized for learning self-supervised features from dermatology images. GraVIS significantly outperforms its transfer learning and self-supervised learning counterparts in both lesion segmentation and disease classification tasks.
  arXiv  Detail & Related papers  (2023-01-11T11:38:37Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• Classification of Skin Cancer Images using Convolutional Neural Networks [0.0]
  Skin cancer is the most common human malignancy. Deep neural networks show humongous potential for image classification. Highest model accuracy achieved was over 86.65%.
  arXiv  Detail & Related papers  (2022-02-01T17:11:41Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)
• Analysis of skin lesion images with deep learning [0.0]
  We evaluate the current state of the art in the classification of dermoscopic images. Various deep neural network architectures pre-trained on the ImageNet data set are adapted to a combined training data set. The performance and applicability of these models for the detection of eight classes of skin lesions are examined.
  arXiv  Detail & Related papers  (2021-01-11T10:58:36Z)
• Multi-label Thoracic Disease Image Classification with Cross-Attention Networks [65.37531731899837]
  We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images. We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
  arXiv  Detail & Related papers  (2020-07-21T14:37:00Z)
• Co-Heterogeneous and Adaptive Segmentation from Multi-Source and Multi-Phase CT Imaging Data: A Study on Pathological Liver and Lesion Segmentation [48.504790189796836]
  We present a novel segmentation strategy, co-heterogenous and adaptive segmentation (CHASe) We propose a versatile framework that fuses appearance based semi-supervision, mask based adversarial domain adaptation, and pseudo-labeling. CHASe can further improve pathological liver mask Dice-Sorensen coefficients by ranges of $4.2% sim 9.4%$.
  arXiv  Detail & Related papers  (2020-05-27T06:58:39Z)
• Melanoma Detection using Adversarial Training and Deep Transfer Learning [6.22964000148682]
  We propose a two-stage framework for automatic classification of skin lesion images. In the first stage, we leverage the inter-class variation of the data distribution for the task of conditional image synthesis. In the second stage, we train a deep convolutional neural network for skin lesion classification.
  arXiv  Detail & Related papers  (2020-04-14T22:46:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.