Automated dermatoscopic pattern discovery by clustering neural network
output for human-computer interaction
- URL: http://arxiv.org/abs/2309.08533v1
- Date: Fri, 15 Sep 2023 16:50:47 GMT
- Title: Automated dermatoscopic pattern discovery by clustering neural network
output for human-computer interaction
- Authors: Lidia Talavera-Martinez, Philipp Tschandl
- Abstract summary: The objective of this study was to create an automated clustering resulting in human-interpretable pattern discovery.
Images from the public HAM10000 dataset, including 7 common pigmented skin lesion diagnoses, were tiled into 29420 tiles and clustered via k-means.
- Score: 0.39462888523270856
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Background: As available medical image datasets increase in size, it becomes
infeasible for clinicians to review content manually for knowledge extraction.
The objective of this study was to create an automated clustering resulting in
human-interpretable pattern discovery.
Methods: Images from the public HAM10000 dataset, including 7 common
pigmented skin lesion diagnoses, were tiled into 29420 tiles and clustered via
k-means using neural network-extracted image features. The final number of
clusters per diagnosis was chosen by either the elbow method or a compactness
metric balancing intra-lesion variance and cluster numbers. The amount of
resulting non-informative clusters, defined as those containing less than six
image tiles, was compared between the two methods.
Results: Applying k-means, the optimal elbow cutoff resulted in a mean of
24.7 (95%-CI: 16.4-33) clusters for every included diagnosis, including 14.9%
(95% CI: 0.8-29.0) non-informative clusters. The optimal cutoff, as estimated
by the compactness metric, resulted in significantly fewer clusters (13.4;
95%-CI 11.8-15.1; p=0.03) and less non-informative ones (7.5%; 95% CI: 0-19.5;
p=0.017). The majority of clusters (93.6%) from the compactness metric could be
manually mapped to previously described dermatoscopic diagnostic patterns.
Conclusions: Automatically constraining unsupervised clustering can produce
an automated extraction of diagnostically relevant and human-interpretable
clusters of visual patterns from a large image dataset.
Related papers
- TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images [62.53931644063323]
In this study we extended the capabilities of TotalSegmentator to MR images.
We trained an nnU-Net segmentation algorithm on this dataset and calculated similarity coefficients (Dice) to evaluate the model's performance.
The model significantly outperformed two other publicly available segmentation models (Dice score 0.824 versus 0.762; p0.001 and 0.762 versus 0.542; p)
arXiv Detail & Related papers (2024-05-29T20:15:54Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - Anomaly Clustering: Grouping Images into Coherent Clusters of Anomaly
Types [60.45942774425782]
We introduce anomaly clustering, whose goal is to group data into coherent clusters of anomaly types.
This is different from anomaly detection, whose goal is to divide anomalies from normal data.
We present a simple yet effective clustering framework using a patch-based pretrained deep embeddings and off-the-shelf clustering methods.
arXiv Detail & Related papers (2021-12-21T23:11:33Z) - DeepMCAT: Large-Scale Deep Clustering for Medical Image Categorization [24.100651548850895]
We propose an unsupervised approach for automatically clustering and categorizing large-scale medical image datasets.
We investigated the end-to-end training using both class-balanced and imbalanced large-scale datasets.
arXiv Detail & Related papers (2021-09-30T22:39:57Z) - Multiclass Anomaly Detection in GI Endoscopic Images using Optimized
Deep One-class Classification in an Imbalanced Dataset [0.0]
Wireless Capsule Endoscopy helps physicians examine the gastrointestinal (GI) tract noninvasively.
Many available datasets, such as KID2 and Kvasir, suffer from imbalance issue which make it difficult to train an effective artificial intelligence (AI) system.
In this study, an ensemble of one-class classifiers is used for detecting anomaly.
arXiv Detail & Related papers (2021-03-15T16:28:42Z) - Chest x-ray automated triage: a semiologic approach designed for
clinical implementation, exploiting different types of labels through a
combination of four Deep Learning architectures [83.48996461770017]
This work presents a Deep Learning method based on the late fusion of different convolutional architectures.
We built four training datasets combining images from public chest x-ray datasets and our institutional archive.
We trained four different Deep Learning architectures and combined their outputs with a late fusion strategy, obtaining a unified tool.
arXiv Detail & Related papers (2020-12-23T14:38:35Z) - Scalable Hierarchical Agglomerative Clustering [65.66407726145619]
Existing scalable hierarchical clustering methods sacrifice quality for speed.
We present a scalable, agglomerative method for hierarchical clustering that does not sacrifice quality and scales to billions of data points.
arXiv Detail & Related papers (2020-10-22T15:58:35Z) - Too Much Information Kills Information: A Clustering Perspective [6.375668163098171]
We propose a simple, but novel approach for variance-based k-clustering tasks, including in which is the widely known k-means clustering.
The proposed approach picks a sampling subset from the given dataset and makes decisions based on the data information in the subset only.
With certain assumptions, the resulting clustering is provably good to estimate the optimum of the variance-based objective with high probability.
arXiv Detail & Related papers (2020-09-16T01:54:26Z) - Y-net: Biomedical Image Segmentation and Clustering [0.0]
We propose a deep clustering architecture alongside image segmentation for medical image analysis.
Deep clustering using Kmeans clustering is performed at the clustering branch and a lightweight model is used for segmentation.
The proposed architecture can provide an early diagnosis and reduce human intervention on labeling as it can become quite costly as the datasets grow larger.
arXiv Detail & Related papers (2020-04-12T21:08:31Z) - Statistical power for cluster analysis [0.0]
Cluster algorithms are increasingly popular in biomedical research.
We estimate power and accuracy for common analysis through simulation.
We recommend that researchers only apply cluster analysis when large subgroup separation is expected.
arXiv Detail & Related papers (2020-03-01T02:43:15Z) - Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale
Chest Computed Tomography Volumes [64.21642241351857]
We curated and analyzed a chest computed tomography (CT) data set of 36,316 volumes from 19,993 unique patients.
We developed a rule-based method for automatically extracting abnormality labels from free-text radiology reports.
We also developed a model for multi-organ, multi-disease classification of chest CT volumes.
arXiv Detail & Related papers (2020-02-12T00:59:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.