Towards Novel Class Discovery: A Study in Novel Skin Lesions Clustering
- URL: http://arxiv.org/abs/2309.16451v1
- Date: Thu, 28 Sep 2023 13:59:29 GMT
- Title: Towards Novel Class Discovery: A Study in Novel Skin Lesions Clustering
- Authors: Wei Feng, Lie Ju, Lin Wang, Kaimin Song, Zongyuan Ge
- Abstract summary: We propose a new novel class discovery framework for automatically discovering new semantic classes from dermoscopy image datasets.
Specifically, we first use contrastive learning to learn a robust and unbiased feature representation based on all data from known and unknown categories.
We conducted extensive experiments on the dermatology dataset ISIC 2019, and the experimental results show that our approach can effectively leverage knowledge from known categories to discover new semantic categories.
- Score: 22.24175320515204
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Existing deep learning models have achieved promising performance in
recognizing skin diseases from dermoscopic images. However, these models can
only recognize samples from predefined categories, when they are deployed in
the clinic, data from new unknown categories are constantly emerging.
Therefore, it is crucial to automatically discover and identify new semantic
categories from new data. In this paper, we propose a new novel class discovery
framework for automatically discovering new semantic classes from dermoscopy
image datasets based on the knowledge of known classes. Specifically, we first
use contrastive learning to learn a robust and unbiased feature representation
based on all data from known and unknown categories. We then propose an
uncertainty-aware multi-view cross pseudo-supervision strategy, which is
trained jointly on all categories of data using pseudo labels generated by a
self-labeling strategy. Finally, we further refine the pseudo label by
aggregating neighborhood information through local sample similarity to improve
the clustering performance of the model for unknown categories. We conducted
extensive experiments on the dermatology dataset ISIC 2019, and the
experimental results show that our approach can effectively leverage knowledge
from known categories to discover new semantic categories. We also further
validated the effectiveness of the different modules through extensive ablation
experiments. Our code will be released soon.
Related papers
- Contextuality Helps Representation Learning for Generalized Category Discovery [5.885208652383516]
This paper introduces a novel approach to Generalized Category Discovery (GCD) by leveraging the concept of contextuality.
Our model integrates two levels of contextuality: instance-level, where nearest-neighbor contexts are utilized for contrastive learning, and cluster-level, employing contrastive learning.
The integration of the contextual information effectively improves the feature learning and thereby the classification accuracy of all categories.
arXiv Detail & Related papers (2024-07-29T07:30:41Z) - UniCell: Universal Cell Nucleus Classification via Prompt Learning [76.11864242047074]
We propose a universal cell nucleus classification framework (UniCell)
It employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains.
In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets.
arXiv Detail & Related papers (2024-02-20T11:50:27Z) - Dynamic Conceptional Contrastive Learning for Generalized Category
Discovery [76.82327473338734]
Generalized category discovery (GCD) aims to automatically cluster partially labeled data.
Unlabeled data contain instances that are not only from known categories of the labeled data but also from novel categories.
One effective way for GCD is applying self-supervised learning to learn discriminate representation for unlabeled data.
We propose a Dynamic Conceptional Contrastive Learning framework, which can effectively improve clustering accuracy.
arXiv Detail & Related papers (2023-03-30T14:04:39Z) - XCon: Learning with Experts for Fine-grained Category Discovery [4.787507865427207]
We present a novel method called Expert-Contrastive Learning (XCon) to help the model to mine useful information from the images.
Experiments on fine-grained datasets show a clear improved performance over the previous best methods, indicating the effectiveness of our method.
arXiv Detail & Related papers (2022-08-03T08:03:12Z) - Novel Class Discovery without Forgetting [72.52222295216062]
We identify and formulate a new, pragmatic problem setting of NCDwF: Novel Class Discovery without Forgetting.
We propose a machine learning model to incrementally discover novel categories of instances from unlabeled data.
We introduce experimental protocols based on CIFAR-10, CIFAR-100 and ImageNet-1000 to measure the trade-off between knowledge retention and novel class discovery.
arXiv Detail & Related papers (2022-07-21T17:54:36Z) - Class-incremental Novel Class Discovery [76.35226130521758]
We study the new task of class-incremental Novel Class Discovery (class-iNCD)
We propose a novel approach for class-iNCD which prevents forgetting of past information about the base classes.
Our experiments, conducted on three common benchmarks, demonstrate that our method significantly outperforms state-of-the-art approaches.
arXiv Detail & Related papers (2022-07-18T13:49:27Z) - LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection.
Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch.
Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
arXiv Detail & Related papers (2022-04-12T12:25:05Z) - Novel Class Discovery in Semantic Segmentation [104.30729847367104]
We introduce a new setting of Novel Class Discovery in Semantic (NCDSS)
It aims at segmenting unlabeled images containing new classes given prior knowledge from a labeled set of disjoint classes.
In NCDSS, we need to distinguish the objects and background, and to handle the existence of multiple classes within an image.
We propose the Entropy-based Uncertainty Modeling and Self-training (EUMS) framework to overcome noisy pseudo-labels.
arXiv Detail & Related papers (2021-12-03T13:31:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.