CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss

• URL: http://arxiv.org/abs/2504.17813v1
• Date: Tue, 22 Apr 2025 22:23:30 GMT
• Title: CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss
• Authors: Dileepa Pitawela, Gustavo Carneiro, Hsiang-Ting Chen,
• Abstract summary: In ordinal classification, misclassifying neighboring ranks is common, yet the consequences of these errors are not the same.<n>We propose CLOC, a new margin-based contrastive learning method for ordinal classification.<n>CLOC learns an ordered representation based on the optimization of multiple margins with a novel multi-margin n-pair loss.
• Score: 8.202961373604719
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In ordinal classification, misclassifying neighboring ranks is common, yet the consequences of these errors are not the same. For example, misclassifying benign tumor categories is less consequential, compared to an error at the pre-cancerous to cancerous threshold, which could profoundly influence treatment choices. Despite this, existing ordinal classification methods do not account for the varying importance of these margins, treating all neighboring classes as equally significant. To address this limitation, we propose CLOC, a new margin-based contrastive learning method for ordinal classification that learns an ordered representation based on the optimization of multiple margins with a novel multi-margin n-pair loss (MMNP). CLOC enables flexible decision boundaries across key adjacent categories, facilitating smooth transitions between classes and reducing the risk of overfitting to biases present in the training data. We provide empirical discussion regarding the properties of MMNP and show experimental results on five real-world image datasets (Adience, Historical Colour Image Dating, Knee Osteoarthritis, Indian Diabetic Retinopathy Image, and Breast Carcinoma Subtyping) and one synthetic dataset simulating clinical decision bias. Our results demonstrate that CLOC outperforms existing ordinal classification methods and show the interpretability and controllability of CLOC in learning meaningful, ordered representations that align with clinical and practical needs.

Related papers

• DIOR-ViT: Differential Ordinal Learning Vision Transformer for Cancer Classification in Pathology Images [4.2832657904981435]
  We introduce a differential ordinal learning problem in which we define and learn the degree of difference in the categorical class labels between pairs of samples. We demonstrate that the adoption of differential ordinal learning can improve the accuracy and reliability of cancer grading. The proposed approach should be applicable to other diseases and problems as they involve ordinal relationship among class labels.
  arXiv  Detail & Related papers  (2024-07-10T12:42:27Z)
• Multi-task Explainable Skin Lesion Classification [54.76511683427566]
  We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data. The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
  arXiv  Detail & Related papers  (2023-10-11T05:49:47Z)
• Balanced Classification: A Unified Framework for Long-Tailed Object Detection [74.94216414011326]
  Conventional detectors suffer from performance degradation when dealing with long-tailed data due to a classification bias towards the majority head categories. We introduce a unified framework called BAlanced CLassification (BACL), which enables adaptive rectification of inequalities caused by disparities in category distribution. BACL consistently achieves performance improvements across various datasets with different backbones and architectures.
  arXiv  Detail & Related papers  (2023-08-04T09:11:07Z)
• SPLAL: Similarity-based pseudo-labeling with alignment loss for semi-supervised medical image classification [11.435826510575879]
  Semi-supervised learning (SSL) methods can mitigate challenges by leveraging both labeled and unlabeled data. SSL methods for medical image classification need to address two key challenges: (1) estimating reliable pseudo-labels for the images in the unlabeled dataset and (2) reducing biases caused by class imbalance. In this paper, we propose a novel SSL approach, SPLAL, that effectively addresses these challenges.
  arXiv  Detail & Related papers  (2023-07-10T14:53:24Z)
• Graph-Ensemble Learning Model for Multi-label Skin Lesion Classification using Dermoscopy and Clinical Images [7.159532626507458]
  This study introduces a Graph Convolution Network (GCN) to exploit prior co-occurrence between each category as a correlation matrix into the deep learning model for the multi-label classification. We propose a Graph-Ensemble Learning Model (GELN) that views the prediction from GCN as complementary information of the predictions from the fusion model.
  arXiv  Detail & Related papers  (2023-07-04T13:19:57Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection [81.07346419422605]
  Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. We propose a novel hierarchical semi-supervised contrastive learning framework, for contamination-resistant anomaly detection.
  arXiv  Detail & Related papers  (2022-07-24T18:49:26Z)
• HSADML: Hyper-Sphere Angular Deep Metric based Learning for Brain Tumor Classification [3.319978067919918]
  HSADML is a novel framework which enables deep metric learning (DML) using SphereFace Loss. State-of-the-art 98.69% validation accu-racy using k-NN (k=1)
  arXiv  Detail & Related papers  (2022-01-28T17:37:15Z)
• Cross-Site Severity Assessment of COVID-19 from CT Images via Domain Adaptation [64.59521853145368]
  Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event. To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites. This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
  arXiv  Detail & Related papers  (2021-09-08T07:56:51Z)
• Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions [18.351120611713586]
  We develop and rigorously evaluate a deep learning based system that can accurately classify skin conditions. We frame this task as an out-of-distribution (OOD) detection problem. Our novel approach, hierarchical outlier detection (HOD) assigns multiple abstention classes for each training class and jointly performs a coarse classification of inliers vs. outliers.
  arXiv  Detail & Related papers  (2021-04-08T15:15:22Z)
• Classification with Rejection Based on Cost-sensitive Classification [83.50402803131412]
  We propose a novel method of classification with rejection by ensemble of learning. Experimental results demonstrate the usefulness of our proposed approach in clean, noisy, and positive-unlabeled classification.
  arXiv  Detail & Related papers  (2020-10-22T14:05:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.