Reliability-Aware Ensemble Classification Under Class Imbalance: A Calibration Study on Liquid-Based Cervical Cytology

• URL: http://arxiv.org/abs/2607.09837v1
• Date: Fri, 10 Jul 2026 16:41:18 GMT
• Title: Reliability-Aware Ensemble Classification Under Class Imbalance: A Calibration Study on Liquid-Based Cervical Cytology
• Abstract summary: This paper presents a class-imbalance-aware and calibration-aware ensemble classification study on the Mendeley LBC dataset.<n>Three lightweight architectures are trained directly on Mendeley LBC using weighted random sampling to counteract class imbalance.<n>Results suggest that, for this dataset, calibration is the dominant lever for reliability, not ensemble size.
• Score: 3.093890460224435
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cervical cytology classification models are typically evaluated on curated, class-balanced benchmarks, but real-world liquid-based cytology (LBC) collections are often small and class-imbalanced. This paper presents a class-imbalance-aware and calibration-aware ensemble classification study on the Mendeley LBC dataset, using its native four-class Bethesda taxonomy (NILM, LSIL, HSIL, SCC) rather than a collapsed binary formulation. Three lightweight architectures (Swin-Tiny, TinyViT-5M, DenseNet121) are trained directly on Mendeley LBC using weighted random sampling to counteract class imbalance, and compared against two soft-voting ensembles (Hybrid-2, Hybrid-3). Post-hoc temperature scaling is fit on a held-out calibration subset carved out of the training portion of each cross-validation fold, distinct from both the training data used to fit model weights and the evaluation fold used for final metrics, avoiding the optimistic calibration estimates that result when the same data is used for both purposes. Calibration substantially reduces expected calibration error, Brier score, and negative log-likelihood for every model and ensemble configuration tested, while discrimination metrics (accuracy, macro-F1, macro-AUROC) remain essentially unchanged. Ensemble size shows no consistent additional reliability benefit over the best individual model once all configurations are properly calibrated. Confusion matrices show that all classification errors, across every configuration, are confined to the boundary between high-grade lesions (HSIL) and carcinoma (SCC); no errors involve the negative (NILM) or low-grade (LSIL) categories. These results suggest that, for this dataset, calibration is the dominant lever for reliability, not ensemble size, though this conclusion should be read in light of the dataset's modest size.

Related papers

• Reliability-Aware Hybrid-K Ensemble Selection for Cervical Cytology Classification: Integrating Discrimination, Calibration, and Selective Prediction [3.093890460224435]
  This study proposes a reliability-aware Hybrid-K ensemble selection framework for multiclass cervical classification.<n>Nine deep learning architectures were evaluated using a fixed stratified five-fold partition and three training seeds.<n>The final Hybrid-2 ensemble, comprising Swin-Tiny and TinyViT-5M, reduced AURC by 43%, NLL by 17%, and WC-ECE by 36% relative to the best individual model.
  arXiv  Detail & Related papers  (2026-09-01T02:30:41Z)
• Equilibrium contrastive learning for imbalanced image classification [5.198140836737882]
  Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset.<n>Recently, several supervised CL methods have been proposed to promote an ideal regular simplex geometric configuration.<n>We propose Equilibrium Contrastive Learning (ECL), a supervised CL framework designed to promote geometric equilibrium.
  arXiv  Detail & Related papers  (2026-02-10T08:07:56Z)
• Classifier Calibration at Scale: An Empirical Study of Model-Agnostic Post-Hoc Methods [0.0]
  We study model-agnostic post-hoc calibration methods to improve probabilistic predictions in supervised binary classification.<n>We benchmark 21 widely used classifiers, including linear models, SVMs, tree ensembles (CatBoost, XGBoost, LightGBM)<n>We find that commonly used calibration procedures, most notably Platt scaling and isotonic regression, can systematically degrade proper scoring performance.
  arXiv  Detail & Related papers  (2026-01-19T18:23:36Z)
• Calibratable Disambiguation Loss for Multi-Instance Partial-Label Learning [53.9713678229744]
  Multi-instance partial-label learning (MIPL) is a weakly supervised framework that addresses the challenges of inexact supervision in both instance and label spaces.<n>Existing MIPL approaches often suffer from poor calibration, undermining reliability.<n>We propose a plug-and-play calibratable disambiguation loss (CDL) that simultaneously improves classification accuracy and calibration performance.
  arXiv  Detail & Related papers  (2025-12-19T16:58:31Z)
• CalibrateMix: Guided-Mixup Calibration of Image Semi-Supervised Models [49.588973929678765]
  CalibrateMix is a mixup-based approach that aims to improve the calibration of SSL models.<n>Our method achieves lower expected calibration error (ECE) and superior accuracy compared to existing SSL approaches.
  arXiv  Detail & Related papers  (2025-11-17T04:43:53Z)
• Uncertainty Calibration of Multi-Label Bird Sound Classifiers [2.3510007132962203]
  In bioacoustics, calibration is challenged by overlapping vocalisations, long-tailed species distributions, and distribution shifts between training and deployment data.<n>We benchmark the calibration of four state-of-the-art multi-label bird sound classifiers on the BirdSet benchmark, evaluating both global, per-dataset and per-class calibration.
  arXiv  Detail & Related papers  (2025-11-11T13:54:59Z)
• Beyond One-Hot Labels: Semantic Mixing for Model Calibration [22.39558434131574]
  We present textbfCalibration-aware Semantic Mixing (CSM), a novel framework that generates training samples with mixed class characteristics.<n>We show that CSM achieves superior calibration compared to the state-of-the-art calibration approaches.
  arXiv  Detail & Related papers  (2025-04-18T08:26:18Z)
• Classifier Calibration with ROC-Regularized Isotonic Regression [0.0]
  We use isotonic regression to minimize the cross entropy on a calibration set via monotone transformations. IR acts as an adaptive binning procedure, which allows achieving a calibration error of zero, but leaves open the issue of the effect on performance. We show empirically that this general monotony criterion is effective in striking a balance between reducing cross entropy loss and avoiding overfitting of the calibration set.
  arXiv  Detail & Related papers  (2023-11-21T08:45:09Z)
• Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labels [53.68653940062605]
  We introduce a novel task, Partial labeling and Long-Tailed Multi-Label Classification (PLT-MLC) We find that most LT-MLC and PL-MLC approaches fail to solve the degradation-MLC. We propose an end-to-end learning framework: textbfCOrrection $rightarrow$ textbfModificattextbfIon $rightarrow$ balantextbfCe.
  arXiv  Detail & Related papers  (2023-04-20T20:05:08Z)
• Enabling Calibration In The Zero-Shot Inference of Large Vision-Language Models [58.720142291102135]
  We measure calibration across relevant variables like prompt, dataset, and architecture, and find that zero-shot inference with CLIP is miscalibrated. A single learned temperature generalizes for each specific CLIP model across inference dataset and prompt choice.
  arXiv  Detail & Related papers  (2023-03-11T17:14:04Z)
• Prototypical Calibration for Few-shot Learning of Language Models [84.5759596754605]
  GPT-like models have been recognized as fragile across different hand-crafted templates, and demonstration permutations. We propose prototypical calibration to adaptively learn a more robust decision boundary for zero- and few-shot classification. Our method calibrates the decision boundary as expected, greatly improving the robustness of GPT to templates, permutations, and class imbalance.
  arXiv  Detail & Related papers  (2022-05-20T13:50:07Z)
• Localized Calibration: Metrics and Recalibration [133.07044916594361]
  We propose a fine-grained calibration metric that spans the gap between fully global and fully individualized calibration. We then introduce a localized recalibration method, LoRe, that improves the LCE better than existing recalibration methods.
  arXiv  Detail & Related papers  (2021-02-22T07:22:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.