FedIIC: Towards Robust Federated Learning for Class-Imbalanced Medical Image Classification

• URL: http://arxiv.org/abs/2206.13803v3
• Date: Wed, 26 Jul 2023 01:46:05 GMT
• Title: FedIIC: Towards Robust Federated Learning for Class-Imbalanced Medical Image Classification
• Authors: Nannan Wu, Li Yu, Xin Yang, Kwang-Ting Cheng, and Zengqiang Yan
• Abstract summary: We present a privacy-preserving Federated Learning (FL) method named FedIIC to combat class imbalance from two perspectives. In feature learning, two levels of contrastive learning are designed to extract better class-specific features with imbalanced data in FL. In classifier learning, per-class margins are dynamically set according to real-time difficulty and class priors, which helps the model learn classes equally.
• Score: 29.69137726688905
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Federated learning (FL), training deep models from decentralized data without privacy leakage, has shown great potential in medical image computing recently. However, considering the ubiquitous class imbalance in medical data, FL can exhibit performance degradation, especially for minority classes (e.g. rare diseases). Existing methods towards this problem mainly focus on training a balanced classifier to eliminate class prior bias among classes, but neglect to explore better representation to facilitate classification performance. In this paper, we present a privacy-preserving FL method named FedIIC to combat class imbalance from two perspectives: feature learning and classifier learning. In feature learning, two levels of contrastive learning are designed to extract better class-specific features with imbalanced data in FL. In classifier learning, per-class margins are dynamically set according to real-time difficulty and class priors, which helps the model learn classes equally. Experimental results on publicly-available datasets demonstrate the superior performance of FedIIC in dealing with both real-world and simulated multi-source medical imaging data under class imbalance. Code is available at https://github.com/wnn2000/FedIIC.

Related papers

• Addressing Imbalance for Class Incremental Learning in Medical Image Classification [14.242875524728495]
  We introduce two plug-in methods to mitigate the adverse effects of imbalance. First, we propose a CIL-balanced classification loss to mitigate the classification bias toward majority classes. Second, we propose a distribution margin loss that not only alleviates the inter-class overlap in embedding space but also enforces the intra-class compactness.
  arXiv  Detail & Related papers  (2024-07-18T17:59:44Z)
• Iterative Online Image Synthesis via Diffusion Model for Imbalanced Classification [29.730360798234294]
  We introduce an Iterative Online Image Synthesis framework to address the class imbalance problem in medical image classification. Our framework incorporates two key modules, namely Online Image Synthesis (OIS) and Accuracy Adaptive Sampling (AAS) To evaluate the effectiveness of our proposed method in addressing imbalanced classification, we conduct experiments on the HAM10000 and APTOS datasets.
  arXiv  Detail & Related papers  (2024-03-13T10:51:18Z)
• Bias Mitigating Few-Shot Class-Incremental Learning [17.185744533050116]
  Few-shot class-incremental learning aims at recognizing novel classes continually with limited novel class samples. Recent methods somewhat alleviate the accuracy imbalance between base and incremental classes by fine-tuning the feature extractor in the incremental sessions. We propose a novel method to mitigate model bias of the FSCIL problem during training and inference processes.
  arXiv  Detail & Related papers  (2024-02-01T10:37:41Z)
• Dual Compensation Residual Networks for Class Imbalanced Learning [98.35401757647749]
  We propose Dual Compensation Residual Networks to better fit both tail and head classes. An important factor causing overfitting is that there is severe feature drift between training and test data on tail classes. We also propose a Residual Balanced Multi-Proxies classifier to alleviate the under-fitting issue.
  arXiv  Detail & Related papers  (2023-08-25T04:06:30Z)
• No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Synthetic and Fixed Classifier [10.491645205483051]
  We propose a solution to the FL's classifier bias problem by utilizing a synthetic and fixed ETF classifier during training. We devise several effective modules to better adapt the ETF structure in FL, achieving both high generalization and personalization. Our method achieves state-of-the-art performances on CIFAR-10, CIFAR-100, and Tiny-ImageNet.
  arXiv  Detail & Related papers  (2023-03-17T15:38:39Z)
• Density-Aware Personalized Training for Risk Prediction in Imbalanced Medical Data [89.79617468457393]
  Training models with imbalance rate (class density discrepancy) may lead to suboptimal prediction. We propose a framework for training models for this imbalance issue. We demonstrate our model's improved performance in real-world medical datasets.
  arXiv  Detail & Related papers  (2022-07-23T00:39:53Z)
• Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalance [65.61909544178603]
  We study a practical yet challenging problem of class imbalanced semi-supervised FL (imFed-Semi) This imFed-Semi problem is addressed by a novel dynamic bank learning scheme, which improves client training by exploiting class proportion information. We evaluate our approach on two public real-world medical datasets, including the intracranial hemorrhage diagnosis with 25,000 CT slices and skin lesion diagnosis with 10,015 dermoscopy images.
  arXiv  Detail & Related papers  (2022-06-27T06:51:48Z)
• Deep Reinforcement Learning for Multi-class Imbalanced Training [64.9100301614621]
  We introduce an imbalanced classification framework, based on reinforcement learning, for training extremely imbalanced data sets. We formulate a custom reward function and episode-training procedure, specifically with the added capability of handling multi-class imbalanced training. Using real-world clinical case studies, we demonstrate that our proposed framework outperforms current state-of-the-art imbalanced learning methods.
  arXiv  Detail & Related papers  (2022-05-24T13:39:59Z)
• SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion Classification [9.265557367859637]
  SuperCon is a two-stage training strategy to overcome the class imbalance problem on skin lesion classification. Our two-stage training strategy effectively addresses the class imbalance classification problem, and significantly improves existing works in terms of F1-score and AUC score.
  arXiv  Detail & Related papers  (2022-02-11T15:19:36Z)
• No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data [78.69828864672978]
  A central challenge in training classification models in the real-world federated system is learning with non-IID data. We propose a novel and simple algorithm called Virtual Representations (CCVR), which adjusts the classifier using virtual representations sampled from an approximated ssian mixture model. Experimental results demonstrate that CCVR state-of-the-art performance on popular federated learning benchmarks including CIFAR-10, CIFAR-100, and CINIC-10.
  arXiv  Detail & Related papers  (2021-06-09T12:02:29Z)
• Deep F-measure Maximization for End-to-End Speech Understanding [52.36496114728355]
  We propose a differentiable approximation to the F-measure and train the network with this objective using standard backpropagation. We perform experiments on two standard fairness datasets, Adult, Communities and Crime, and also on speech-to-intent detection on the ATIS dataset and speech-to-image concept classification on the Speech-COCO dataset. In all four of these tasks, F-measure results in improved micro-F1 scores, with absolute improvements of up to 8% absolute, as compared to models trained with the cross-entropy loss function.
  arXiv  Detail & Related papers  (2020-08-08T03:02:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.