FedDRAW: Federated Dual Reputation Annealing Weighting for Heterogeneous Multi-Institutional Chest Radiograph Classification
- URL: http://arxiv.org/abs/2609.05223v1
- Date: Fri, 04 Sep 2026 14:53:31 GMT
- Title: FedDRAW: Federated Dual Reputation Annealing Weighting for Heterogeneous Multi-Institutional Chest Radiograph Classification
- Abstract summary: We propose Federated Dual Reputation Annealing Weighting (FedDRAW) as a server-side aggregation method.<n>FedDRAW achieves the highest average rank among all eight methods under both AUC and the geometric mean (GM) of sensitivity and specificity.<n> Scheduling two signals, rather than fixing the weights by sample count alone, could enable less biased diagnostic models.
- Score: 1.0384586035475536
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Artificial intelligence models are promising for medical diagnosis, but they require large numbers of unbiased data, which in medicine are distributed across hospitals and cannot be centralized to protect patient privacy. Federated Learning (FL) addresses this, since hospitals train one shared diagnostic model while patient data remain local. Training proceeds in communication rounds, in which each hospital trains the shared model locally and returns it to the server for merging by weighted average. This aggregation weight determines whose institutional knowledge shapes the result. Federated averaging (FedAvg) sets it in proportion to local sample count, so a small but informative hospital is permanently assigned a small influence, andl argest clients could dominate the global model even when they are less informative. We propose Federated Dual Reputation Annealing Weighting (FedDRAW), a server-side aggregation method that combines a data-size prior with the cosine similarity between client and global parameters under two coupled annealing schedules. An inner schedule shifts client reputation from the size prior towards similarity. An outer, deferred annealing schedule on the softmax inverse temperature keeps the weighting selective in the early and middle rounds and relaxes it to uniformity at convergence. We evaluate FedDRAW on 12 simulated client-partition scenarios of two chest radiograph datasets (CheXpert and ChestMNIST), against seven federated baselines under identical local training settings. FedDRAW achieved the highest average rank among all eight methods under both AUC and the geometric mean (GM) of sensitivity and specificity, which a Friedman test with Nemenyi post-hoc analysis confirmed to be a statistically significant difference between the methods. Scheduling two signals, rather than fixing the weights by sample count alone, could enable less biased diagnostic models.
Related papers
- FedPref: Federated Preference Learning for Structured Radiology Report Extraction [69.11739400975445]
Radiology reports describe findings and locations in free text, but downstream search and analysis require these relations in a fixed schema.<n>We introduce FedPref: frozen public language models propose alternative extractions, local annotations rank them, and sites collaboratively train pooled compact Qwen3-8B adapters.<n>On development data from six simulated hospitals with unequal data volume and disease prevalence, FedPref improves client-mean F1 by 2.49 points and worst-site F1 by 9.10 points compared with training each site in isolation.
arXiv Detail & Related papers (2026-08-17T12:29:42Z) - FedSPM: Routing-Enabled Federated Learning under Dual Heterogeneity via Semiparametric Mixture [14.751907622686423]
We present FedSPM, a routing-enabled semiparametric mixture framework that represents each client using client-specific latent components.<n>Experiments on controlled benchmarks and real-world medical data demonstrate consistent improvements in routing and prediction under dual heterogeneity.
arXiv Detail & Related papers (2026-07-05T02:31:39Z) - Comparing Federated Stochastic Gradient Descent and Federated Averaging for Predicting Hospital Length of Stay [0.0]
Predicting hospital length of stay (LOS) reliably is an essential need for efficient resource allocation at hospitals.
Traditional predictive modeling tools frequently have difficulty acquiring sufficient and diverse data because healthcare institutions have privacy rules in place.
This modeling approach facilitates collaborative model training by modeling decentralized data sources from different hospitals without extracting sensitive data outside of hospitals.
arXiv Detail & Related papers (2024-07-17T17:00:20Z) - Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization [90.08459757321405]
Federated Adam (FedAdam) algorithms suffer from a threefold increase in uplink communication overhead.<n>We propose a novel sparse FedAdam algorithm called FedAdam-SSM, wherein distributed devices sparsify the updates local model parameters and moment estimates.<n>By minimizing the divergence bound between the model trained by FedAdam-SSM and centralized Adam, we optimize the SSM to mitigate the learning performance degradation caused by sparsification error.
arXiv Detail & Related papers (2024-05-28T07:56:49Z) - Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency [10.16245019262119]
Federated learning aims to train a shared model of isolated clients without local data exchange.
In this work, we propose a novel federated semi-supervised learning framework for medical image segmentation.
arXiv Detail & Related papers (2024-03-19T12:52:38Z) - Cluster Based Secure Multi-Party Computation in Federated Learning for
Histopathology Images [0.0]
Federated learning (FL) is a decentralized method enabling hospitals to collaboratively learn a model without sharing private patient data for training.
In FL, participant hospitals periodically exchange training results rather than training samples with a central server.
In our proposed method, the hospitals are divided into clusters. After local training, each hospital splits its model weights among other hospitals in the same cluster. Then, all hospitals sum up the received weights, sending the results to the central server.
Finally, the central server aggregates the results, retrieving the average of models' weights and updating the model without having access to individual hospitals' weights.
arXiv Detail & Related papers (2022-08-21T23:56:28Z) - Density-Aware Personalized Training for Risk Prediction in Imbalanced
Medical Data [89.79617468457393]
Training models with imbalance rate (class density discrepancy) may lead to suboptimal prediction.
We propose a framework for training models for this imbalance issue.
We demonstrate our model's improved performance in real-world medical datasets.
arXiv Detail & Related papers (2022-07-23T00:39:53Z) - FedIIC: Towards Robust Federated Learning for Class-Imbalanced Medical
Image Classification [29.69137726688905]
We present a privacy-preserving Federated Learning (FL) method named FedIIC to combat class imbalance from two perspectives.
In feature learning, two levels of contrastive learning are designed to extract better class-specific features with imbalanced data in FL.
In classifier learning, per-class margins are dynamically set according to real-time difficulty and class priors, which helps the model learn classes equally.
arXiv Detail & Related papers (2022-06-28T07:37:38Z) - Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with
Class Imbalance [65.61909544178603]
We study a practical yet challenging problem of class imbalanced semi-supervised FL (imFed-Semi)
This imFed-Semi problem is addressed by a novel dynamic bank learning scheme, which improves client training by exploiting class proportion information.
We evaluate our approach on two public real-world medical datasets, including the intracranial hemorrhage diagnosis with 25,000 CT slices and skin lesion diagnosis with 10,015 dermoscopy images.
arXiv Detail & Related papers (2022-06-27T06:51:48Z) - Practical Challenges in Differentially-Private Federated Survival
Analysis of Medical Data [57.19441629270029]
In this paper, we take advantage of the inherent properties of neural networks to federate the process of training of survival analysis models.
In the realistic setting of small medical datasets and only a few data centers, this noise makes it harder for the models to converge.
We propose DPFed-post which adds a post-processing stage to the private federated learning scheme.
arXiv Detail & Related papers (2022-02-08T10:03:24Z) - FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality
Brain Image Synthesis [55.939957482776194]
We propose a new benchmark for federated domain translation on unsupervised brain image synthesis (termed as FedMed-GAN)
FedMed-GAN mitigates the mode collapse without sacrificing the performance of generators.
A comprehensive evaluation is provided for comparing FedMed-GAN and other centralized methods.
arXiv Detail & Related papers (2022-01-22T02:50:29Z) - Auto-FedAvg: Learnable Federated Averaging for Multi-Institutional
Medical Image Segmentation [7.009650174262515]
Federated learning (FL) enables collaborative model training while preserving each participant's privacy.
FedAvg is a standard algorithm that uses fixed weights, often originating from the dataset sizes at each client, to aggregate the distributed learned models on a server during the FL process.
In this work, we design a new data-driven approach, namely Auto-FedAvg, where aggregation weights are dynamically adjusted.
arXiv Detail & Related papers (2021-04-20T18:29:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.