Federated Cross Learning for Medical Image Segmentation

• URL: http://arxiv.org/abs/2204.02450v2
• Date: Mon, 22 May 2023 21:05:06 GMT
• Title: Federated Cross Learning for Medical Image Segmentation
• Authors: Xuanang Xu, Hannah H. Deng, Tianyi Chen, Tianshu Kuang, Joshua C. Barber, Daeseung Kim, Jaime Gateno, James J. Xia, Pingkun Yan
• Abstract summary: Federated learning (FL) can collaboratively train deep learning models using isolated patient data owned by different hospitals for various clinical applications. A major problem of FL is its performance degradation when dealing with data that are not independently and identically distributed (non-iid)
• Score: 23.075410916203005
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Federated learning (FL) can collaboratively train deep learning models using isolated patient data owned by different hospitals for various clinical applications, including medical image segmentation. However, a major problem of FL is its performance degradation when dealing with data that are not independently and identically distributed (non-iid), which is often the case in medical images. In this paper, we first conduct a theoretical analysis on the FL algorithm to reveal the problem of model aggregation during training on non-iid data. With the insights gained through the analysis, we propose a simple yet effective method, federated cross learning (FedCross), to tackle this challenging problem. Unlike the conventional FL methods that combine multiple individually trained local models on a server node, our FedCross sequentially trains the global model across different clients in a round-robin manner, and thus the entire training procedure does not involve any model aggregation steps. To further improve its performance to be comparable with the centralized learning method, we combine the FedCross with an ensemble learning mechanism to compose a federated cross ensemble learning (FedCrossEns) method. Finally, we conduct extensive experiments using a set of public datasets. The experimental results show that the proposed FedCross training strategy outperforms the mainstream FL methods on non-iid data. In addition to improving the segmentation performance, our FedCrossEns can further provide a quantitative estimation of the model uncertainty, demonstrating the effectiveness and clinical significance of our designs. Source code is publicly available at https://github.com/DIAL-RPI/FedCross.

Related papers

• FedSoup: Improving Generalization and Personalization in Federated Learning via Selective Model Interpolation [32.36334319329364]
  Cross-silo federated learning (FL) enables the development of machine learning models on datasets distributed across data centers. Recent research has found that current FL algorithms face a trade-off between local and global performance when confronted with distribution shifts. We propose a novel federated model soup method to optimize the trade-off between local and global performance.
  arXiv  Detail & Related papers  (2023-07-20T00:07:29Z)
• Learnable Weight Initialization for Volumetric Medical Image Segmentation [66.3030435676252]
  We propose a learnable weight-based hybrid medical image segmentation approach. Our approach is easy to integrate into any hybrid model and requires no external training data. Experiments on multi-organ and lung cancer segmentation tasks demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-06-15T17:55:05Z)
• Collaborative Training of Medical Artificial Intelligence Models with non-uniform Labels [0.07176066267895696]
  Building powerful and robust deep learning models requires training with large multi-party datasets. We propose flexible federated learning (FFL) for collaborative training on such data. We demonstrate that having heterogeneously labeled datasets, FFL-based training leads to significant performance increase.
  arXiv  Detail & Related papers  (2022-11-24T13:48:54Z)
• FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation [16.019513233021435]
  Federated Learning (FL) has attracted increasing attention to deal with data silo problems without compromising user privacy. We present an efficient FL framework named FedCross, which uses a novel multi-to-multi FL training scheme based on our proposed multi-model cross-aggregation approach. We show that FedCross can significantly improve FL accuracy within both IID and non-IID scenarios without causing additional communication overhead.
  arXiv  Detail & Related papers  (2022-10-15T13:12:11Z)
• FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings [51.09574369310246]
  Federated Learning (FL) is a novel approach enabling several clients holding sensitive data to collaboratively train machine learning models. We propose a novel cross-silo dataset suite focused on healthcare, FLamby, to bridge the gap between theory and practice of cross-silo FL. Our flexible and modular suite allows researchers to easily download datasets, reproduce results and re-use the different components for their research.
  arXiv  Detail & Related papers  (2022-10-10T12:17:30Z)
• FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning [87.08902493524556]
  Federated learning(FL) has recently attracted increasing attention from academia and industry. We propose FedDM to build the global training objective from multiple local surrogate functions. In detail, we construct synthetic sets of data on each client to locally match the loss landscape from original data.
  arXiv  Detail & Related papers  (2022-07-20T04:55:18Z)
• MS Lesion Segmentation: Revisiting Weighting Mechanisms for Federated Learning [92.91544082745196]
  Federated learning (FL) has been widely employed for medical image analysis. FL's performance is limited for multiple sclerosis (MS) lesion segmentation tasks. We propose the first FL MS lesion segmentation framework via two effective re-weighting mechanisms.
  arXiv  Detail & Related papers  (2022-05-03T14:06:03Z)
• Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation [66.44449514373746]
  Cross-silo federated learning (FL) has attracted much attention in medical imaging analysis with deep learning in recent years. There can be a gap between the model trained from FL and one from centralized training. We propose a novel training framework FedSM to avoid client issue and successfully close the drift gap.
  arXiv  Detail & Related papers  (2022-03-18T19:50:07Z)
• FedDropoutAvg: Generalizable federated learning for histopathology image classification [11.509801043891837]
  Federated learning (FL) enables collaborative learning of a deep learning model without sharing the data of participating sites. We propose FedDropoutAvg, a new federated learning approach for training a generalizable model. We show that the proposed approach is more generalizable than other state-of-the-art federated training approaches.
  arXiv  Detail & Related papers  (2021-11-25T19:30:37Z)
• Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching [58.26619456972598]
  Federated learning (FL) has emerged with increasing popularity to collaborate distributed medical institutions for training deep networks. This paper studies a practical yet challenging FL problem, named textitFederated Semi-supervised Learning (FSSL) We present a novel approach for this problem, which improves over traditional consistency regularization mechanism with a new inter-client relation matching scheme.
  arXiv  Detail & Related papers  (2021-06-16T07:58:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.