A cautionary tale on the cost-effectiveness of collaborative AI in real-world medical applications

• URL: http://arxiv.org/abs/2412.06494v1
• Date: Mon, 09 Dec 2024 13:50:52 GMT
• Title: A cautionary tale on the cost-effectiveness of collaborative AI in real-world medical applications
• Authors: Francesco Cremonesi, Lucia Innocenti, Sebastien Ourselin, Vicky Goh, Michela Antonelli, Marco Lorenzi,
• Abstract summary: Federated learning (FL) has gained wide popularity as a collaborative learning paradigm enabling collaborative AI in sensitive healthcare applications.<n>In this work we propose a benchmark of the accuracy and cost-effectiveness of a panel of FL and consensus-based learning methods.
• Score: 3.2821049498759094
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Background. Federated learning (FL) has gained wide popularity as a collaborative learning paradigm enabling collaborative AI in sensitive healthcare applications. Nevertheless, the practical implementation of FL presents technical and organizational challenges, as it generally requires complex communication infrastructures. In this context, consensus-based learning (CBL) may represent a promising collaborative learning alternative, thanks to the ability of combining local knowledge into a federated decision system, while potentially reducing deployment overhead. Methods. In this work we propose an extensive benchmark of the accuracy and cost-effectiveness of a panel of FL and CBL methods in a wide range of collaborative medical data analysis scenarios. The benchmark includes 7 different medical datasets, encompassing 3 machine learning tasks, 8 different data modalities, and multi-centric settings involving 3 to 23 clients. Findings. Our results reveal that CBL is a cost-effective alternative to FL. When compared across the panel of medical dataset in the considered benchmark, CBL methods provide equivalent accuracy to the one achieved by FL.Nonetheless, CBL significantly reduces training time and communication cost (resp. 15 fold and 60 fold decrease) (p < 0.05). Interpretation. This study opens a novel perspective on the deployment of collaborative AI in real-world applications, whereas the adoption of cost-effective methods is instrumental to achieve sustainability and democratisation of AI by alleviating the need for extensive computational resources.

Related papers

• FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare [19.559006138457605]
  Federated Learning (FL) has emerged as an effective solution for multi-institutional collaborations without sharing patient data. We developed the Federated Healthcare Benchmark(FHBench), a benchmark specifically designed from datasets derived from real-world healthcare applications. Building on FHBench, we introduced Efficient Personalized Federated Learning with Adaptive LoRA(EPFL), a personalized FL framework.
  arXiv  Detail & Related papers  (2025-04-15T02:38:00Z)
• Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP [4.744635045603924]
  Federated learning (FL) enables collaborative model training across organizations without sharing raw data. We propose Layer-Skipping Federated Learning, where only selected layers of a pre-trained LLM are fine-tuned across clients while others remain frozen.
  arXiv  Detail & Related papers  (2025-04-13T07:27:56Z)
• Query-based Knowledge Transfer for Heterogeneous Learning Environments [50.45210784447839]
  We propose a novel framework called Query-based Knowledge Transfer (QKT) QKT enables tailored knowledge acquisition to fulfill specific client needs without direct data exchange. Our experiments show that QKT significantly outperforms existing collaborative learning methods.
  arXiv  Detail & Related papers  (2025-04-12T13:09:39Z)
• Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning [67.49221252724229]
  E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. Applying federated learning in e-health faces many challenges. Medical data is both horizontally and vertically partitioned. A naive combination of HFL and VFL has limitations including low training efficiency, unsound convergence analysis, and lack of parameter tuning strategies.
  arXiv  Detail & Related papers  (2024-04-15T19:45:07Z)
• Benchmarking Collaborative Learning Methods Cost-Effectiveness for Prostate Segmentation [39.19170617818745]
  We address a prostate segmentation problem from MRI in a collaborative scenario. To the best of our knowledge, this is the first work in which consensus-based methods (CBM) are used to solve a problem of collaborative learning.
  arXiv  Detail & Related papers  (2023-09-29T09:47:18Z)
• Improving Fairness in AI Models on Electronic Health Records: The Case for Federated Learning Methods [0.0]
  We show one possible approach to mitigate bias concerns by having healthcare institutions collaborate through a federated learning paradigm. We propose a comprehensive FL approach with adversarial debiasing and a fair aggregation method, suitable to various fairness metrics. Our method has achieved promising fairness performance with the lowest impact on overall discrimination performance (accuracy)
  arXiv  Detail & Related papers  (2023-05-19T02:03:49Z)
• FedDBL: Communication and Data Efficient Federated Deep-Broad Learning for Histopathological Tissue Classification [65.7405397206767]
  We propose Federated Deep-Broad Learning (FedDBL) to achieve superior classification performance with limited training samples and only one-round communication. FedDBL greatly outperforms the competitors with only one-round communication and limited training samples, while it even achieves comparable performance with the ones under multiple-round communications. Since no data or deep model sharing across different clients, the privacy issue is well-solved and the model security is guaranteed with no model inversion attack risk.
  arXiv  Detail & Related papers  (2023-02-24T14:27:41Z)
• Towards the Practical Utility of Federated Learning in the Medical Domain [32.172151977619826]
  We propose empirical benchmarks and experimental settings for three representative medical datasets with different modalities. We evaluate six FL algorithms designed for addressing data heterogeneity among clients, and a hybrid algorithm combining the strengths of two representative FL algorithms. We find that simple FL algorithms tend to outperform more sophisticated ones, while the hybrid algorithm consistently shows good, if not the best performance.
  arXiv  Detail & Related papers  (2022-07-07T04:07:48Z)
• Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases [57.90226879210227]
  FedCy is a semi-supervised learning (FSSL) method that combines FL and self-supervised learning to exploit a decentralized dataset of both labeled and unlabeled videos. We demonstrate significant performance gains over state-of-the-art FSSL methods on the task of automatic recognition of surgical phases.
  arXiv  Detail & Related papers  (2022-03-14T17:44:53Z)
• Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning [61.488646649045215]
  Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices)
  arXiv  Detail & Related papers  (2021-11-28T19:03:39Z)
• Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching [58.26619456972598]
  Federated learning (FL) has emerged with increasing popularity to collaborate distributed medical institutions for training deep networks. This paper studies a practical yet challenging FL problem, named textitFederated Semi-supervised Learning (FSSL) We present a novel approach for this problem, which improves over traditional consistency regularization mechanism with a new inter-client relation matching scheme.
  arXiv  Detail & Related papers  (2021-06-16T07:58:00Z)
• FLOP: Federated Learning on Medical Datasets using Partial Networks [84.54663831520853]
  COVID-19 Disease due to the novel coronavirus has caused a shortage of medical resources. Different data-driven deep learning models have been developed to mitigate the diagnosis of COVID-19. The data itself is still scarce due to patient privacy concerns. We propose a simple yet effective algorithm, named textbfFederated textbfL textbfon Medical datasets using textbfPartial Networks (FLOP)
  arXiv  Detail & Related papers  (2021-02-10T01:56:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.