Communication Efficient Tensor Factorization for Decentralized Healthcare Networks

• URL: http://arxiv.org/abs/2109.01718v1
• Date: Fri, 3 Sep 2021 19:47:08 GMT
• Title: Communication Efficient Tensor Factorization for Decentralized Healthcare Networks
• Abstract summary: We propose CiderTF, a communication-efficient decentralized generalized tensor factorization. Experiments on two real-world EHR datasets demonstrate that CiderTF achieves comparable convergence with the communication reduction up to 99.99%.
• Score: 12.57461555027056
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Tensor factorization has been proved as an efficient unsupervised learning approach for health data analysis, especially for computational phenotyping, where the high-dimensional Electronic Health Records (EHRs) with patients history of medical procedures, medications, diagnosis, lab tests, etc., are converted to meaningful and interpretable medical concepts. Federated tensor factorization distributes the tensor computation to multiple workers under the coordination of a central server, which enables jointly learning the phenotypes across multiple hospitals while preserving the privacy of the patient information. However, existing federated tensor factorization algorithms encounter the single-point-failure issue with the involvement of the central server, which is not only easily exposed to external attacks, but also limits the number of clients sharing information with the server under restricted uplink bandwidth. In this paper, we propose CiderTF, a communication-efficient decentralized generalized tensor factorization, which reduces the uplink communication cost by leveraging a four-level communication reduction strategy designed for a generalized tensor factorization, which has the flexibility of modeling different tensor distribution with multiple kinds of loss functions. Experiments on two real-world EHR datasets demonstrate that CiderTF achieves comparable convergence with the communication reduction up to 99.99%.

Related papers

• Federated Transformer-GNN for Privacy-Preserving Brain Tumor Localization with Modality-Level Explainability [0.2683233968306505]
  We present a federated learning framework for brain tumor localization that enables multi-institutional collaboration without sharing sensitive patient data.<n>Our method extends a hybrid Transformer-Graph Neural Network architecture derived from prior decoder-free supervoxel GNNs.<n>We provide an explainability analysis through Transformer attention mechanisms that reveals which MRI modalities drive the model predictions.
  arXiv  Detail & Related papers  (2026-01-21T14:46:00Z)
• FedSCA: Federated Tuning with Similarity-guided Collaborative Aggregation for Heterogeneous Medical Image Segmentation [14.113755905200009]
  Transformer-based foundation models (FMs) have recently demonstrated remarkable performance in medical image segmentation. However, scaling these models is challenging due to the limited size of medical image datasets within isolated hospitals. We propose a novel FLFM fine-tuning framework, underlinetextbfFederated tuning with underlinetextbfCollaborative underlinetextbfAggregation (FedSCA)
  arXiv  Detail & Related papers  (2025-03-19T16:27:29Z)
• Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors [74.31355755781343]
  We propose TCN, an accurate and compatible tensor convolutional network that integrates seamlessly with TF methods for predicting top-k interactions. We show that TCN integrated with a TF method outperforms competitors, including TF methods and a hyperedge prediction method.
  arXiv  Detail & Related papers  (2025-03-14T18:22:20Z)
• Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation [15.55939232262832]
  Cardiovascular disease (CVD) and cardiac dyssynchrony are major public health problems in the United States. We propose a novel efficient and adaptive federate learning method for cardiac segmentation.
  arXiv  Detail & Related papers  (2025-01-06T18:57:18Z)
• Boosting the Performance of Decentralized Federated Learning via Catalyst Acceleration [66.43954501171292]
  We introduce Catalyst Acceleration and propose an acceleration Decentralized Federated Learning algorithm called DFedCata. DFedCata consists of two main components: the Moreau envelope function, which addresses parameter inconsistencies, and Nesterov's extrapolation step, which accelerates the aggregation phase. Empirically, we demonstrate the advantages of the proposed algorithm in both convergence speed and generalization performance on CIFAR10/100 with various non-iid data distributions.
  arXiv  Detail & Related papers  (2024-10-09T06:17:16Z)
• FeDETR: a Federated Approach for Stenosis Detection in Coronary Angiography [0.3823356975862007]
  coronary stenosis is an underlying factor in heart failure. Current practice for grading coronary lesions suffers from several drawbacks. Deep learning methods have emerged to assist cardiologists in automating the estimation of FFR/iFR values.
  arXiv  Detail & Related papers  (2024-09-21T23:52:05Z)
• Federated Hierarchical Tensor Networks: a Collaborative Learning Quantum AI-Driven Framework for Healthcare [0.0]
  In today's context, Federated Learning (FL) stands out as a crucial remedy, facilitating the rapid advancement of distributed machine learning. We propose a federated learning framework based on quantum tensor networks, which leverages the principles of many-body quantum physics. Experiments on popular medical image datasets show that the federated quantum tensor network model achieved a mean receiver-operator characteristic area under the curve (ROC-AUC) between 0.91-0.98.
  arXiv  Detail & Related papers  (2024-05-13T13:32:02Z)
• Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning [67.49221252724229]
  E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. Applying federated learning in e-health faces many challenges. Medical data is both horizontally and vertically partitioned. A naive combination of HFL and VFL has limitations including low training efficiency, unsound convergence analysis, and lack of parameter tuning strategies.
  arXiv  Detail & Related papers  (2024-04-15T19:45:07Z)
• Leveraging Frequency Domain Learning in 3D Vessel Segmentation [50.54833091336862]
  In this study, we leverage Fourier domain learning as a substitute for multi-scale convolutional kernels in 3D hierarchical segmentation models. We show that our novel network achieves remarkable dice performance (84.37% on ASACA500 and 80.32% on ImageCAS) in tubular vessel segmentation tasks.
  arXiv  Detail & Related papers  (2024-01-11T19:07:58Z)
• Communication-Efficient Decentralized Federated Learning via One-Bit Compressive Sensing [52.402550431781805]
  Decentralized federated learning (DFL) has gained popularity due to its practicality across various applications. Compared to the centralized version, training a shared model among a large number of nodes in DFL is more challenging. We develop a novel algorithm based on the framework of the inexact alternating direction method (iADM)
  arXiv  Detail & Related papers  (2023-08-31T12:22:40Z)
• Medical Federated Model with Mixture of Personalized and Sharing Components [31.068735334318088]
  We propose a new personalized framework of federated learning to handle the problem. It successfully yields personalized models based on awareness of similarity between local data. Also, we propose an effective method to reduce the computational cost, which improves computation efficiency significantly.
  arXiv  Detail & Related papers  (2023-06-26T07:50:32Z)
• Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI [9.916963496386089]
  A novel hierarchical structural-functional connectivity fusing (HSCF) model is proposed to construct brain structural-functional connectivity matrices. Results from a wide range of tests performed on the public Alzheimer's Disease Neuroimaging Initiative database show that the proposed model performs better than competing approaches.
  arXiv  Detail & Related papers  (2023-06-16T05:22:25Z)
• Distributed Learning over Networks with Graph-Attention-Based Personalization [49.90052709285814]
  We propose a graph-based personalized algorithm (GATTA) for distributed deep learning. In particular, the personalized model in each agent is composed of a global part and a node-specific part. By treating each agent as one node in a graph the node-specific parameters as its features, the benefits of the graph attention mechanism can be inherited.
  arXiv  Detail & Related papers  (2023-05-22T13:48:30Z)
• Fundamental Limits of Communication Efficiency for Model Aggregation in Distributed Learning: A Rate-Distortion Approach [54.311495894129585]
  We study the limit of communication cost of model aggregation in distributed learning from a rate-distortion perspective. It is found that the communication gain by exploiting the correlation between worker nodes is significant for SignSGD.
  arXiv  Detail & Related papers  (2022-06-28T13:10:40Z)
• Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic Training [28.309185925167565]
  Federated learning enables neural network training for COVID-19 diagnosis on chest X-ray (CXR) images without collecting patient CXR data across multiple hospitals. We show that Vision Transformer, a recently developed deep learning architecture with straightforward decomposable configuration, is ideally suitable for split learning without sacrificing performance. Our results affirm the suitability of Transformer for collaborative learning in medical imaging and pave the way forward for future real-world implementations.
  arXiv  Detail & Related papers  (2021-11-02T02:54:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.