Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction

• URL: http://arxiv.org/abs/2502.04521v1
• Date: Thu, 06 Feb 2025 21:45:16 GMT
• Title: Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction
• Authors: Valiyeh A. Nezhad, Gokberk Elmas, Bilal Kabas, Fuat Arslan, Tolga Çukur,
• Abstract summary: FedGAT is a model-agnostic FL technique based on generative autoregressive transformers. It decentralizes the training of a global generative prior that captures the distribution of multi-site MR images. It supports flexible collaborations while enjoying superior within-site and across-site reconstruction performance.
• Score: 5.519160766363227
• License:
• Abstract: Although learning-based models hold great promise for MRI reconstruction, single-site models built on limited local datasets often suffer from poor generalization. This challenge has spurred interest in collaborative model training on multi-site datasets via federated learning (FL) -- a privacy-preserving framework that aggregates model updates instead of sharing imaging data. Conventional FL builds a global model by aggregating locally trained model weights, inherently constraining all sites to a homogeneous model architecture. This rigid homogeneity requirement forces sites to forgo architectures tailored to their compute infrastructure and application-specific demands. Consequently, existing FL methods for MRI reconstruction fail to support model-heterogeneous settings, where individual sites are allowed to use distinct architectures. To overcome this fundamental limitation, here we introduce FedGAT, a novel model-agnostic FL technique based on generative autoregressive transformers. FedGAT decentralizes the training of a global generative prior that captures the distribution of multi-site MR images. For enhanced fidelity, we propose a novel site-prompted GAT prior that controllably synthesizes MR images from desired sites via autoregressive prediction across spatial scales. Each site then trains its site-specific reconstruction model -- using its preferred architecture -- on a hybrid dataset comprising the local MRI dataset and GAT-generated synthetic MRI datasets for other sites. Comprehensive experiments on multi-institutional datasets demonstrate that FedGAT supports flexible collaborations while enjoying superior within-site and across-site reconstruction performance compared to state-of-the-art FL baselines.

Related papers

• Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model [17.375064910924717]
  We propose a dynamic MRI reconstruction method based on a time-interleaved acquisition scheme, termed the Glob-al-to-local Diffusion Model. The proposed method performs well in terms of noise reduction and preservation, achieving reconstruction quality comparable to that of supervised approaches.
  arXiv  Detail & Related papers  (2024-11-06T07:40:27Z)
• Federated Learning with Projected Trajectory Regularization [65.6266768678291]
  Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients. We propose a novel federated learning framework with projected trajectory regularization (FedPTR) for tackling the data issue.
  arXiv  Detail & Related papers  (2023-12-22T02:12:08Z)
• Tackling Computational Heterogeneity in FL: A Few Theoretical Insights [68.8204255655161]
  We introduce and analyse a novel aggregation framework that allows for formalizing and tackling computational heterogeneous data. Proposed aggregation algorithms are extensively analyzed from a theoretical, and an experimental prospective.
  arXiv  Detail & Related papers  (2023-07-12T16:28:21Z)
• Vertical Federated Learning over Cloud-RAN: Convergence Analysis and System Optimization [82.12796238714589]
  We propose a novel cloud radio access network (Cloud-RAN) based vertical FL system to enable fast and accurate model aggregation. We characterize the convergence behavior of the vertical FL algorithm considering both uplink and downlink transmissions. We establish a system optimization framework by joint transceiver and fronthaul quantization design, for which successive convex approximation and alternate convex search based system optimization algorithms are developed.
  arXiv  Detail & Related papers  (2023-05-04T09:26:03Z)
• One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesis [5.3963856146595095]
  Learning-based MRI translation involves a synthesis model that maps a source-contrast onto a target-contrast image. Here we introduce the first personalized FL method for MRI Synthesis (pFL Synth) pFL Synth is based on an adversarial model equipped with a mapper that produces latents specific to individual sites and source-target contrasts.
  arXiv  Detail & Related papers  (2022-07-13T20:14:16Z)
• Federated Learning of Generative Image Priors for MRI Reconstruction [5.3963856146595095]
  Multi-institutional efforts can facilitate training of deep MRI reconstruction models, albeit privacy risks arise during cross-site sharing of imaging data. We introduce a novel method for MRI reconstruction based on Federated learning of Generative IMage Priors (FedGIMP) FedGIMP leverages a two-stage approach: cross-site learning of a generative MRI prior, and subject-specific injection of the imaging operator.
  arXiv  Detail & Related papers  (2022-02-08T22:17:57Z)
• Specificity-Preserving Federated Learning for MR Image Reconstruction [94.58912814426122]
  Federated learning can be used to improve data privacy and efficiency in magnetic resonance (MR) image reconstruction. Recent FL techniques tend to solve this by enhancing the generalization of the global model. We propose a specificity-preserving FL algorithm for MR image reconstruction (FedMRI)
  arXiv  Detail & Related papers  (2021-12-09T22:13:35Z)
• FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorization [16.704006420306353]
  A scalable federated learning framework should address heterogeneous clients equipped with different computation and communication capabilities. This paper proposes FedHM, a novel federated model compression framework that distributes the heterogeneous low-rank models to clients and then aggregates them into a global full-rank model. Our solution enables the training of heterogeneous local models with varying computational complexities and aggregates a single global model.
  arXiv  Detail & Related papers  (2021-11-29T16:11:09Z)
• Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning [53.73083199055093]
  We show that attention-based architectures (e.g., Transformers) are fairly robust to distribution shifts. Our experiments show that replacing convolutional networks with Transformers can greatly reduce catastrophic forgetting of previous devices.
  arXiv  Detail & Related papers  (2021-06-10T21:04:18Z)
• Edge-assisted Democratized Learning Towards Federated Analytics [67.44078999945722]
  We show the hierarchical learning structure of the proposed edge-assisted democratized learning mechanism, namely Edge-DemLearn. We also validate Edge-DemLearn as a flexible model training mechanism to build a distributed control and aggregation methodology in regions.
  arXiv  Detail & Related papers  (2020-12-01T11:46:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.