Multimodal Federated Learning in Healthcare: a Review

• URL: http://arxiv.org/abs/2310.09650v2
• Date: Tue, 27 Feb 2024 17:16:59 GMT
• Title: Multimodal Federated Learning in Healthcare: a Review
• Authors: Jacob Thrasher, Alina Devkota, Prasiddha Siwakotai, Rohit Chivukula, Pranav Poudel, Chaunbo Hu, Binod Bhattarai, Prashnna Gyawali
• Abstract summary: Federated Learning (FL) provides a decentralized mechanism where data need not be consolidated. This paper outlines the current state-of-the-art approaches to Multimodal Federated Learning (MMFL) within the healthcare domain. It aims to bridge the gap between cutting-edge AI technology and the imperative need for patient data privacy in healthcare applications.
• Score: 5.983768682145731
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in multimodal machine learning have empowered the development of accurate and robust AI systems in the medical domain, especially within centralized database systems. Simultaneously, Federated Learning (FL) has progressed, providing a decentralized mechanism where data need not be consolidated, thereby enhancing the privacy and security of sensitive healthcare data. The integration of these two concepts supports the ongoing progress of multimodal learning in healthcare while ensuring the security and privacy of patient records within local data-holding agencies. This paper offers a concise overview of the significance of FL in healthcare and outlines the current state-of-the-art approaches to Multimodal Federated Learning (MMFL) within the healthcare domain. It comprehensively examines the existing challenges in the field, shedding light on the limitations of present models. Finally, the paper outlines potential directions for future advancements in the field, aiming to bridge the gap between cutting-edge AI technology and the imperative need for patient data privacy in healthcare applications.

Related papers

• Advances in Privacy Preserving Federated Learning to Realize a Truly Learning Healthcare System [0.2748450182087935]
  The concept of a learning healthcare system (LHS) envisions a self-improving network where multimodal data from patient care are continuously analyzed to enhance future healthcare outcomes. Privacy-Preserving Federated Learning (PPFL) is a transformative and promising approach that has the potential to address these challenges. This paper proposes a vision for integrating PPFL into the healthcare ecosystem to achieve a truly LHS as defined by the Institute of Medicine (IOM) Roundtable.
  arXiv  Detail & Related papers  (2024-09-29T20:02:40Z)
• FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injection [83.54960238236548]
  FEDMEKI not only preserves data privacy but also enhances the capability of medical foundation models. FEDMEKI allows medical foundation models to learn from a broader spectrum of medical knowledge without direct data exposure.
  arXiv  Detail & Related papers  (2024-08-17T15:18:56Z)
• Automated Ensemble Multimodal Machine Learning for Healthcare [52.500923923797835]
  We introduce a multimodal framework, AutoPrognosis-M, that enables the integration of structured clinical (tabular) data and medical imaging using automated machine learning. AutoPrognosis-M incorporates 17 imaging models, including convolutional neural networks and vision transformers, and three distinct multimodal fusion strategies.
  arXiv  Detail & Related papers  (2024-07-25T17:46:38Z)
• Federated Learning in Healthcare: Model Misconducts, Security, Challenges, Applications, and Future Research Directions -- A Systematic Review [2.710010611878837]
  Federated Learning (FL) enables multiple healthcare institutions to collaboratively learn from decentralized data without sharing it. FL's scope in healthcare covers areas such as disease prediction, treatment customization, and clinical trial research. implementing FL poses challenges, including model convergence in non-IID data environments, communication overhead, and managing multi-institutional collaborations.
  arXiv  Detail & Related papers  (2024-05-22T16:59:50Z)
• Blockchain-empowered Federated Learning for Healthcare Metaverses: User-centric Incentive Mechanism with Optimal Data Freshness [66.3982155172418]
  We first design a user-centric privacy-preserving framework based on decentralized Federated Learning (FL) for healthcare metaverses. We then utilize Age of Information (AoI) as an effective data-freshness metric and propose an AoI-based contract theory model under Prospect Theory (PT) to motivate sensing data sharing.
  arXiv  Detail & Related papers  (2023-07-29T12:54:03Z)
• The Design and Implementation of a National AI Platform for Public Healthcare in Italy: Implications for Semantics and Interoperability [62.997667081978825]
  The Italian National Health Service is adopting Artificial Intelligence through its technical agencies. Such a vast programme requires special care in formalising the knowledge domain. Questions have been raised about the impact that AI could have on patients, practitioners, and health systems.
  arXiv  Detail & Related papers  (2023-04-24T08:00:02Z)
• Privacy-preserving machine learning for healthcare: open challenges and future perspectives [72.43506759789861]
  We conduct a review of recent literature concerning Privacy-Preserving Machine Learning (PPML) for healthcare. We primarily focus on privacy-preserving training and inference-as-a-service. The aim of this review is to guide the development of private and efficient ML models in healthcare.
  arXiv  Detail & Related papers  (2023-03-27T19:20:51Z)
• A Secure Healthcare 5.0 System Based on Blockchain Technology Entangled with Federated Learning Technique [0.44040106718326594]
  Security and privacy are key concerns on the Internet of Medical Things (IoMT) industry. By identifying concerns early, a smart healthcare system can help avoid long-term damage. This study is to construct a secure health monitoring system in healthcare 5.0 by utilizing a blockchain technology and Intrusion Detection System (IDS)
  arXiv  Detail & Related papers  (2022-09-16T23:25:42Z)
• Federated Learning for Medical Applications: A Taxonomy, Current Trends, Challenges, and Future Research Directions [9.662980267339375]
  We focus on medical applications of acFL, particularly in the context of global cancer diagnosis. Recent developments in acFL have made it possible to train complex machine-learned models in a distributed manner.
  arXiv  Detail & Related papers  (2022-08-05T21:41:15Z)
• MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluation [110.31526448744096]
  We argue that unlocking this potential requires a systematic way to measure the performance of medical AI models on large-scale heterogeneous data. We are building MedPerf, an open framework for benchmarking machine learning in the medical domain.
  arXiv  Detail & Related papers  (2021-09-29T18:09:41Z)
• Smart Healthcare in the Age of AI: Recent Advances, Challenges, and Future Prospects [3.3336265497547126]
  The smart healthcare system is a topic of recently growing interest and has become increasingly required due to major developments in modern technologies. This paper is aimed to discuss the current state-of-the-art smart healthcare systems highlighting major areas like wearable and smartphone devices for health monitoring, machine learning for disease diagnosis, and the assistive frameworks, including social robots developed for the ambient assisted living environment.
  arXiv  Detail & Related papers  (2021-06-24T05:10:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.