Federated Learning for Computational Pathology on Gigapixel Whole Slide
Images
- URL: http://arxiv.org/abs/2009.10190v2
- Date: Wed, 23 Sep 2020 00:11:40 GMT
- Title: Federated Learning for Computational Pathology on Gigapixel Whole Slide
Images
- Authors: Ming Y. Lu, Dehan Kong, Jana Lipkova, Richard J. Chen, Rajendra Singh,
Drew F. K. Williamson, Tiffany Y. Chen, Faisal Mahmood
- Abstract summary: We introduce privacy-preserving federated learning for gigapixel whole slide images in computational pathology.
We evaluate our approach on two different diagnostic problems using thousands of histology whole slide images with only slide-level labels.
- Score: 4.035591045544291
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep Learning-based computational pathology algorithms have demonstrated
profound ability to excel in a wide array of tasks that range from
characterization of well known morphological phenotypes to predicting
non-human-identifiable features from histology such as molecular alterations.
However, the development of robust, adaptable, and accurate deep learning-based
models often rely on the collection and time-costly curation large high-quality
annotated training data that should ideally come from diverse sources and
patient populations to cater for the heterogeneity that exists in such
datasets. Multi-centric and collaborative integration of medical data across
multiple institutions can naturally help overcome this challenge and boost the
model performance but is limited by privacy concerns amongst other difficulties
that may arise in the complex data sharing process as models scale towards
using hundreds of thousands of gigapixel whole slide images. In this paper, we
introduce privacy-preserving federated learning for gigapixel whole slide
images in computational pathology using weakly-supervised attention multiple
instance learning and differential privacy. We evaluated our approach on two
different diagnostic problems using thousands of histology whole slide images
with only slide-level labels. Additionally, we present a weakly-supervised
learning framework for survival prediction and patient stratification from
whole slide images and demonstrate its effectiveness in a federated setting.
Our results show that using federated learning, we can effectively develop
accurate weakly supervised deep learning models from distributed data silos
without direct data sharing and its associated complexities, while also
preserving differential privacy using randomized noise generation.
Related papers
- Beyond Multiple Instance Learning: Full Resolution All-In-Memory End-To-End Pathology Slide Modeling [1.063200750366449]
We propose a novel approach to jointly train both a tile encoder and a slide-aggregator fully in memory and end-to-end at high-resolution.
While more computationally expensive, detailed quantitative validation shows promise for large-scale pre-training and fine-tuning of pathology foundation models.
arXiv Detail & Related papers (2024-03-07T19:28:58Z) - Domain Generalization for Mammographic Image Analysis with Contrastive
Learning [62.25104935889111]
The training of an efficacious deep learning model requires large data with diverse styles and qualities.
A novel contrastive learning is developed to equip the deep learning models with better style generalization capability.
The proposed method has been evaluated extensively and rigorously with mammograms from various vendor style domains and several public datasets.
arXiv Detail & Related papers (2023-04-20T11:40:21Z) - AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context
Processing for Representation Learning of Giga-pixel Images [53.29794593104923]
We present a novel concept of shared-context processing for whole slide histopathology images.
AMIGO uses the celluar graph within the tissue to provide a single representation for a patient.
We show that our model is strongly robust to missing information to an extent that it can achieve the same performance with as low as 20% of the data.
arXiv Detail & Related papers (2023-03-01T23:37:45Z) - When Accuracy Meets Privacy: Two-Stage Federated Transfer Learning
Framework in Classification of Medical Images on Limited Data: A COVID-19
Case Study [77.34726150561087]
COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources.
CNN has been widely utilized and verified in analyzing medical images.
arXiv Detail & Related papers (2022-03-24T02:09:41Z) - ContIG: Self-supervised Multimodal Contrastive Learning for Medical
Imaging with Genetics [4.907551775445731]
We propose ContIG, a self-supervised method that can learn from large datasets of unlabeled medical images and genetic data.
Our approach aligns images and several genetic modalities in the feature space using a contrastive loss.
We also perform genome-wide association studies on the features learned by our models, uncovering interesting relationships between images and genetic data.
arXiv Detail & Related papers (2021-11-26T11:06:12Z) - Generalized Multi-Task Learning from Substantially Unlabeled
Multi-Source Medical Image Data [11.061381376559053]
MultiMix is a new multi-task learning model that jointly learns disease classification and anatomical segmentation in a semi-supervised manner.
Our experiments with varying quantities of multi-source labeled data in the training sets confirm the effectiveness of MultiMix.
arXiv Detail & Related papers (2021-10-25T18:09:19Z) - Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
We propose a deep co-attention network for multi-view subspace learning.
It aims to extract both the common information and the complementary information in an adversarial setting.
In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
arXiv Detail & Related papers (2021-02-15T18:46:44Z) - Generative Adversarial U-Net for Domain-free Medical Image Augmentation [49.72048151146307]
The shortage of annotated medical images is one of the biggest challenges in the field of medical image computing.
In this paper, we develop a novel generative method named generative adversarial U-Net.
Our newly designed model is domain-free and generalizable to various medical images.
arXiv Detail & Related papers (2021-01-12T23:02:26Z) - Medical Image Harmonization Using Deep Learning Based Canonical Mapping:
Toward Robust and Generalizable Learning in Imaging [4.396671464565882]
We propose a new paradigm in which data from a diverse range of acquisition conditions are "harmonized" to a common reference domain.
We test this approach on two example problems, namely MRI-based brain age prediction and classification of schizophrenia.
arXiv Detail & Related papers (2020-10-11T22:01:37Z) - Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype
Prediction [55.94378672172967]
We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients.
We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks.
Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
arXiv Detail & Related papers (2020-09-02T02:50:30Z) - Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and
Domain Adaptation: ABIDE Results [13.615292855384729]
To train a high-quality deep learning model, the aggregation of a significant amount of patient information is required.
Due to the need to protect the privacy of patient data, it is hard to assemble a central database from multiple institutions.
Federated learning allows for population-level models to be trained without centralizing entities' data.
arXiv Detail & Related papers (2020-01-16T04:49:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.