Federated Transfer Learning: concept and applications
- URL: http://arxiv.org/abs/2010.15561v3
- Date: Sat, 6 Mar 2021 10:20:25 GMT
- Title: Federated Transfer Learning: concept and applications
- Authors: Sudipan Saha and Tahir Ahmad
- Abstract summary: Federated transfer learning (FTL) allows knowledge to be transferred across domains that do not have many overlapping features and users.
In this work we study the background of FTL and its different existing applications.
We further analyze FTL from privacy and machine learning perspective.
- Score: 2.474754293747645
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Development of Artificial Intelligence (AI) is inherently tied to the
development of data. However, in most industries data exists in form of
isolated islands, with limited scope of sharing between different
organizations. This is an hindrance to the further development of AI. Federated
learning has emerged as a possible solution to this problem in the last few
years without compromising user privacy. Among different variants of the
federated learning, noteworthy is federated transfer learning (FTL) that allows
knowledge to be transferred across domains that do not have many overlapping
features and users. In this work we provide a comprehensive survey of the
existing works on this topic. In more details, we study the background of FTL
and its different existing applications. We further analyze FTL from privacy
and machine learning perspective.
Related papers
- Private Knowledge Sharing in Distributed Learning: A Survey [50.51431815732716]
The rise of Artificial Intelligence has revolutionized numerous industries and transformed the way society operates.
It is crucial to utilize information in learning processes that are either distributed or owned by different entities.
Modern data-driven services have been developed to integrate distributed knowledge entities into their outcomes.
arXiv Detail & Related papers (2024-02-08T07:18:23Z) - Prototype of deployment of Federated Learning with IoT devices [0.0]
A huge amount of the resource desired, data, is stored in mobile devices, sensors and other Internet of Things (IoT) devices.
At the same time these devices do not have enough data or computational capacity to train good models.
Federated Learning (FL) provides an innovative solution that allows devices to learn in a collaborative way.
arXiv Detail & Related papers (2023-11-24T10:37:30Z) - Federated Learning and Meta Learning: Approaches, Applications, and
Directions [94.68423258028285]
In this tutorial, we present a comprehensive review of FL, meta learning, and federated meta learning (FedMeta)
Unlike other tutorial papers, our objective is to explore how FL, meta learning, and FedMeta methodologies can be designed, optimized, and evolved, and their applications over wireless networks.
arXiv Detail & Related papers (2022-10-24T10:59:29Z) - Towards Federated Long-Tailed Learning [76.50892783088702]
Data privacy and class imbalance are the norm rather than the exception in many machine learning tasks.
Recent attempts have been launched to, on one side, address the problem of learning from pervasive private data, and on the other side, learn from long-tailed data.
This paper focuses on learning with long-tailed (LT) data distributions under the context of the popular privacy-preserved federated learning (FL) framework.
arXiv Detail & Related papers (2022-06-30T02:34:22Z) - Federated Learning: Issues in Medical Application [0.7598921989525735]
Since the federated learning, which makes AI learning possible without moving local data around, was introduced by google in 2017 it has been actively studied particularly in the field of medicine.
The idea of machine learning in AI without collecting data from local clients is very attractive because data remain in local sites.
However, federated learning techniques still have various open issues due to its own characteristics such as non identical distribution, client participation management, and vulnerable environments.
arXiv Detail & Related papers (2021-09-01T06:04:08Z) - Concept drift detection and adaptation for federated and continual
learning [55.41644538483948]
Smart devices can collect vast amounts of data from their environment.
This data is suitable for training machine learning models, which can significantly improve their behavior.
In this work, we present a new method, called Concept-Drift-Aware Federated Averaging.
arXiv Detail & Related papers (2021-05-27T17:01:58Z) - The FeatureCloud AI Store for Federated Learning in Biomedicine and
Beyond [0.7517525791460022]
Privacy-preserving methods, such as Federated Learning (FL), allow for training ML models without sharing sensitive data.
We present the FeatureCloud AI Store for FL as an all-in-one platform for biomedical research and other applications.
arXiv Detail & Related papers (2021-05-12T15:31:46Z) - What is being transferred in transfer learning? [51.6991244438545]
We show that when training from pre-trained weights, the model stays in the same basin in the loss landscape.
We present that when training from pre-trained weights, the model stays in the same basin in the loss landscape and different instances of such model are similar in feature space and close in parameter space.
arXiv Detail & Related papers (2020-08-26T17:23:40Z) - Federated and continual learning for classification tasks in a society
of devices [59.45414406974091]
Light Federated and Continual Consensus (LFedCon2) is a new federated and continual architecture that uses light, traditional learners.
Our method allows powerless devices (such as smartphones or robots) to learn in real time, locally, continuously, autonomously and from users.
In order to test our proposal, we have applied it in a heterogeneous community of smartphone users to solve the problem of walking recognition.
arXiv Detail & Related papers (2020-06-12T12:37:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.