TablePuppet: A Generic Framework for Relational Federated Learning

• URL: http://arxiv.org/abs/2403.15839v1
• Date: Sat, 23 Mar 2024 13:28:37 GMT
• Title: TablePuppet: A Generic Framework for Relational Federated Learning
• Authors: Lijie Xu, Chulin Xie, Yiran Guo, Gustavo Alonso, Bo Li, Guoliang Li, Wei Wang, Wentao Wu, Ce Zhang,
• Abstract summary: Current federated learning (FL) approaches view decentralized training data as a single table, divided among participants either horizontally (by rows) or vertically (by columns) This scenario requires intricate operations like joins and unions to obtain the training data, which is either costly or restricted by privacy concerns. We propose TablePuppet, a generic framework for RFL that decomposes the learning process into two steps: (1) learning over join (LoJ) followed by (2) learning over union (LoU)
• Score: 27.274856376963356
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Current federated learning (FL) approaches view decentralized training data as a single table, divided among participants either horizontally (by rows) or vertically (by columns). However, these approaches are inadequate for handling distributed relational tables across databases. This scenario requires intricate SQL operations like joins and unions to obtain the training data, which is either costly or restricted by privacy concerns. This raises the question: can we directly run FL on distributed relational tables? In this paper, we formalize this problem as relational federated learning (RFL). We propose TablePuppet, a generic framework for RFL that decomposes the learning process into two steps: (1) learning over join (LoJ) followed by (2) learning over union (LoU). In a nutshell, LoJ pushes learning down onto the vertical tables being joined, and LoU further pushes learning down onto the horizontal partitions of each vertical table. TablePuppet incorporates computation/communication optimizations to deal with the duplicate tuples introduced by joins, as well as differential privacy (DP) to protect against both feature and label leakages. We demonstrate the efficiency of TablePuppet in combination with two widely-used ML training algorithms, stochastic gradient descent (SGD) and alternating direction method of multipliers (ADMM), and compare their computation/communication complexity. We evaluate the SGD/ADMM algorithms developed atop TablePuppet by training diverse ML models. Our experimental results show that TablePuppet achieves model accuracy comparable to the centralized baselines running directly atop the SQL results. Moreover, ADMM takes less communication time than SGD to converge to similar model accuracy.

Related papers

• ACCIO: Table Understanding Enhanced via Contrastive Learning with Aggregations [0.0]
  ACCIO, tAble understanding enhanCed via Contrastive learnIng with aggregatiOns, is a novel approach to enhancing table understanding. ACCIO achieves competitive performance with a macro F1 score of 91.1 compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-11-07T05:35:39Z)
• Tabular Transfer Learning via Prompting LLMs [52.96022335067357]
  We propose a novel framework, Prompt to Transfer (P2T), that utilizes unlabeled (or heterogeneous) source data with large language models (LLMs) P2T identifies a column feature in a source dataset that is strongly correlated with a target task feature to create examples relevant to the target task, thus creating pseudo-demonstrations for prompts.
  arXiv  Detail & Related papers  (2024-08-09T11:30:52Z)
• OpenTab: Advancing Large Language Models as Open-domain Table Reasoners [38.29047314758911]
  OpenTab is an open-domain table reasoning framework powered by Large Language Models (LLMs) OpenTab significantly outperforms baselines in both open- and closed-domain settings, achieving up to 21.5% higher accuracy.
  arXiv  Detail & Related papers  (2024-02-22T08:01:01Z)
• Relational Deep Learning: Graph Representation Learning on Relational Databases [69.7008152388055]
  We introduce an end-to-end representation approach to learn on data laid out across multiple tables. Message Passing Graph Neural Networks can then automatically learn across the graph to extract representations that leverage all data input.
  arXiv  Detail & Related papers  (2023-12-07T18:51:41Z)
• SEMv2: Table Separation Line Detection Based on Instance Segmentation [96.36188168694781]
  We propose an accurate table structure recognizer, termed SEMv2 (SEM: Split, Embed and Merge) We address the table separation line instance-level discrimination problem and introduce a table separation line detection strategy based on conditional convolution. To comprehensively evaluate the SEMv2, we also present a more challenging dataset for table structure recognition, dubbed iFLYTAB.
  arXiv  Detail & Related papers  (2023-03-08T05:15:01Z)
• Bridge the Gap between Language models and Tabular Understanding [99.88470271644894]
  Table pretrain-then-finetune paradigm has been proposed and employed at a rapid pace after the success of pre-training in the natural language domain. Despite the promising findings, there is an input gap between pre-training and fine-tuning phases. We propose UTP, an approach that dynamically supports three types of multi-modal inputs: table-text, table, and text.
  arXiv  Detail & Related papers  (2023-02-16T15:16:55Z)
• DeepJoin: Joinable Table Discovery with Pre-trained Language Models [10.639106014582756]
  Existing approaches target equi-joins, the most common way of combining tables for creating a unified view. Deepjoin is a deep learning model for accurate and efficient joinable table discovery. Deepjoin is even more accurate than an exact solution to semantic joins when evaluated with labels from experts.
  arXiv  Detail & Related papers  (2022-12-15T02:40:57Z)
• Model Joins: Enabling Analytics Over Joins of Absent Big Tables [9.797488793708624]
  This work puts forth a framework, Model Join, addressing these challenges. The framework integrates and joins the per-table models of the absent tables. The approximation stems from the models, but not from the Model Join framework.
  arXiv  Detail & Related papers  (2022-06-21T14:28:24Z)
• TransTab: Learning Transferable Tabular Transformers Across Tables [42.859662256134584]
  Tabular data (or tables) are the most widely used data format in machine learning (ML) heavy data cleaning is required to merge disparate tables with different columns. TransTab converts each sample (a row in the table) to a generalizable embedding vector.
  arXiv  Detail & Related papers  (2022-05-19T05:34:46Z)
• Meta Clustering Learning for Large-scale Unsupervised Person Re-identification [124.54749810371986]
  We propose a "small data for big task" paradigm dubbed Meta Clustering Learning (MCL) MCL only pseudo-labels a subset of the entire unlabeled data via clustering to save computing for the first-phase training. Our method significantly saves computational cost while achieving a comparable or even better performance compared to prior works.
  arXiv  Detail & Related papers  (2021-11-19T04:10:18Z)
• Coded Stochastic ADMM for Decentralized Consensus Optimization with Edge Computing [113.52575069030192]
  Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles. Due to the limitations of communication costs and security requirements, it is of paramount importance to extract information in a decentralized manner instead of aggregating data to a fusion center. We consider the problem of learning model parameters in a multi-agent system with data locally processed via distributed edge nodes. A class of mini-batch alternating direction method of multipliers (ADMM) algorithms is explored to develop the distributed learning model.
  arXiv  Detail & Related papers  (2020-10-02T10:41:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.