Convergence-aware Clustered Federated Graph Learning Framework for Collaborative Inter-company Labor Market Forecasting

• URL: http://arxiv.org/abs/2409.19545v1
• Date: Sun, 29 Sep 2024 04:11:23 GMT
• Title: Convergence-aware Clustered Federated Graph Learning Framework for Collaborative Inter-company Labor Market Forecasting
• Authors: Zhuoning Guo, Hao Liu, Le Zhang, Qi Zhang, Hengshu Zhu, Hui Xiong,
• Abstract summary: Labor market forecasting on talent demand and supply is essential for business management and economic development. Previous studies ignore the interconnection between demand-supply sequences among different companies for predicting variations. We propose a Meta-personalized Convergence-aware Clustered Federated Learning framework to provide accurate and timely collaborative talent demand and supply prediction.
• Score: 38.13767335441753
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Labor market forecasting on talent demand and supply is essential for business management and economic development. With accurate and timely forecasts, employers can adapt their recruitment strategies to align with the evolving labor market, and employees can have proactive career path planning according to future demand and supply. However, previous studies ignore the interconnection between demand-supply sequences among different companies and positions for predicting variations. Moreover, companies are reluctant to share their private human resource data for global labor market analysis due to concerns over jeopardizing competitive advantage, security threats, and potential ethical or legal violations. To this end, in this paper, we formulate the Federated Labor Market Forecasting (FedLMF) problem and propose a Meta-personalized Convergence-aware Clustered Federated Learning (MPCAC-FL) framework to provide accurate and timely collaborative talent demand and supply prediction in a privacy-preserving way. First, we design a graph-based sequential model to capture the inherent correlation between demand and supply sequences and company-position pairs. Second, we adopt meta-learning techniques to learn effective initial model parameters that can be shared across companies, allowing personalized models to be optimized for forecasting company-specific demand and supply, even when companies have heterogeneous data. Third, we devise a Convergence-aware Clustering algorithm to dynamically divide companies into groups according to model similarity and apply federated aggregation in each group. The heterogeneity can be alleviated for more stable convergence and better performance. Extensive experiments demonstrate that MPCAC-FL outperforms compared baselines on three real-world datasets and achieves over 97% of the state-of-the-art model, i.e., DH-GEM, without exposing private company data.

Related papers

• F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
  We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm. By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases. Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
  arXiv  Detail & Related papers  (2024-06-23T21:28:50Z)
• Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking [59.87055275344965]
  Job-SDF is a dataset designed to train and benchmark job-skill demand forecasting models. Based on 10.35 million public job advertisements collected from major online recruitment platforms in China between 2021 and 2023. Our dataset uniquely enables evaluating skill demand forecasting models at various granularities, including occupation, company, and regional levels.
  arXiv  Detail & Related papers  (2024-06-17T07:22:51Z)
• Building Socially-Equitable Public Models [32.35090986784889]
  Public models offer predictions to a variety of downstream tasks and have played a crucial role in various AI applications. We advocate for integrating the objectives of downstream agents into the optimization process. We propose a novel Equitable Objective to address performance disparities and foster fairness among heterogeneous agents in training.
  arXiv  Detail & Related papers  (2024-06-04T21:27:43Z)
• By Fair Means or Foul: Quantifying Collusion in a Market Simulation with Deep Reinforcement Learning [1.5249435285717095]
  This research employs an experimental oligopoly model of repeated price competition. We investigate the strategies and emerging pricing patterns developed by the agents, which may lead to a collusive outcome. Our findings indicate that RL-based AI agents converge to a collusive state characterized by the charging of supracompetitive prices.
  arXiv  Detail & Related papers  (2024-06-04T15:35:08Z)
• A Deep Learning Method for Predicting Mergers and Acquisitions: Temporal Dynamic Industry Networks [0.0]
  An effective M&A predictive model should offer deal-level predictions without requiring ad-hoc feature engineering or data rebalancing. Due to the sparsity of M&A events, existing models require data rebalancing, which introduces bias and limits their real-world applicability. We propose a Temporal Dynamic Industry Network (TDIN) model, leveraging temporal point processes and deep learning to capture complex M&A interdependencies.
  arXiv  Detail & Related papers  (2024-04-10T18:48:19Z)
• The Effects of Data Imbalance Under a Federated Learning Approach for Credit Risk Forecasting [0.0]
  Credit risk forecasting plays a crucial role for commercial banks and other financial institutions in granting loans to customers. Traditional machine learning methods require the sharing of sensitive client information with an external server to build a global model. A newly developed privacy-preserving distributed machine learning technique known as Federated Learning (FL) allows the training of a global model without the necessity of accessing private local data directly.
  arXiv  Detail & Related papers  (2024-01-14T09:15:10Z)
• PAGE: Equilibrate Personalization and Generalization in Federated Learning [13.187836371243385]
  Federated learning (FL) is becoming a major driving force behind machine learning as a service. We propose the first algorithm to balance personalization and generalization on top of game theory, dubbed PAGE. Experiments show that PAGE outperforms state-of-the-art FL baselines in terms of global and local prediction accuracy simultaneously.
  arXiv  Detail & Related papers  (2023-10-13T09:11:35Z)
• Finding Regularized Competitive Equilibria of Heterogeneous Agent Macroeconomic Models with Reinforcement Learning [151.03738099494765]
  We study a heterogeneous agent macroeconomic model with an infinite number of households and firms competing in a labor market. We propose a data-driven reinforcement learning framework that finds the regularized competitive equilibrium of the model.
  arXiv  Detail & Related papers  (2023-02-24T17:16:27Z)
• FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning [87.08902493524556]
  Federated learning(FL) has recently attracted increasing attention from academia and industry. We propose FedDM to build the global training objective from multiple local surrogate functions. In detail, we construct synthetic sets of data on each client to locally match the loss landscape from original data.
  arXiv  Detail & Related papers  (2022-07-20T04:55:18Z)
• Test-time Collective Prediction [73.74982509510961]
  Multiple parties in machine learning want to jointly make predictions on future test points. Agents wish to benefit from the collective expertise of the full set of agents, but may not be willing to release their data or model parameters. We explore a decentralized mechanism to make collective predictions at test time, leveraging each agent's pre-trained model.
  arXiv  Detail & Related papers  (2021-06-22T18:29:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.