Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking

• URL: http://arxiv.org/abs/2406.11920v2
• Date: Wed, 19 Jun 2024 17:47:25 GMT
• Title: Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking
• Authors: Xi Chen, Chuan Qin, Chuyu Fang, Chao Wang, Chen Zhu, Fuzhen Zhuang, Hengshu Zhu, Hui Xiong,
• Abstract summary: Job-SDF is a dataset designed to train and benchmark job-skill demand forecasting models. Based on 10.35 million public job advertisements collected from major online recruitment platforms in China between 2021 and 2023. Our dataset uniquely enables evaluating skill demand forecasting models at various granularities, including occupation, company, and regional levels.
• Score: 59.87055275344965
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In a rapidly evolving job market, skill demand forecasting is crucial as it enables policymakers and businesses to anticipate and adapt to changes, ensuring that workforce skills align with market needs, thereby enhancing productivity and competitiveness. Additionally, by identifying emerging skill requirements, it directs individuals towards relevant training and education opportunities, promoting continuous self-learning and development. However, the absence of comprehensive datasets presents a significant challenge, impeding research and the advancement of this field. To bridge this gap, we present Job-SDF, a dataset designed to train and benchmark job-skill demand forecasting models. Based on 10.35 million public job advertisements collected from major online recruitment platforms in China between 2021 and 2023, this dataset encompasses monthly recruitment demand for 2,324 types of skills across 521 companies. Our dataset uniquely enables evaluating skill demand forecasting models at various granularities, including occupation, company, and regional levels. We benchmark a range of models on this dataset, evaluating their performance in standard scenarios, in predictions focused on lower value ranges, and in the presence of structural breaks, providing new insights for further research. Our code and dataset are publicly accessible via the https://github.com/Job-SDF/benchmark.

Related papers

• GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluation [90.53485251837235]
  GIFT-Eval is a pioneering benchmark aimed at promoting evaluation across diverse datasets. GIFT-Eval encompasses 28 datasets over 144,000 time series and 177 million data points. We also provide a non-leaking pretraining dataset containing approximately 230 billion data points.
  arXiv  Detail & Related papers  (2024-10-14T11:29:38Z)
• Convergence-aware Clustered Federated Graph Learning Framework for Collaborative Inter-company Labor Market Forecasting [38.13767335441753]
  Labor market forecasting on talent demand and supply is essential for business management and economic development. Previous studies ignore the interconnection between demand-supply sequences among different companies for predicting variations. We propose a Meta-personalized Convergence-aware Clustered Federated Learning framework to provide accurate and timely collaborative talent demand and supply prediction.
  arXiv  Detail & Related papers  (2024-09-29T04:11:23Z)
• F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
  We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm. By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases. Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
  arXiv  Detail & Related papers  (2024-06-23T21:28:50Z)
• How Much Data are Enough? Investigating Dataset Requirements for Patch-Based Brain MRI Segmentation Tasks [74.21484375019334]
  Training deep neural networks reliably requires access to large-scale datasets. To mitigate both the time and financial costs associated with model development, a clear understanding of the amount of data required to train a satisfactory model is crucial. This paper proposes a strategic framework for estimating the amount of annotated data required to train patch-based segmentation networks.
  arXiv  Detail & Related papers  (2024-04-04T13:55:06Z)
• Design of Negative Sampling Strategies for Distantly Supervised Skill Extraction [19.43668931500507]
  We propose an end-to-end system for skill extraction, based on distant supervision through literal matching. We observe that using the ESCO taxonomy to select negative examples from related skills yields the biggest improvements. We release the benchmark dataset for research purposes to stimulate further research on the task.
  arXiv  Detail & Related papers  (2022-09-13T13:37:06Z)
• Forecasting Future World Events with Neural Networks [68.43460909545063]
  Autocast is a dataset containing thousands of forecasting questions and an accompanying news corpus. The news corpus is organized by date, allowing us to precisely simulate the conditions under which humans made past forecasts. We test language models on our forecasting task and find that performance is far below a human expert baseline.
  arXiv  Detail & Related papers  (2022-06-30T17:59:14Z)
• INTERN: A New Learning Paradigm Towards General Vision [117.3343347061931]
  We develop a new learning paradigm named INTERN. By learning with supervisory signals from multiple sources in multiple stages, the model being trained will develop strong generalizability. In most cases, our models, adapted with only 10% of the training data in the target domain, outperform the counterparts trained with the full set of data.
  arXiv  Detail & Related papers  (2021-11-16T18:42:50Z)
• Toward Knowledge Discovery Framework for Data Science Job Market in the United States [1.7205106391379024]
  This paper introduces a framework to analyze the job market for data science-related jobs within the US. The proposed framework includes three sub-modules allowing continuous data collection, information extraction, and a web-based visualization dashboard. The current version of this application is deployed on the web and allows individuals and institutes to investigate skills required for data science positions.
  arXiv  Detail & Related papers  (2021-06-14T21:23:15Z)
• Predicting Skill Shortages in Labor Markets: A Machine Learning Approach [7.503338065129185]
  This research implements a high-performing Machine Learning approach to predict occupational skill shortages. We compile a unique dataset of both Labor Demand and Labor Supply occupational data in Australia from 2012 to 2018. Job ads data and employment statistics were the highest performing feature sets for predicting year-to-year skills shortage changes for occupations.
  arXiv  Detail & Related papers  (2020-04-03T00:15:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.