SkillSpan: Hard and Soft Skill Extraction from English Job Postings

• URL: http://arxiv.org/abs/2204.12811v1
• Date: Wed, 27 Apr 2022 10:07:36 GMT
• Title: SkillSpan: Hard and Soft Skill Extraction from English Job Postings
• Abstract summary: We introduce SKILLSPAN, a novel SE dataset consisting of 14.5K sentences and over 12.5K spans. We release its respective guidelines created over three different sources annotated for hard and soft skills by domain experts. Our results show that the domain-adapted models significantly outperform their non-adapted counterparts, and single-task outperforms multi-task learning.
• Score: 16.490047604583882
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Skill Extraction (SE) is an important and widely-studied task useful to gain insights into labor market dynamics. However, there is a lacuna of datasets and annotation guidelines; available datasets are few and contain crowd-sourced labels on the span-level or labels from a predefined skill inventory. To address this gap, we introduce SKILLSPAN, a novel SE dataset consisting of 14.5K sentences and over 12.5K annotated spans. We release its respective guidelines created over three different sources annotated for hard and soft skills by domain experts. We introduce a BERT baseline (Devlin et al., 2019). To improve upon this baseline, we experiment with language models that are optimized for long spans (Joshi et al., 2020; Beltagy et al., 2020), continuous pre-training on the job posting domain (Han and Eisenstein, 2019; Gururangan et al., 2020), and multi-task learning (Caruana, 1997). Our results show that the domain-adapted models significantly outperform their non-adapted counterparts, and single-task outperforms multi-task learning.

Related papers

• What Can Low Resource Languages Learn From Each Other? [4.131835597238715]
  We propose a data-efficient framework that capitalizes on a cross-script "transfer effect"<n>Our approach first derives language-specific experts from a high-resource base model, then employs task arithmetic to fuse these experts into a unified, high-performance multilingual back- bone.
  arXiv  Detail & Related papers  (2026-08-27T22:32:35Z)
• Chinese-SkillSpan: A Span-Level Dataset for ESCO-Aligned Competency Extraction from Chinese Job Ads [48.9502429544132]
  Job Skill Named Entity Recognition (JobSkillNER) aims to automatically extract key skill information from large-scale job posting data.<n>This work presents the first Chinese JobSkillNER dataset for recruitment texts.<n>We release Chinese-SkillSpan, the first Chinese JobSkillNER dataset aligned with the ESCO occupational skill standard.
  arXiv  Detail & Related papers  (2026-04-24T20:56:15Z)
• FiNERweb: Datasets and Artifacts for Scalable Multilingual Named Entity Recognition [12.125413756152833]
  We introduce FiNERweb, a dataset-creation pipeline that scales the teacher-student paradigm to 91 languages and 25 scripts.<n>Building on FineWeb-Edu, our approach trains regression models to identify NER-relevant passages and annotate them with multilingual LLMs.<n>Our experiments show that the regression model achieves more than 84 F1, and that models trained on FiNERweb obtain comparable or improved performance in zero shot transfer settings.
  arXiv  Detail & Related papers  (2025-12-15T20:36:39Z)
• The role of synthetic data in Multilingual, Multi-cultural AI systems: Lessons from Indic Languages [18.087937520281965]
  We introduce Updesh, a large-scale synthetic instruction-following dataset comprising 9.5M data points across 13 Indian languages.<n>A comprehensive evaluation incorporating both automated metrics and human annotation across 10k assessments indicates that generated data is high quality.<n>Models trained on Updesh consistently achieve significant gains on generative tasks and remain competitive on multiple-choice style NLU tasks.
  arXiv  Detail & Related papers  (2025-09-25T15:13:00Z)
• A Comparative Study of Task Adaptation Techniques of Large Language Models for Identifying Sustainable Development Goals [39.71115518041856]
  This study analyzes various proprietary and open-source text classification models for a single-label, multi-class text classification task focused on the UN's Sustainable Development Goals.<n>The results reveal that smaller models, when optimized through prompt engineering, can perform on par with larger models like OpenAI's GPT.
  arXiv  Detail & Related papers  (2025-06-18T07:42:32Z)
• LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content [9.539308087147134]
  Large Language Models (LLMs) have demonstrated remarkable success as general-purpose task solvers across various fields. This study focuses on developing a specialized LLM, LlamaLens, for analyzing news and social media content in a multilingual context. We demonstrate that LlamaLens outperforms the current state-of-the-art (SOTA) on 16 testing sets, and achieves comparable performance on 10 sets.
  arXiv  Detail & Related papers  (2024-10-20T06:37:37Z)
• Pretraining Data and Tokenizer for Indic LLM [1.7729311045335219]
  We develop a novel approach to data preparation for developing multilingual Indic large language model. Our meticulous data acquisition spans open-source and proprietary sources, including Common Crawl, Indic books, news articles, and Wikipedia. For each Indic language, we design a custom preprocessing pipeline to effectively eliminate redundant and low-quality text content.
  arXiv  Detail & Related papers  (2024-07-17T11:06:27Z)
• Multilingual Diversity Improves Vision-Language Representations [66.41030381363244]
  Pre-training on this dataset outperforms using English-only or English-dominated datasets on ImageNet. On a geographically diverse task like GeoDE, we also observe improvements across all regions, with the biggest gain coming from Africa.
  arXiv  Detail & Related papers  (2024-05-27T08:08:51Z)
• LiPost: Improved Content Understanding With Effective Use of Multi-task Contrastive Learning [2.611731148829789]
  We fine-tune a pre-trained, transformer-based LLM using multi-task contrastive learning with data from a diverse set of semantic labeling tasks. Our model outperforms the baseline on zero shot learning and offers improved multilingual support. This work provides a robust foundation for vertical teams across LinkedIn to customize and fine-tune the LLM to their specific applications.
  arXiv  Detail & Related papers  (2024-05-18T17:28:29Z)
• Data Engineering for Scaling Language Models to 128K Context [98.41554785106902]
  We study the continual pretraining recipe for scaling language models' context lengths to 128K. We find that naively upsampling longer data on certain domains like books, a common practice of existing work, gives suboptimal performance. Our recipe outperforms strong open-source long-context models and closes the gap to frontier models like GPT-4 128K.
  arXiv  Detail & Related papers  (2024-02-15T18:19:16Z)
• NNOSE: Nearest Neighbor Occupational Skill Extraction [55.22292957778972]
  We tackle the complexity in occupational skill datasets. We employ an external datastore for retrieving similar skills in a dataset-unifying manner. We observe a performance gain in predicting infrequent patterns, with substantial gains of up to 30% span-F1 in cross-dataset settings.
  arXiv  Detail & Related papers  (2024-01-30T15:18:29Z)
• Optimal Strategies to Perform Multilingual Analysis of Social Content for a Novel Dataset in the Tourism Domain [5.848712585343905]
  We evaluate few-shot, pattern-exploiting and fine-tuning machine learning techniques on large multilingual language models. We aim to ascertain the quantity of annotated examples required to achieve good performance in 3 common NLP tasks. This work paves the way for applying NLP to new domain-specific applications.
  arXiv  Detail & Related papers  (2023-11-20T13:08:21Z)
• Extreme Multi-Label Skill Extraction Training using Large Language Models [19.095612333241288]
  We describe a cost-effective approach to generate an accurate, fully synthetic labeled dataset for skill extraction. Our results show a consistent increase of between 15 to 25 percentage points in textitR-Precision@5 compared to previously published results.
  arXiv  Detail & Related papers  (2023-07-20T11:29:15Z)
• Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding [52.723297744257536]
  Pre-trained language models (LMs) have shown effectiveness in scientific literature understanding tasks. We propose a multi-task contrastive learning framework, SciMult, to facilitate common knowledge sharing across different literature understanding tasks.
  arXiv  Detail & Related papers  (2023-05-23T16:47:22Z)
• Design of Negative Sampling Strategies for Distantly Supervised Skill Extraction [19.43668931500507]
  We propose an end-to-end system for skill extraction, based on distant supervision through literal matching. We observe that using the ESCO taxonomy to select negative examples from related skills yields the biggest improvements. We release the benchmark dataset for research purposes to stimulate further research on the task.
  arXiv  Detail & Related papers  (2022-09-13T13:37:06Z)
• Transferring BERT-like Transformers' Knowledge for Authorship Verification [8.443350618722562]
  We study the effectiveness of several BERT-like transformers for the task of authorship verification. We provide new splits for PAN-2020, where training and test data are sampled from disjoint topics or authors. We show that those splits can enhance the models' capability to transfer knowledge over a new, significantly different dataset.
  arXiv  Detail & Related papers  (2021-12-09T18:57:29Z)
• Low-Resource Domain Adaptation for Compositional Task-Oriented Semantic Parsing [85.35582118010608]
  Task-oriented semantic parsing is a critical component of virtual assistants. Recent advances in deep learning have enabled several approaches to successfully parse more complex queries. We propose a novel method that outperforms a supervised neural model at a 10-fold data reduction.
  arXiv  Detail & Related papers  (2020-10-07T17:47:53Z)
• XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation [100.09099800591822]
  XGLUE is a new benchmark dataset that can be used to train large-scale cross-lingual pre-trained models. XGLUE provides 11 diversified tasks that cover both natural language understanding and generation scenarios.
  arXiv  Detail & Related papers  (2020-04-03T07:03:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.