Overview of the TalentCLEF 2026: Skill and Job Title Intelligence for Human Capital Management

• URL: http://arxiv.org/abs/2606.31692v1
• Date: Tue, 30 Jun 2026 14:04:59 GMT
• Title: Overview of the TalentCLEF 2026: Skill and Job Title Intelligence for Human Capital Management
• Abstract summary: TalentCLEF is an initiative aimed at advancing Natural Language Processing research in Human Capital Management.<n>This paper describes the motivation and organization of the challenge, summarizes the datasets and evaluation settings, and reports the main results obtained by the participating teams.
• Score: 2.692507586681092
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents an overview of the second edition of the TalentCLEF challenge, organized as a Lab at the Conference and Labs of the Evaluation Forum (CLEF) 2026. TalentCLEF is an initiative aimed at advancing Natural Language Processing research in Human Capital Management. The second edition of the challenge consisted of two tasks: Task A, contextualized job-person matching, focuses on identifying and ranking the most suitable candidates represented by their resumes for a given job vacancy in English and Spanish. Task B, job-skill matching with skill type classification, addresses retrieving the most relevant skills for a given job title in English and distinguishing between core and contextual skills. TalentCLEF attracted 113 registered teams and received more than 400 submissions in the two tasks, reflecting the growing interest of the research community in shared evaluation benchmarks for Human Capital Management. This paper describes the motivation and organization of the challenge, summarizes the datasets and evaluation settings, and reports the main results obtained by the participating teams.

Related papers

• TalentCLEF at CLEF2026: Skill and Job Title Intelligence for Human Capital Management [0.20209739009228475]
  This paper presents the second edition of the TalentCLEF Challenge, which will run as an evaluation lab as part of CLEF 2026.<n>The aim of TalentCLEF is to promote the development of systems and methods that use Natural Language Processing (NLP) in the field of Human Capital Management (HCM)<n>To this end, TalentCLEF establishes benchmarks where research teams can compare methods and share findings.
  arXiv  Detail & Related papers  (2026-07-22T10:51:28Z)
• SemEval-2026 Task 7: Everyday Knowledge Across Diverse Languages and Cultures [93.36078244548077]
  The task data consist of an extended version of our manually constructed BLEnD benchmark (Myung et al. 2024), covering more than 30 language-culture pairs.<n>As the task is designed strictly for evaluation, participants were not permitted to use the data for training, fine-tuning, few-shot learning, or any other form of model modification.<n>We report the results and present an analysis of the best-performing systems and the most commonly adopted approaches.
  arXiv  Detail & Related papers  (2026-05-04T13:49:44Z)
• The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking [58.93871662838964]
  The CheckThat! lab aims to advance the development of innovative technologies combating disinformation and manipulation efforts in online communication.<n>In this year's edition, the verification pipeline is at the center again with the following tasks.<n>These tasks represent challenging classification and retrieval problems as well as generation challenges at the document and span level, including multilingual settings.
  arXiv  Detail & Related papers  (2026-02-10T08:20:18Z)
• Overview of the TalentCLEF 2025: Skill and Job Title Intelligence for Human Capital Management [0.2276267460638319]
  We present TalentCLEF 2025, the first evaluation campaign focused on skill and job title intelligence.<n>The evaluations included monolingual and cross-lingual scenarios and covered the evaluation of gender bias.<n> TalentCLEF provides the first public benchmark in this field and encourages the development of robust, fair, and transferable language technologies for the labor market.
  arXiv  Detail & Related papers  (2025-07-17T16:33:57Z)
• The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval [47.46368856874347]
  CheckThat! lab aims to advance the development of technologies designed to identify and counteract online disinformation.<n>Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification.<n>In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges.
  arXiv  Detail & Related papers  (2025-03-19T02:06:07Z)
• GenAI Content Detection Task 1: English and Multilingual Machine-Generated Text Detection: AI vs. Human [71.42669028683741]
  We present a shared task on binary machine generated text detection conducted as a part of the GenAI workshop at COLING 2025.<n>The task consists of two subtasks: Monolingual (English) and Multilingual.<n>We provide a comprehensive overview of the data, a summary of the results, detailed descriptions of the participating systems, and an in-depth analysis of submissions.
  arXiv  Detail & Related papers  (2025-01-19T11:11:55Z)
• GenAI Content Detection Task 2: AI vs. Human -- Academic Essay Authenticity Challenge [12.076440946525434]
  The Academic Essay Authenticity Challenge was organized as part of the GenAI Content Detection shared tasks collocated with COLING 2025.<n>This challenge focuses on detecting machine-generated vs. human-authored essays for academic purposes.<n>The challenge involves two languages: English and Arabic.<n>This paper outlines the task formulation, details the dataset construction process, and explains the evaluation framework.
  arXiv  Detail & Related papers  (2024-12-24T08:33:44Z)
• Overview of the PromptCBLUE Shared Task in CHIP2023 [26.56584015791646]
  This paper presents an overview of the PromptC BLUE shared task held in the CHIP-2023 Conference. It provides a good testbed for Chinese open-domain or medical-domain large language models (LLMs) in general medical natural language processing. This paper describes the tasks, the datasets, evaluation metrics, and the top systems for both tasks.
  arXiv  Detail & Related papers  (2023-12-29T09:05:00Z)
• Perception Test 2023: A Summary of the First Challenge And Outcome [67.0525378209708]
  The First Perception Test challenge was held as a half-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2023. The goal was to benchmarking state-of-the-art video models on the recently proposed Perception Test benchmark. We summarise in this report the task descriptions, metrics, baselines, and results.
  arXiv  Detail & Related papers  (2023-12-20T15:12:27Z)
• ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Images [198.35937007558078]
  The competition opened on 30th December, 2022 and closed on 24th March, 2023. There are 35 participants and 91 valid submissions received for Track 1, and 15 participants and 26 valid submissions received for Track 2. According to the performance of the submissions, we believe there is still a large gap on the expected information extraction performance for complex and zero-shot scenarios.
  arXiv  Detail & Related papers  (2023-06-05T22:20:52Z)
• SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding [12.843166994677286]
  This paper presents the shared task on Multilingualaticity Detection and Sentence Embedding. It consists of two subtasks: (a) a binary classification one aimed at identifying whether a sentence contains an idiomatic expression, and (b) a task based on semantic text similarity which requires the model to adequately represent potentially idiomatic expressions in context. The task had close to 100 registered participants organised into twenty five teams making over 650 and 150 submissions in the practice and evaluation phases respectively.
  arXiv  Detail & Related papers  (2022-04-21T12:20:52Z)
• Predicting Job Titles from Job Descriptions with Multi-label Text Classification [0.0]
  We propose the multi-label classification approach for predicting relevant job titles from job description texts. We implement the Bi-GRU-LSTM-CNN with different pre-trained language models to apply for the job titles prediction problem.
  arXiv  Detail & Related papers  (2021-12-21T09:31:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.