Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn

• URL: http://arxiv.org/abs/2607.24783v1
• Date: Mon, 22 Jun 2026 07:42:09 GMT
• Title: Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn
• Abstract summary: Job understanding is critical to LinkedIn's mission to connect talent with opportunity.<n>We present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges.<n>Our work provides practical insights into building industry-scale text understanding systems.
• Score: 14.073644871405582
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Job understanding is critical to LinkedIn's mission of connecting talent with opportunity. This task involves transforming unstructured and noisy job postings into standardized or derived job attributes that power numerous LinkedIn products. However, building a scalable, cost-efficient, and high-performing job understanding system remains challenging. In this paper, we present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges. We begin by fine-tuning an open-source SLM using a suite of carefully curated synthetic tasks augmented with reasoning traces. These tasks jointly target taxonomy-guided classification and taxonomy-agnostic entity extraction. This allows the resulting model to acquire robust zero-shot generalization for job understanding in structured and unstructured contexts. Building upon this foundation, we introduce a multi-adapter architecture with attribute grouping to facilitate efficient task-specific adaptation while streamlining model management across diverse downstream attributes. Offline evaluations and online A/B tests demonstrate significant performance improvement while reducing operational complexity. Our work provides practical insights into building industry-scale text understanding systems.

Related papers

• Toward Effective and Reliable LLM Agents via Dynamic Ontology [21.48160246568531]
  Large model language (LLM) agents rely heavily on knowledge encoded in model parameters or presented as unstructured context.<n>This often results in incomplete evidence use and brittle multi-step decisions.<n>Ontologies offer a way to externalize domain concepts and relations as machine-interpretable structures.<n>We present OaK, an ontology-as-a- Kernel framework that dynamically constructs and refines task-oriented LLM agents.
  arXiv  Detail & Related papers  (2026-08-24T08:33:42Z)
• Knowledge-Centric Agents for Workflow Generation [73.4340391112949]
  We propose a knowledge-centric framework that learns to invert, inject, and infer with knowledge across multiple abstraction levels.<n>Our method produces with richer node diversity, more coherent structures, and higher execution success rates than existing systems.
  arXiv  Detail & Related papers  (2026-07-17T11:03:01Z)
• A Unified Structured Query Understanding Framework for Industrial Semantic Search [9.913119853395205]
  Query understanding in large-scale industrial search systems is typically implemented as a cascade of disparate, task-specific components.<n>We propose and deploy a unified structured query understanding system that consolidates these heterogeneous functions into a single Small Language Model.<n>We validate this approach through extensive offline and online tests within LinkedIn's Job Search system.
  arXiv  Detail & Related papers  (2026-05-22T19:35:15Z)
• OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models [57.94189874119267]
  Multi-Agent Systems (MAS) offer a powerful paradigm for solving complex problems.<n>Current graph learning-based design methodologies often adhere to a "one-for-one" paradigm.<n>We propose OFA-TAD, a one-for-all framework that generates adaptive collaboration graphs for any task described in natural language.
  arXiv  Detail & Related papers  (2026-01-19T12:23:44Z)
• Consistency-Aware Editing for Entity-level Unlearning in Language Models [53.522931419965424]
  We introduce a novel consistency-aware editing (CAE) framework for entity-level unlearning.<n>CAE aggregates a diverse set of prompts related to a target entity, including its attributes, relations, and adversarial paraphrases.<n>It then jointly learns a low-rank update guided by a consistency regularizer that aligns the editing directions across prompts.
  arXiv  Detail & Related papers  (2025-12-19T15:18:07Z)
• OmniStruct: Universal Text-to-Structure Generation across Diverse Schemas [57.49565459553627]
  We introduce OmniStruct, a benchmark for assessing Large Language Models' capabilities on text-to-structure tasks.<n>We collect high-quality training data via synthetic task generation to facilitate the development of efficient text-to-structure models.<n>Our experiments demonstrate the possibility of fine-tuning much smaller models on synthetic data into universal structured generation models.
  arXiv  Detail & Related papers  (2025-11-23T08:18:12Z)
• CoT Referring: Improving Referring Expression Tasks with Grounded Reasoning [67.18702329644526]
  CoT Referring enhances model reasoning across modalities through a structured, chain-of-thought training data structure.<n>We restructure the training data to enforce a new output form, providing new annotations for existing datasets.<n>We also integrate detection and segmentation capabilities into a unified MLLM framework, training it with a novel adaptive weighted loss to optimize performance.
  arXiv  Detail & Related papers  (2025-10-03T08:50:21Z)
• Powering Job Search at Scale: LLM-Enhanced Query Understanding in Job Matching Systems [10.9341814749217]
  We introduce a unified query understanding framework powered by a Large Language Model (LLM)<n>Our approach jointly models the user query and contextual signals such as profile attributes to generate structured interpretations.<n>The framework improves relevance quality in online A/B testing while significantly reducing system complexity.
  arXiv  Detail & Related papers  (2025-08-19T21:35:43Z)
• A representational framework for learning and encoding structurally enriched trajectories in complex agent environments [1.1470070927586018]
  The ability of artificial intelligence agents to make optimal decisions and generalise them to different domains and tasks is compromised in complex scenarios.<n>One way to address this issue has focused on learning efficient representations of the world and on how the actions of agents affect them in state-action transitions.<n>We propose to enhance the agent's ontology and extend the traditional conceptualisation of trajectories to provide a more nuanced view of task execution.
  arXiv  Detail & Related papers  (2025-03-17T14:04:27Z)
• Learning Task Representations from In-Context Learning [67.66042137487287]
  Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL)<n>We introduce an automated formulation for encoding task information in ICL prompts as a function of attention heads.<n>The proposed method successfully extracts task-specific information from in-context demonstrations and excels in both text and regression tasks.
  arXiv  Detail & Related papers  (2025-02-08T00:16:44Z)
• Knowledge prompt chaining for semantic modeling [0.0]
  We propose a novel automatic semantic modeling framework: Knowledge Prompt Chaining.<n>It canserialize the graph-structured knowledge and inject it into the LLMs properly.<n>Based on experimental results, our method achieves better performance than existing leading techniques.
  arXiv  Detail & Related papers  (2025-01-15T03:00:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.