Position: Avoid Overstretching LLMs for every Enterprise Task
- URL: http://arxiv.org/abs/2605.09365v1
- Date: Sun, 10 May 2026 06:29:34 GMT
- Title: Position: Avoid Overstretching LLMs for every Enterprise Task
- Abstract summary: We argue that AI systems should treat language models as interfaces rather than monolithic engines.<n>Our theoretical evidences show that finite computation models cannot fully capture the breadth of knowledge required for enterprise tasks.<n>Building on this, we take the position that language models should primarily be used for structured extraction in deterministic enterprise.
- Score: 3.679908170761854
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Enterprise workloads are dominated by deterministic, structured, and knowledge-dependent tasks operating under strict cost, latency, and reliability constraints. While these are often addressed through large language model (LLM) deployment or distillation into smaller models, we argue this is inefficient, unreliable, and misaligned with enterprise task structures. Instead, AI systems should treat language models as interfaces rather than monolithic engines, externalizing knowledge and computation into dedicated components for greater reliability, scalability, and transparency. Our theoretical evidences show that finite-capacity models cannot fully capture the breadth of knowledge required for enterprise tasks, creating inherent limits to efficiency and interpretability. Building on this, we take the position that language models should primarily be used for structured extraction in deterministic enterprise workflows, while computation and storage are delegated to knowledge bases and symbolic procedures. We formally demonstrate that such modular architectures are more reliable and maintainable than monolithic frameworks, offering a sustainable foundation for enterprise tasks.
Related papers
- SkillMemo: Expert-guided Skill Memory Framework for Compositional Embodied Manipulation [72.14179740056073]
Embodied visuomotor models, including Diffusion Policy (DP) and Vision-Language-Action (VLA) models, have demonstrated promising performance on robotic manipulation benchmarks.<n>We propose Skill-Based Memory (SkillMemo) framework that implicitly decomposes long-horizon demonstrations into latent atomic skills.
arXiv Detail & Related papers (2026-08-06T12:46:13Z) - Knowledge-Centric Agents for Workflow Generation [73.4340391112949]
We propose a knowledge-centric framework that learns to invert, inject, and infer with knowledge across multiple abstraction levels.<n>Our method produces with richer node diversity, more coherent structures, and higher execution success rates than existing systems.
arXiv Detail & Related papers (2026-07-17T11:03:01Z) - Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems [12.176736540015881]
Embodied intelligence systems require reusable functional modules that transform multimodal observations, robot states, human demonstrations, and task contexts.<n>This work defines these modules as embodied operators and studies them as independent yet composable units in embodied intelligence pipelines.
arXiv Detail & Related papers (2026-07-03T12:51:55Z) - Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn [14.073644871405582]
Job understanding is critical to LinkedIn's mission to connect talent with opportunity.<n>We present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges.<n>Our work provides practical insights into building industry-scale text understanding systems.
arXiv Detail & Related papers (2026-06-22T07:42:09Z) - OpenCompass: A Universal Evaluation Platform for Large Language Models [62.59671563145442]
General-purpose large language models (LLMs) have become a critical link in advancing technological development.<n>Mainstream benchmark datasets face challenges such as the diversity of task types, inconsistent evaluation criteria, and fragmentation of data and processing.<n>This paper proposes and open-source Open LLMs, a one-stop, scalable, and high-concurrency general-purpose evaluation platform.
arXiv Detail & Related papers (2026-05-19T02:50:11Z) - Information-Theoretic Limits of Reliability and Scaling in Language Models [6.658166782006281]
Large language models (LLMs) are evaluated as though perfect reliability is achievable for any task given sufficient scale.<n>We show this assumption is information-theoretically unjustified.<n>Our work formalizes the resource-complexity tradeoffs that govern model performance across domains.
arXiv Detail & Related papers (2026-05-08T06:06:18Z) - RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs [55.44696796126619]
Earth Observation systems are designed to support domain experts who often express their requirements through vague natural language.<n>A practical EO AI system must bridge the gap between ambiguous human queries and the appropriate multi-granularity visual analysis tasks.<n>We propose RemoteAgent, an agentic framework that strategically respects the capability intrinsic boundaries of MLLMs.
arXiv Detail & Related papers (2026-04-09T03:40:46Z) - Agent Skill Framework: Perspectives on the Potential of Small Language Models in Industrial Environments [14.079091139464175]
This work introduces a formal mathematical definition of the Agent Skill process, followed by a systematic evaluation of language models of varying sizes.<n>Results show that tiny models struggle with reliable skill selection, while moderately sized SLMs (approximately 12B - 30B) benefit substantially from the Agent Skill approach.
arXiv Detail & Related papers (2026-02-18T17:52:17Z) - HELP: Hierarchical Embodied Language Planner for Household Tasks [75.38606213726906]
Embodied agents tasked with complex scenarios rely heavily on robust planning capabilities.<n>Large language models equipped with extensive linguistic knowledge can play this role.<n>We propose a Hierarchical Embodied Language Planner, called HELP, consisting of a set of LLM-based agents.
arXiv Detail & Related papers (2025-12-25T15:54:08Z) - EoS-FM: Can an Ensemble of Specialist Models act as a Generalist Feature Extractor? [8.178030486012437]
We present an Ensemble-of-Specialists framework for building Remote Sensing Foundation Models (RSFMs)<n>Our method decomposes the training process into lightweight, task-specific ConvNeXtV2 specialists that can be frozen and reused.<n>Our framework sets a new direction for building scalable and efficient RSFMs.
arXiv Detail & Related papers (2025-11-26T15:52:56Z) - Automated Constraint Specification for Job Scheduling by Regulating Generative Model with Domain-Specific Representation [38.193536141447254]
This paper presents a constraint-centric architecture that regulates Large Language Models (LLMs) to perform reliable automated constraint specification for production scheduling.<n>An automated production scenario adaptation algorithm is designed and deployed to efficiently customize the architecture for specific manufacturing configurations. Experimental results demonstrate that the proposed approach successfully balances the generative capabilities of LLMs with the reliability requirements of manufacturing systems.
arXiv Detail & Related papers (2025-10-03T02:34:11Z) - Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems [39.23499993745249]
We introduce semantic integrity constraints (SICs) for specifying and enforcing correctness conditions over LLM outputs in semantic queries.<n>SICs generalize traditional database integrity constraints to semantic settings, supporting common types of constraints, such as grounding, soundness, and exclusion.<n>We present a system design for integrating SICs into query planning and runtime and discuss its realization in AI-augmented DPSs.
arXiv Detail & Related papers (2025-03-01T19:59:25Z) - Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More? [54.667202878390526]
Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases.
We introduce LOFT, a benchmark of real-world tasks requiring context up to millions of tokens designed to evaluate LCLMs' performance on in-context retrieval and reasoning.
Our findings reveal LCLMs' surprising ability to rival state-of-the-art retrieval and RAG systems, despite never having been explicitly trained for these tasks.
arXiv Detail & Related papers (2024-06-19T00:28:58Z) - Improving Open Information Extraction with Large Language Models: A
Study on Demonstration Uncertainty [52.72790059506241]
Open Information Extraction (OIE) task aims at extracting structured facts from unstructured text.
Despite the potential of large language models (LLMs) like ChatGPT as a general task solver, they lag behind state-of-the-art (supervised) methods in OIE tasks.
arXiv Detail & Related papers (2023-09-07T01:35:24Z) - Large Language Models with Controllable Working Memory [64.71038763708161]
Large language models (LLMs) have led to a series of breakthroughs in natural language processing (NLP)
What further sets these models apart is the massive amounts of world knowledge they internalize during pretraining.
How the model's world knowledge interacts with the factual information presented in the context remains under explored.
arXiv Detail & Related papers (2022-11-09T18:58:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.