Retrieval-as-a-Service:A System-Oriented Analysis of Industrial Retrieval Pipelines in Web Systems

• URL: http://arxiv.org/abs/2606.14932v1
• Date: Fri, 12 Jun 2026 20:10:02 GMT
• Title: Retrieval-as-a-Service:A System-Oriented Analysis of Industrial Retrieval Pipelines in Web Systems
• Abstract summary: Retrieval systems have become a foundational infrastructure component in modern Web services.<n>In large-scale industrial environments, retrieval is increasingly deployed as an independent service layer.<n>This paper focuses on architectural design and deployment trade-offs under real-world constraints.
• Score: 5.990455845813845
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Retrieval systems have become a foundational infrastructure component in modern Web services, supporting applications such as content recommendation, advertising targeting, and API discovery. In large-scale industrial environments, retrieval is increasingly deployed as an independent service layer, commonly referred to as Retrieval-as-a-Service (RaaS). This paper presents a system-oriented survey of industrial retrieval pipelines, focusing on architectural design and deployment trade-offs under real-world constraints. Unlike prior surveys that emphasize algorithmic developments, we analyze retrieval systems from an infrastructure perspective, highlighting how latency requirements, scalability constraints, and resource limitations shape system design in production environments. We introduce a unified RaaS pipeline abstraction that models retrieval as a multi-stage service, including high-efficiency candidate generation, embedding-based semantic matching, and resource-aware re-ranking. We further examine the integration of Large Language Model (LLM)-based retrieval mechanisms and analyze their impact on semantic performance, latency, and computational overhead. The results provide a system-level understanding of retrieval as a service-oriented infrastructure and offer practical guidelines for designing scalable, efficient, and QoS-aware retrieval architectures in large-scale Web systems.

Related papers

• A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design [71.32556809242666]
  The rapid expansion of large-scale AI models has led to significant performance breakthroughs across diverse domains.<n>It has also raised critical concerns regarding computational costs, energy consumption, and environmental sustainability.<n>This survey aims to offer a holistic roadmap toward sustainable, scalable, and socially responsible development of large models.
  arXiv  Detail & Related papers  (2026-07-10T04:02:22Z)
• A Unified Structured Query Understanding Framework for Industrial Semantic Search [9.913119853395205]
  Query understanding in large-scale industrial search systems is typically implemented as a cascade of disparate, task-specific components.<n>We propose and deploy a unified structured query understanding system that consolidates these heterogeneous functions into a single Small Language Model.<n>We validate this approach through extensive offline and online tests within LinkedIn's Job Search system.
  arXiv  Detail & Related papers  (2026-05-22T19:35:15Z)
• ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development [72.4729759618632]
  We introduce ABC-Bench, a benchmark to evaluate agentic backend coding within a realistic, executable workflow.<n>We curated 224 practical tasks spanning 8 languages and 19 frameworks from open-source repositories.<n>Our evaluation reveals that even state-of-the-art models struggle to deliver reliable performance on these holistic tasks.
  arXiv  Detail & Related papers  (2026-01-16T08:23:52Z)
• FLAS: a combination of proactive and reactive auto-scaling architecture for distributed services [0.0]
  We present FLAS (Forecasted Load Auto-Scaling), an auto-scaler for distributed services.<n>It combines the advantages of proactive and reactive approaches according to the situation to decide the optimal scaling actions.<n>We provide a FLAS implementation for the use case of a content-based publish-subscribe distributed systems.
  arXiv  Detail & Related papers  (2025-10-23T09:38:07Z)
• Deep Research Agents: A Systematic Examination And Roadmap [109.53237992384872]
  Deep Research (DR) agents are designed to tackle complex, multi-turn informational research tasks.<n>In this paper, we conduct a detailed analysis of the foundational technologies and architectural components that constitute DR agents.
  arXiv  Detail & Related papers  (2025-06-22T16:52:48Z)
• Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey [58.50944604905037]
  Edge-cloud collaborative computing (ECCC) has emerged as a pivotal paradigm for addressing the computational demands of modern intelligent applications.<n>Recent advancements in AI, particularly deep learning and large language models (LLMs), have dramatically enhanced the capabilities of these distributed systems.<n>This survey provides a structured tutorial on fundamental architectures, enabling technologies, and emerging applications.
  arXiv  Detail & Related papers  (2025-05-03T13:55:38Z)
• Adopting Large Language Models to Automated System Integration [0.0]
  We introduce a software architecture for automated service composition using Large Language Models (LLMs)<n>We propose a novel natural language query-based benchmark for service discovery.<n>We extend the benchmark to complete service composition scenarios.
  arXiv  Detail & Related papers  (2025-04-11T12:42:01Z)
• DNS-Rec: Data-aware Neural Architecture Search for Recommender Systems [79.76519917171261]
  This paper addresses the computational overhead and resource inefficiency prevalent in Sequential Recommender Systems (SRSs)<n>We introduce an innovative approach combining pruning methods with advanced model designs.<n>Our principal contribution is the development of a Data-aware Neural Architecture Search for Recommender System (DNS-Rec)
  arXiv  Detail & Related papers  (2024-02-01T07:22:52Z)
• Distributed intelligence on the Edge-to-Cloud Continuum: A systematic literature review [62.997667081978825]
  This review aims at providing a comprehensive vision of the main state-of-the-art libraries and frameworks for machine learning and data analytics available today. The main simulation, emulation, deployment systems, and testbeds for experimental research on the Edge-to-Cloud Continuum available today are also surveyed.
  arXiv  Detail & Related papers  (2022-04-29T08:06:05Z)
• Machine Learning-based Orchestration of Containers: A Taxonomy and Future Directions [25.763692543206773]
  Existing mainstream cloud service providers have prevalently adopted container technologies in their distributed system infrastructures for automated application management. To handle the automation of deployment, maintenance, autoscaling, and networking of containerized applications, container orchestration is proposed as an essential research problem. In this paper, we present a comprehensive review of existing machine learning-based container orchestration approaches.
  arXiv  Detail & Related papers  (2021-06-24T02:55:35Z)
• Performance Analysis of Deep Learning Workloads on a Composable System [0.08388591755871731]
  Composable infrastructure is defined as resources, such as compute, storage, accelerators and networking, that are shared in a pool. This paper details the design of an enterprise composable infrastructure that we have implemented and made available to our partners in the IBM Research AI Hardware Center.
  arXiv  Detail & Related papers  (2021-03-19T17:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.