Constraint-Driven Model Optimization: An Industry Framework for Selecting Compression and Acceleration Techniques in Modern Machine Learning Systems

• URL: http://arxiv.org/abs/2607.13735v2
• Date: Fri, 17 Jul 2026 08:40:24 GMT
• Title: Constraint-Driven Model Optimization: An Industry Framework for Selecting Compression and Acceleration Techniques in Modern Machine Learning Systems
• Abstract summary: We argue that optimization should be formulated as a constraint-driven, multi-objective engineering decision.<n>This work provides one of the first structured attempts to formalize model optimization as a constraint-aware, multi-objective engineering process.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rapid deployment of machine learning systems across cloud, edge, and enterprise environments has brought model optimization to the forefront of systems-engineering. Despite a rich literature spanning quantization, pruning, knowledge distillation, parameter-efficient fine-tuning (PEFT), and inference-time optimization, practitioners are often left navigating these techniques through heuristics rather than principled methodology. We argue that optimization should be formulated as a constraint-driven, multi-objective engineering decision and introduce a unified framework that characterizes any production deployment along five interacting constraint dimensions: data availability, latency budget, memory budget, accuracy tolerance, and retraining budget. Building on this taxonomy, we synthesize empirical gains reported across the research literature and map them to operational constraints rather than algorithmic categories. To ensure practical relevance, we selected these techniques by reviewing recent literature for methods that report measurable improvements against critical deployment bottlenecks. We propose a prescriptive decision framework and provide optimization pipelines for four representative industrial scenarios to illustrate it in practice. To the best of our knowledge, this work provides one of the first structured attempts to formalize model optimization as a constraint-aware, multi-objective engineering process, synthesizing quantitative evidence from the research literature.

Related papers

• little m: An AI Agent for Industrial Process Optimization [6.819597984555337]
  We introduce little m, an AI agent designed to assist the formulation of industrial process control models.<n>For systematic evaluation, we introduce the Industrial Process Control Benchmark (IPC-Bench), a novel dataset of 50 canonical scenarios.<n>Little m substantially outperforms state-of-the-art LLMs, generating semantically correct models.
  arXiv  Detail & Related papers  (2026-09-15T06:01:18Z)
• Token-Operations-Oriented Inference Optimization Techniques for Large Models [97.15115857661591]
  Large model inference optimization serves as a key foundation for supporting the scalable, low-cost, and highly stable operation of large model services.<n>This paper proposes for the first time a four-layer technical architecture consisting of Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion.
  arXiv  Detail & Related papers  (2026-06-18T14:33:09Z)
• Evolution of Optimization Methods: Algorithms, Scenarios, and Evaluations [98.44542103979735]
  First-order gradient descent methods, epitomized by gradient descent (SGD) and Adam, serve as the cornerstone of modern training pipelines.<n>Large-scale model training, stringent privacy requirements, and distributed learning paradigms expose critical limitations in these conventional approaches regarding privacy protection and memory efficiency.<n>We retrospectively analyze the evolutionary trajectory of deep learning optimization algorithms and present a comprehensive empirical evaluation of mainstreams across diverse model architectures and training scenarios.<n>We distill key emerging trends and fundamental design trade-offs, pinpointing promising directions for future research.
  arXiv  Detail & Related papers  (2026-04-14T17:01:36Z)
• Deep Unfolding: Recent Developments, Theory, and Design Guidelines [99.63555420898554]
  This article provides a tutorial-style overview of deep unfolding, a framework that transforms optimization algorithms into structured, trainable ML architectures.<n>We review the foundations of optimization for inference and for learning, introduce four representative design paradigms for deep unfolding, and discuss the distinctive training schemes that arise from their iterative nature.
  arXiv  Detail & Related papers  (2025-12-03T13:16:35Z)
• Data-Driven Differential Evolution in Tire Industry Extrusion: Leveraging Surrogate Models [0.0]
  This study proposes a surrogate-based, data-driven methodology for optimizing complex real-world manufacturing systems.<n>Machine learning models are employed to approximate system behavior and construct surrogate models, which are integrated into a tailored metaheuristic approach.<n>Results show that the surrogate-based optimization approach outperforms historical best configurations.
  arXiv  Detail & Related papers  (2025-07-15T10:52:45Z)
• LLM-guided Chemical Process Optimization with a Multi-Agent Approach [8.714038047141202]
  We present a multi-agent LLM framework that autonomously infers operating constraints from minimal process descriptions.<n>Our AutoGen-based framework employs OpenAI's o3 model with specialized agents for constraint generation, parameter validation, simulation, and optimization guidance.
  arXiv  Detail & Related papers  (2025-06-26T01:03:44Z)
• A Survey of Automatic Prompt Engineering: An Optimization Perspective [18.933465526053453]
  This paper presents the first comprehensive survey on automated prompt engineering through a unified optimization-theoretic lens.<n>We formalize prompt optimization as a problem over discrete, continuous, and hybrid prompt spaces.<n>We highlight underexplored frontiers in constrained optimization and agent-oriented prompt design.
  arXiv  Detail & Related papers  (2025-02-17T08:48:07Z)
• A Survey on Inference Optimization Techniques for Mixture of Experts Models [50.40325411764262]
  Large-scale Mixture of Experts (MoE) models offer enhanced model capacity and computational efficiency through conditional computation.<n> deploying and running inference on these models presents significant challenges in computational resources, latency, and energy efficiency.<n>This survey analyzes optimization techniques for MoE models across the entire system stack.
  arXiv  Detail & Related papers  (2024-12-18T14:11:15Z)
• End-to-End Learning for Fair Multiobjective Optimization Under Uncertainty [55.04219793298687]
  The Predict-Then-Forecast (PtO) paradigm in machine learning aims to maximize downstream decision quality. This paper extends the PtO methodology to optimization problems with nondifferentiable Ordered Weighted Averaging (OWA) objectives. It shows how optimization of OWA functions can be effectively integrated with parametric prediction for fair and robust optimization under uncertainty.
  arXiv  Detail & Related papers  (2024-02-12T16:33:35Z)
• Machine Learning Insides OptVerse AI Solver: Design Principles and Applications [74.67495900436728]
  We present a comprehensive study on the integration of machine learning (ML) techniques into Huawei Cloud's OptVerse AI solver. We showcase our methods for generating complex SAT and MILP instances utilizing generative models that mirror multifaceted structures of real-world problem. We detail the incorporation of state-of-the-art parameter tuning algorithms which markedly elevate solver performance.
  arXiv  Detail & Related papers  (2024-01-11T15:02:15Z)
• Designing MacPherson Suspension Architectures using Bayesian Optimization [21.295015276123962]
  Testing for compliance is performed first by computer simulation using a discipline model. Designs passing this simulation are then considered for physical prototyping. We show that the proposed approach is general, scalable, and efficient.
  arXiv  Detail & Related papers  (2022-06-17T21:50:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.