Towards Continuous Experiment-driven MLOps

• URL: http://arxiv.org/abs/2503.03455v1
• Date: Wed, 05 Mar 2025 12:41:37 GMT
• Title: Towards Continuous Experiment-driven MLOps
• Authors: Keerthiga Rajenthiram, Milad Abdullah, Ilias Gerostathopoulos, Petr Hnetynka, Tomáš Bureš, Gerard Pons, Besim Bilalli, Anna Queralt,
• Abstract summary: There is poor support for and limited control over optimizing and evolving ML models.<n>We propose an experiment-driven MLOps approach which tackles these problems.<n>We demonstrate our approach through its realization and application in the ExtremeXP1 project.
• Score: 3.4799421102633787
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite advancements in MLOps and AutoML, ML development still remains challenging for data scientists. First, there is poor support for and limited control over optimizing and evolving ML models. Second, there is lack of efficient mechanisms for continuous evolution of ML models which would leverage the knowledge gained in previous optimizations of the same or different models. We propose an experiment-driven MLOps approach which tackles these problems. Our approach relies on the concept of an experiment, which embodies a fully controllable optimization process. It introduces full traceability and repeatability to the optimization process, allows humans to be in full control of it, and enables continuous improvement of the ML system. Importantly, it also establishes knowledge, which is carried over and built across a series of experiments and allows for improving the efficiency of experimentation over time. We demonstrate our approach through its realization and application in the ExtremeXP1 project (Horizon Europe).

Related papers

• EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment [42.41408547627677]
  EvolvingGrasp is an evolutionary grasp generation method that continuously enhances grasping performance through preference alignment. Our results validate that EvolvingGrasp enables evolutionary grasp generation, ensuring robust, physically feasible, and preference-aligned grasping in both simulation and real scenarios.
  arXiv  Detail & Related papers  (2025-03-18T15:01:47Z)
• Improving Retrospective Language Agents via Joint Policy Gradient Optimization [57.35348425288859]
  RetroAct is a framework that jointly optimize both task-planning and self-reflective evolution capabilities in language agents.<n>We develop a two-stage joint optimization process that integrates imitation learning and reinforcement learning.<n>We conduct extensive experiments across various testing environments, demonstrating RetroAct has substantial improvements in task performance and decision-making processes.
  arXiv  Detail & Related papers  (2025-03-03T12:54:54Z)
• Can Large Language Models Be Trusted as Black-Box Evolutionary Optimizers for Combinatorial Problems? [8.082897040940447]
  Large Language Models (LLMs) offer a game-changing solution with their extensive knowledge and could democratize the optimization paradigm.<n>It is therefore imperative to evaluate the suitability of LLMs as evolutionary mechanism (EVO)
  arXiv  Detail & Related papers  (2025-01-25T05:19:19Z)
• Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning [71.2981957820888]
  We propose a novel Star-Agents framework, which automates the enhancement of data quality across datasets. The framework initially generates diverse instruction data with multiple LLM agents through a bespoke sampling method. The generated data undergo a rigorous evaluation using a dual-model method that assesses both difficulty and quality.
  arXiv  Detail & Related papers  (2024-11-21T02:30:53Z)
• On-the-fly Modulation for Balanced Multimodal Learning [53.616094855778954]
  Multimodal learning is expected to boost model performance by integrating information from different modalities. The widely-used joint training strategy leads to imbalanced and under-optimized uni-modal representations. We propose On-the-fly Prediction Modulation (OPM) and On-the-fly Gradient Modulation (OGM) strategies to modulate the optimization of each modality.
  arXiv  Detail & Related papers  (2024-10-15T13:15:50Z)
• SemiEpi: Self-driving, Closed-loop Multi-Step Growth of Semiconductor Heterostructures Guided by Machine Learning [19.232018561757545]
  SemiEpi is a self-driving platform designed to execute molecular beam epitaxy (MBE) growth of semiconductor heterostructures.<n>SemiEpi identifies optimal initial conditions and proposes experiments for multi-step heterostructure growth.<n>We optimize the growth for InAs quantum dots (QDs) heterostructures to showcase the power of SemiEpi.
  arXiv  Detail & Related papers  (2024-08-07T02:19:17Z)
• A Survey on Self-Evolution of Large Language Models [116.54238664264928]
  Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. To address this issue, self-evolution approaches that enable LLMs to autonomously acquire, refine, and learn from experiences generated by the model itself are rapidly growing.
  arXiv  Detail & Related papers  (2024-04-22T17:43:23Z)
• MLXP: A Framework for Conducting Replicable Experiments in Python [63.37350735954699]
  We propose MLXP, an open-source, simple, and lightweight experiment management tool based on Python. It streamlines the experimental process with minimal overhead while ensuring a high level of practitioner overhead.
  arXiv  Detail & Related papers  (2024-02-21T14:22:20Z)
• Learning to optimize by multi-gradient for multi-objective optimization [0.0]
  We introduce a new automatic learning paradigm for optimizing MOO problems, and propose a multi-gradient learning to optimize (ML2O) method. As a learning-based method, ML2O acquires knowledge of local landscapes by leveraging information from the current step. We show that our learned outperforms hand-designed competitors on training multi-task learning (MTL) neural network.
  arXiv  Detail & Related papers  (2023-11-01T14:55:54Z)
• Exploring MLOps Dynamics: An Experimental Analysis in a Real-World Machine Learning Project [0.0]
  The experiment involves a comprehensive MLOps workflow, covering essential phases like problem definition, data acquisition, data preparation, model development, model deployment, monitoring, management, scalability, and governance and compliance. A systematic tracking approach was employed to document revisits to specific phases from a main phase under focus, capturing the reasons for such revisits. The resulting data provides visual representations of the MLOps process's interdependencies and iterative characteristics within the experimental framework.
  arXiv  Detail & Related papers  (2023-07-22T10:33:19Z)
• Machine Learning with Knowledge Constraints for Process Optimization of Open-Air Perovskite Solar Cell Manufacturing [5.240805076177176]
  We present an ML framework of sequential learning for manufacturing process optimization. We apply our methodology to the Rapid Spray Plasma Processing (RSPP) technique for perovskite thin films in ambient conditions. With a limited experimental budget of screening 100 conditions process conditions, we demonstrated an efficiency improvement to 18.5% for the best performing device.
  arXiv  Detail & Related papers  (2021-10-01T00:36:56Z)
• Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resources [78.72922528736011]
  We propose a novel approach, black-box adversarial reprogramming (BAR), that repurposes a well-trained black-box machine learning model. Using zeroth order optimization and multi-label mapping techniques, BAR can reprogram a black-box ML model solely based on its input-output responses. BAR outperforms state-of-the-art methods and yields comparable performance to the vanilla adversarial reprogramming method.
  arXiv  Detail & Related papers  (2020-07-17T01:52:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.