DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning

• URL: http://arxiv.org/abs/2206.03493v1
• Date: Tue, 7 Jun 2022 12:59:39 GMT
• Title: DeepCAVE: An Interactive Analysis Tool for Automated Machine Learning
• Authors: Ren\'e Sass and Eddie Bergman and Andr\'e Biedenkapp and Frank Hutter and Marius Lindauer
• Abstract summary: DeepCAVE is an interactive framework to analyze and monitor state-of-the-art optimization procedures for AutoML easily and ad hoc. Our framework's modular and easy-to-extend nature provides users with automatically generated text, tables, and graphic visualizations.
• Score: 41.90094833178758
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated Machine Learning (AutoML) is used more than ever before to support users in determining efficient hyperparameters, neural architectures, or even full machine learning pipelines. However, users tend to mistrust the optimization process and its results due to a lack of transparency, making manual tuning still widespread. We introduce DeepCAVE, an interactive framework to analyze and monitor state-of-the-art optimization procedures for AutoML easily and ad hoc. By aiming for full and accessible transparency, DeepCAVE builds a bridge between users and AutoML and contributes to establishing trust. Our framework's modular and easy-to-extend nature provides users with automatically generated text, tables, and graphic visualizations. We show the value of DeepCAVE in an exemplary use-case of outlier detection, in which our framework makes it easy to identify problems, compare multiple runs and interpret optimization processes. The package is freely available on GitHub https://github.com/automl/DeepCAVE.

Related papers

• DeepContext: A Context-aware, Cross-platform, and Cross-framework Tool for Performance Profiling and Analysis of Deep Learning Workloads [5.987963635879264]
  This paper introduces DeepContext, a novel profiler that links program contexts across high-level Python code, deep learning frameworks, underlying libraries written in C/C++, as well as device code executed on GPUs. DeepContext incorporates measurements of both coarse- and fine-grained performance metrics for major deep learning frameworks, such as PyTorch and JAX. In addition, DeepContext integrates a novel GUI that allows users to quickly identify hotpots and an innovative automated performance analyzer that suggests users with potential optimizations based on performance metrics and program context.
  arXiv  Detail & Related papers  (2024-11-05T04:15:26Z)
• AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML [56.565200973244146]
  Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline. Recent works have started exploiting large language models (LLM) to lessen such burden. This paper proposes AutoML-Agent, a novel multi-agent framework tailored for full-pipeline AutoML.
  arXiv  Detail & Related papers  (2024-10-03T20:01:09Z)
• AutoDOViz: Human-Centered Automation for Decision Optimization [20.114066563594125]
  We present AutoDOViz, an interactive user interface for automated decision optimization (AutoDO) using reinforcement learning (RL) We report our findings from semi-structured expert interviews with DO practitioners as well as business consultants.
  arXiv  Detail & Related papers  (2023-02-19T23:06:19Z)
• AutoOED: Automated Optimal Experiment Design Platform [28.343314031971158]
  AutoOED is an Optimal Experiment Design platform powered with automated machine learning. We implement several multi-objective Bayesian optimization algorithms with state-of-the-art performance. AutoOED is open-source and written in Python.
  arXiv  Detail & Related papers  (2021-04-13T06:20:54Z)
• AutoGL: A Library for Automated Graph Learning [67.63587865669372]
  We present Automated Graph Learning (AutoGL), the first dedicated library for automated machine learning on graphs. AutoGL is open-source, easy to use, and flexible to be extended. We also present AutoGL-light, a lightweight version of AutoGL to facilitate customizing pipelines and enriching applications.
  arXiv  Detail & Related papers  (2021-04-11T10:49:23Z)
• VEGA: Towards an End-to-End Configurable AutoML Pipeline [101.07003005736719]
  VEGA is an efficient and comprehensive AutoML framework that is compatible and optimized for multiple hardware platforms. VEGA can improve the existing AutoML algorithms and discover new high-performance models against SOTA methods.
  arXiv  Detail & Related papers  (2020-11-03T06:53:53Z)
• HyperTendril: Visual Analytics for User-Driven Hyperparameter Optimization of Deep Neural Networks [36.047441272704205]
  HyperTendril is a web-based visual analytics system that supports user-driven hyperparameter tuning processes. We show how HyperTendril helps users steer their tuning processes via a longitudinal user study based on the analysis of interaction logs and in-depth interviews while we deploy our system in a professional industrial environment.
  arXiv  Detail & Related papers  (2020-09-04T09:11:08Z)
• Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL [53.40030379661183]
  Auto-PyTorch is a framework to enable fully automated deep learning (AutoDL) It combines multi-fidelity optimization with portfolio construction for warmstarting and ensembling of deep neural networks (DNNs) We show that Auto-PyTorch performs better than several state-of-the-art competitors on average.
  arXiv  Detail & Related papers  (2020-06-24T15:15:17Z)
• AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction [75.16836697734995]
  We propose a two-stage algorithm called Automatic Feature Interaction Selection (AutoFIS) AutoFIS can automatically identify important feature interactions for factorization models with computational cost just equivalent to training the target model to convergence. AutoFIS has been deployed onto the training platform of Huawei App Store recommendation service.
  arXiv  Detail & Related papers  (2020-03-25T06:53:54Z)
• PHOTONAI -- A Python API for Rapid Machine Learning Model Development [2.414341608751139]
  PHOTONAI is a high-level Python API designed to simplify and accelerate machine learning model development. It functions as a unifying framework allowing the user to easily access and combine algorithms from different toolboxes into custom algorithm sequences.
  arXiv  Detail & Related papers  (2020-02-13T10:33:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.