Hyperparameter Tuning Cookbook: A guide for scikit-learn, PyTorch, river, and spotPython

• URL: http://arxiv.org/abs/2307.10262v1
• Date: Mon, 17 Jul 2023 16:20:27 GMT
• Title: Hyperparameter Tuning Cookbook: A guide for scikit-learn, PyTorch, river, and spotPython
• Authors: Thomas Bartz-Beielstein
• Abstract summary: This document provides a guide to hyperparameter tuning using spotPython for scikit-learn, PyTorch, and river. With a hands-on approach and step-by-step explanations, this cookbook serves as a practical starting point.
• Score: 0.20305676256390928
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This document provides a comprehensive guide to hyperparameter tuning using spotPython for scikit-learn, PyTorch, and river. The first part introduces spotPython's surrogate model-based optimization process, while the second part focuses on hyperparameter tuning. Several case studies are presented, including hyperparameter tuning for sklearn models such as Support Vector Classification, Random Forests, Gradient Boosting (XGB), and K-nearest neighbors (KNN), as well as a Hoeffding Adaptive Tree Regressor from river. The integration of spotPython into the PyTorch and PyTorch Lightning training workflow is also discussed. With a hands-on approach and step-by-step explanations, this cookbook serves as a practical starting point for anyone interested in hyperparameter tuning with Python. Highlights include the interplay between Tensorboard, PyTorch Lightning, spotPython, and river. This publication is under development, with updates available on the corresponding webpage.

Related papers

• BARMPy: Bayesian Additive Regression Models Python Package [0.0]
  We make Bayesian Additive Regression Networks (BARN) available as a Python package, textttbarmpy, with documentation. textttbarmpy also serves as a baseline Python library for generic Bayesian Additive Regression Models.
  arXiv  Detail & Related papers  (2024-04-06T21:51:53Z)
• pyvene: A Library for Understanding and Improving PyTorch Models via Interventions [79.72930339711478]
  $textbfpyvene$ is an open-source library that supports customizable interventions on a range of different PyTorch modules. We show how $textbfpyvene$ provides a unified framework for performing interventions on neural models and sharing the intervened upon models with others.
  arXiv  Detail & Related papers  (2024-03-12T16:46:54Z)
• TopoX: A Suite of Python Packages for Machine Learning on Topological Domains [89.9320422266332]
  TopoX is a Python software suite that provides reliable and user-friendly building blocks for computing and machine learning on topological domains. TopoX consists of three packages: TopoNetX, TopoEmbedX and TopoModelx.
  arXiv  Detail & Related papers  (2024-02-04T10:41:40Z)
• PyTorch Hyperparameter Tuning - A Tutorial for spotPython [0.20305676256390928]
  This tutorial includes a brief comparison with Ray Tune, a Python library for running experiments and tuning hyperparameters. We show that spotPython achieves similar or even better results while being more flexible and transparent than Ray Tune.
  arXiv  Detail & Related papers  (2023-05-19T17:47:50Z)
• PyHopper -- Hyperparameter optimization [51.40201315676902]
  We present PyHopper, a black-box optimization platform for machine learning researchers. PyHopper's goal is to integrate with existing code with minimal effort and run the optimization process with minimal necessary manual oversight. With simplicity as the primary theme, PyHopper is powered by a single robust Markov-chain Monte-Carlo optimization algorithm.
  arXiv  Detail & Related papers  (2022-10-10T14:35:01Z)
• PyHHMM: A Python Library for Heterogeneous Hidden Markov Models [63.01207205641885]
  PyHHMM is an object-oriented Python implementation of Heterogeneous-Hidden Markov Models (HHMMs) PyHHMM emphasizes features not supported in similar available frameworks: a heterogeneous observation model, missing data inference, different model order selection criterias, and semi-supervised training. PyHHMM relies on the numpy, scipy, scikit-learn, and seaborn Python packages, and is distributed under the Apache-2.0 License.
  arXiv  Detail & Related papers  (2022-01-12T07:32:36Z)
• Using Python for Model Inference in Deep Learning [0.6027358520885614]
  We show how it is possible to meet performance and packaging constraints while performing inference in Python. We present a way of using multiple Python interpreters within a single process to achieve scalable inference.
  arXiv  Detail & Related papers  (2021-04-01T04:48:52Z)
• PyLightcurve-torch: a transit modelling package for deep learning applications in PyTorch [0.0]
  We present a new open source python package, based on PyLightcurve and PyTorch. It is tailored for efficient computation and automatic differentiation of exoplanetary transits.
  arXiv  Detail & Related papers  (2020-11-03T22:05:41Z)
• MOGPTK: The Multi-Output Gaussian Process Toolkit [71.08576457371433]
  We present MOGPTK, a Python package for multi-channel data modelling using Gaussian processes (GP) The aim of this toolkit is to make multi-output GP (MOGP) models accessible to researchers, data scientists, and practitioners alike.
  arXiv  Detail & Related papers  (2020-02-09T23:34:49Z)
• OPFython: A Python-Inspired Optimum-Path Forest Classifier [68.8204255655161]
  This paper proposes a Python-based Optimum-Path Forest framework, denoted as OPFython. As OPFython is a Python-based library, it provides a more friendly environment and a faster prototyping workspace than the C language.
  arXiv  Detail & Related papers  (2020-01-28T15:46:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.