Automated Machine Learning -- a brief review at the end of the early
years
- URL: http://arxiv.org/abs/2008.08516v3
- Date: Mon, 24 Aug 2020 14:45:40 GMT
- Title: Automated Machine Learning -- a brief review at the end of the early
years
- Authors: Hugo Jair Escalante
- Abstract summary: Automated machine learning (AutoML) is the sub-field of machine learning that aims at automating, to some extend, all stages of the design of a machine learning system.
In the context of supervised learning, AutoML is concerned with feature extraction, pre processing, model design and post processing.
- Score: 14.211962590104111
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automated machine learning (AutoML) is the sub-field of machine learning that
aims at automating, to some extend, all stages of the design of a machine
learning system. In the context of supervised learning, AutoML is concerned
with feature extraction, pre processing, model design and post processing.
Major contributions and achievements in AutoML have been taking place during
the recent decade. We are therefore in perfect timing to look back and realize
what we have learned. This chapter aims to summarize the main findings in the
early years of AutoML. More specifically, in this chapter an introduction to
AutoML for supervised learning is provided and an historical review of progress
in this field is presented. Likewise, the main paradigms of AutoML are
described and research opportunities are outlined.
Related papers
- Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques [17.62426370778165]
The paper is structured to assist both beginners and experienced practitioners, with detailed discussions on popular AutoML tools.
It also addresses emerging topics like Neural Architecture Search (NAS) and AutoML's applications in deep learning.
arXiv Detail & Related papers (2024-10-12T17:11:39Z) - Position: A Call to Action for a Human-Centered AutoML Paradigm [83.78883610871867]
Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML)
We argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems.
arXiv Detail & Related papers (2024-06-05T15:05:24Z) - A General Recipe for Automated Machine Learning in Practice [0.0]
We propose a frame of reference for building general AutoML systems.
Our main idea is to distill the fundamental concepts in order to support them in a single design.
We discuss some open problems related to the application of AutoML for future research.
arXiv Detail & Related papers (2023-08-29T21:49:28Z) - The Devil is in the Errors: Leveraging Large Language Models for
Fine-grained Machine Translation Evaluation [93.01964988474755]
AutoMQM is a prompting technique which asks large language models to identify and categorize errors in translations.
We study the impact of labeled data through in-context learning and finetuning.
We then evaluate AutoMQM with PaLM-2 models, and we find that it improves performance compared to just prompting for scores.
arXiv Detail & Related papers (2023-08-14T17:17:21Z) - Benchmarking Automated Machine Learning Methods for Price Forecasting
Applications [58.720142291102135]
We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions.
Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part.
We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
arXiv Detail & Related papers (2023-04-28T10:27:38Z) - Towards Green Automated Machine Learning: Status Quo and Future
Directions [71.86820260846369]
AutoML is being criticised for its high resource consumption.
This paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly.
arXiv Detail & Related papers (2021-11-10T18:57:27Z) - Automated Machine Learning on Graphs: A Survey [81.21692888288658]
This paper is the first systematic and comprehensive review of automated machine learning on graphs.
We focus on hyper- parameter optimization (HPO) and neural architecture search (NAS) for graph machine learning.
In the end, we share our insights on future research directions for automated graph machine learning.
arXiv Detail & Related papers (2021-03-01T04:20:33Z) - A Neophyte With AutoML: Evaluating the Promises of Automatic Machine
Learning Tools [1.713291434132985]
This paper discusses modern Auto Machine Learning (AutoML) tools from the perspective of a person with little prior experience in Machine Learning (ML)
There are many AutoML tools both ready-to-use and under development, which are created to simplify and democratize usage of ML technologies in everyday life.
arXiv Detail & Related papers (2021-01-14T19:28:57Z) - AutoML to Date and Beyond: Challenges and Opportunities [30.60364966752454]
AutoML tools aim to make machine learning accessible for non-machine learning experts.
We introduce a new classification system for AutoML systems.
We lay out a roadmap for the future, pinpointing the research required to further automate the end-to-end machine learning pipeline.
arXiv Detail & Related papers (2020-10-21T06:08:21Z) - Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning [45.643809726832764]
We introduce new AutoML approaches motivated by our winning submission to the second ChaLearn AutoML challenge.
We develop PoSH Auto-sklearn, which enables AutoML systems to work well on large datasets under rigid time limits.
We also propose a solution towards truly hands-free AutoML.
arXiv Detail & Related papers (2020-07-08T12:41:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.