Position: A Call to Action for a Human-Centered AutoML Paradigm
- URL: http://arxiv.org/abs/2406.03348v1
- Date: Wed, 5 Jun 2024 15:05:24 GMT
- Title: Position: A Call to Action for a Human-Centered AutoML Paradigm
- Authors: Marius Lindauer, Florian Karl, Anne Klier, Julia Moosbauer, Alexander Tornede, Andreas Mueller, Frank Hutter, Matthias Feurer, Bernd Bischl,
- Abstract summary: Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML)
We argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems.
- Score: 83.78883610871867
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) workflows, aiding the research of new ML algorithms, and contributing to the democratization of ML by making it accessible to a broader audience. Over the past decade, commendable achievements in AutoML have primarily focused on optimizing predictive performance. This focused progress, while substantial, raises questions about how well AutoML has met its broader, original goals. In this position paper, we argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems, including their diverse roles, expectations, and expertise. We envision a more human-centered approach in future AutoML research, promoting the collaborative design of ML systems that tightly integrates the complementary strengths of human expertise and AutoML methodologies.
Related papers
- AutoMMLab: Automatically Generating Deployable Models from Language
Instructions for Computer Vision Tasks [39.71649832548044]
AutoMMLab is a general-purpose LLM-empowered AutoML system that follows user's language instructions.
The proposed AutoMMLab system effectively employs LLMs as the bridge to connect AutoML and OpenMMLab community.
Experiments show that our AutoMMLab system is versatile and covers a wide range of mainstream tasks.
arXiv Detail & Related papers (2024-02-23T14:38:19Z) - A Multivocal Literature Review on the Benefits and Limitations of
Automated Machine Learning Tools [9.69672653683112]
We conducted a multivocal literature review, which allowed us to identify 54 sources from the academic literature and 108 sources from the grey literature reporting on AutoML benefits and limitations.
Concerning the benefits, we highlight that AutoML tools can help streamline the core steps of ML.
We highlight several limitations that may represent obstacles to the widespread adoption of AutoML.
arXiv Detail & Related papers (2024-01-21T01:39:39Z) - Assessing the Use of AutoML for Data-Driven Software Engineering [10.40771687966477]
AutoML promises to automate the building of end-to-end AI/ML pipelines.
Despite the growing interest and high expectations, there is a dearth of information about the extent to which AutoML is currently adopted.
arXiv Detail & Related papers (2023-07-20T11:14:24Z) - AutoML in the Age of Large Language Models: Current Challenges, Future
Opportunities and Risks [62.05741061393927]
We envision that the two fields can radically push the boundaries of each other through tight integration.
By highlighting conceivable synergies, but also risks, we aim to foster further exploration at the intersection of AutoML and LLMs.
arXiv Detail & Related papers (2023-06-13T19:51:22Z) - Benchmarking Automated Machine Learning Methods for Price Forecasting
Applications [58.720142291102135]
We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions.
Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part.
We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
arXiv Detail & Related papers (2023-04-28T10:27:38Z) - Can Fairness be Automated? Guidelines and Opportunities for
Fairness-aware AutoML [52.86328317233883]
We present a comprehensive overview of different ways in which fairness-related harm can arise.
We highlight several open technical challenges for future work in this direction.
arXiv Detail & Related papers (2023-03-15T09:40:08Z) - OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge
Collaborative AutoML System [85.8338446357469]
We introduce OmniForce, a human-centered AutoML system that yields both human-assisted ML and ML-assisted human techniques.
We show how OmniForce can put an AutoML system into practice and build adaptive AI in open-environment scenarios.
arXiv Detail & Related papers (2023-03-01T13:35:22Z) - The Roles and Modes of Human Interactions with Automated Machine
Learning Systems [7.670270099306412]
Automated machine learning (AutoML) systems continue to progress in both sophistication and performance.
It becomes important to understand the how' and why' of human-computer interaction (HCI) within these frameworks.
This review serves to identify key research directions aimed at better facilitating the roles and modes of human interactions with both current and future AutoML systems.
arXiv Detail & Related papers (2022-05-09T09:28:43Z) - Towards Green Automated Machine Learning: Status Quo and Future
Directions [71.86820260846369]
AutoML is being criticised for its high resource consumption.
This paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly.
arXiv Detail & Related papers (2021-11-10T18:57:27Z) - Whither AutoML? Understanding the Role of Automation in Machine Learning
Workflows [10.309305727686326]
Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning.
To understand how Auto-ML tools are used in practice today, we performed a qualitative study with participants ranging from novice hobbyists to industry researchers who use Auto-ML tools.
We present insights into the benefits and deficiencies of existing tools, as well as the respective roles of the human and automation in ML.
arXiv Detail & Related papers (2021-01-13T02:12:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.