Position: A Call to Action for a Human-Centered AutoML Paradigm

• URL: http://arxiv.org/abs/2406.03348v1
• Date: Wed, 5 Jun 2024 15:05:24 GMT
• Title: Position: A Call to Action for a Human-Centered AutoML Paradigm
• Authors: Marius Lindauer, Florian Karl, Anne Klier, Julia Moosbauer, Alexander Tornede, Andreas Mueller, Frank Hutter, Matthias Feurer, Bernd Bischl,
• Abstract summary: Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) We argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems.
• Score: 83.78883610871867
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) workflows, aiding the research of new ML algorithms, and contributing to the democratization of ML by making it accessible to a broader audience. Over the past decade, commendable achievements in AutoML have primarily focused on optimizing predictive performance. This focused progress, while substantial, raises questions about how well AutoML has met its broader, original goals. In this position paper, we argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems, including their diverse roles, expectations, and expertise. We envision a more human-centered approach in future AutoML research, promoting the collaborative design of ML systems that tightly integrates the complementary strengths of human expertise and AutoML methodologies.

Related papers

• UniAutoML: A Human-Centered Framework for Unified Discriminative and Generative AutoML with Large Language Models [5.725785427377439]
  We introduce UniAutoML, a human-centered AutoML framework that unifies AutoML for both discriminative and generative tasks. The human-centered design of UniAutoML innovatively features a conversational user interface (CUI) that facilitates natural language interactions. This design enhances transparency and user control throughout the AutoML training process, allowing users to seamlessly break down or modify the model being trained.
  arXiv  Detail & Related papers  (2024-10-09T17:33:15Z)
• AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML [56.565200973244146]
  Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline. Recent works have started exploiting large language models (LLM) to lessen such burden. This paper proposes AutoML-Agent, a novel multi-agent framework tailored for full-pipeline AutoML.
  arXiv  Detail & Related papers  (2024-10-03T20:01:09Z)
• AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Tasks [39.71649832548044]
  AutoMMLab is a general-purpose LLM-empowered AutoML system that follows user's language instructions. The proposed AutoMMLab system effectively employs LLMs as the bridge to connect AutoML and OpenMMLab community. Experiments show that our AutoMMLab system is versatile and covers a wide range of mainstream tasks.
  arXiv  Detail & Related papers  (2024-02-23T14:38:19Z)
• A Multivocal Literature Review on the Benefits and Limitations of Automated Machine Learning Tools [9.69672653683112]
  We conducted a multivocal literature review, which allowed us to identify 54 sources from the academic literature and 108 sources from the grey literature reporting on AutoML benefits and limitations. Concerning the benefits, we highlight that AutoML tools can help streamline the core steps of ML. We highlight several limitations that may represent obstacles to the widespread adoption of AutoML.
  arXiv  Detail & Related papers  (2024-01-21T01:39:39Z)
• Assessing the Use of AutoML for Data-Driven Software Engineering [10.40771687966477]
  AutoML promises to automate the building of end-to-end AI/ML pipelines. Despite the growing interest and high expectations, there is a dearth of information about the extent to which AutoML is currently adopted.
  arXiv  Detail & Related papers  (2023-07-20T11:14:24Z)
• Benchmarking Automated Machine Learning Methods for Price Forecasting Applications [58.720142291102135]
  We show the possibility of substituting manually created ML pipelines with automated machine learning (AutoML) solutions. Based on the CRISP-DM process, we split the manual ML pipeline into a machine learning and non-machine learning part. We show in a case study for the industrial use case of price forecasting, that domain knowledge combined with AutoML can weaken the dependence on ML experts.
  arXiv  Detail & Related papers  (2023-04-28T10:27:38Z)
• Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML [52.86328317233883]
  We present a comprehensive overview of different ways in which fairness-related harm can arise. We highlight several open technical challenges for future work in this direction.
  arXiv  Detail & Related papers  (2023-03-15T09:40:08Z)
• OmniForce: On Human-Centered, Large Model Empowered and Cloud-Edge Collaborative AutoML System [85.8338446357469]
  We introduce OmniForce, a human-centered AutoML system that yields both human-assisted ML and ML-assisted human techniques. We show how OmniForce can put an AutoML system into practice and build adaptive AI in open-environment scenarios.
  arXiv  Detail & Related papers  (2023-03-01T13:35:22Z)
• Towards Green Automated Machine Learning: Status Quo and Future Directions [71.86820260846369]
  AutoML is being criticised for its high resource consumption. This paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly.
  arXiv  Detail & Related papers  (2021-11-10T18:57:27Z)
• Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows [10.309305727686326]
  Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today, we performed a qualitative study with participants ranging from novice hobbyists to industry researchers who use Auto-ML tools. We present insights into the benefits and deficiencies of existing tools, as well as the respective roles of the human and automation in ML.
  arXiv  Detail & Related papers  (2021-01-13T02:12:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.