The Roles and Modes of Human Interactions with Automated Machine Learning Systems

• URL: http://arxiv.org/abs/2205.04139v1
• Date: Mon, 9 May 2022 09:28:43 GMT
• Title: The Roles and Modes of Human Interactions with Automated Machine Learning Systems
• Authors: Thanh Tung Khuat, David Jacob Kedziora, Bogdan Gabrys
• Abstract summary: Automated machine learning (AutoML) systems continue to progress in both sophistication and performance. It becomes important to understand the how' and why' of human-computer interaction (HCI) within these frameworks. This review serves to identify key research directions aimed at better facilitating the roles and modes of human interactions with both current and future AutoML systems.
• Score: 7.670270099306412
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: As automated machine learning (AutoML) systems continue to progress in both sophistication and performance, it becomes important to understand the `how' and `why' of human-computer interaction (HCI) within these frameworks, both current and expected. Such a discussion is necessary for optimal system design, leveraging advanced data-processing capabilities to support decision-making involving humans, but it is also key to identifying the opportunities and risks presented by ever-increasing levels of machine autonomy. Within this context, we focus on the following questions: (i) How does HCI currently look like for state-of-the-art AutoML algorithms, especially during the stages of development, deployment, and maintenance? (ii) Do the expectations of HCI within AutoML frameworks vary for different types of users and stakeholders? (iii) How can HCI be managed so that AutoML solutions acquire human trust and broad acceptance? (iv) As AutoML systems become more autonomous and capable of learning from complex open-ended environments, will the fundamental nature of HCI evolve? To consider these questions, we project existing literature in HCI into the space of AutoML; this connection has, to date, largely been unexplored. In so doing, we review topics including user-interface design, human-bias mitigation, and trust in artificial intelligence (AI). Additionally, to rigorously gauge the future of HCI, we contemplate how AutoML may manifest in effectively open-ended environments. This discussion necessarily reviews projected developmental pathways for AutoML, such as the incorporation of reasoning, although the focus remains on how and why HCI may occur in such a framework rather than on any implementational details. Ultimately, this review serves to identify key research directions aimed at better facilitating the roles and modes of human interactions with both current and future AutoML systems.

Related papers

• Position: A Call to Action for a Human-Centered AutoML Paradigm [83.78883610871867]
  Automated machine learning (AutoML) was formed around the fundamental objectives of automatically and efficiently configuring machine learning (ML) We argue that a key to unlocking AutoML's full potential lies in addressing the currently underexplored aspect of user interaction with AutoML systems.
  arXiv  Detail & Related papers  (2024-06-05T15:05:24Z)
• Towards Scalable Automated Alignment of LLMs: A Survey [54.820256625544225]
  This paper systematically reviews the recently emerging methods of automated alignment. We categorize existing automated alignment methods into 4 major categories based on the sources of alignment signals. We discuss the essential factors that make automated alignment technologies feasible and effective from the fundamental role of alignment.
  arXiv  Detail & Related papers  (2024-06-03T12:10:26Z)
• Human-Centered Automation [0.3626013617212666]
  The paper argues for the emerging area of Human-Centered Automation (HCA), which prioritizes user needs and preferences in the design and development of automation systems. The paper discusses the limitations of existing automation approaches, the challenges in integrating AI and RPA, and the benefits of human-centered automation for productivity, innovation, and democratizing access to these technologies.
  arXiv  Detail & Related papers  (2024-05-24T22:12:28Z)
• Interactive Autonomous Navigation with Internal State Inference and Interactivity Estimation [58.21683603243387]
  We propose three auxiliary tasks with relational-temporal reasoning and integrate them into the standard Deep Learning framework. These auxiliary tasks provide additional supervision signals to infer the behavior patterns other interactive agents. Our approach achieves robust and state-of-the-art performance in terms of standard evaluation metrics.
  arXiv  Detail & Related papers  (2023-11-27T18:57:42Z)
• Assessing the Use of AutoML for Data-Driven Software Engineering [10.40771687966477]
  AutoML promises to automate the building of end-to-end AI/ML pipelines. Despite the growing interest and high expectations, there is a dearth of information about the extent to which AutoML is currently adopted.
  arXiv  Detail & Related papers  (2023-07-20T11:14:24Z)
• Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML [52.86328317233883]
  We present a comprehensive overview of different ways in which fairness-related harm can arise. We highlight several open technical challenges for future work in this direction.
  arXiv  Detail & Related papers  (2023-03-15T09:40:08Z)
• The Technological Emergence of AutoML: A Survey of Performant Software and Applications in the Context of Industry [72.10607978091492]
  Automated/Autonomous Machine Learning (AutoML/AutonoML) is a relatively young field. This review makes two primary contributions to knowledge around this topic. It provides the most up-to-date and comprehensive survey of existing AutoML tools, both open-source and commercial.
  arXiv  Detail & Related papers  (2022-11-08T10:42:08Z)
• Human-Robot Collaboration and Machine Learning: A Systematic Review of Recent Research [69.48907856390834]
  Human-robot collaboration (HRC) is the approach that explores the interaction between a human and a robot. This paper proposes a thorough literature review of the use of machine learning techniques in the context of HRC.
  arXiv  Detail & Related papers  (2021-10-14T15:14:33Z)
• AutonoML: Towards an Integrated Framework for Autonomous Machine Learning [9.356870107137095]
  Review seeks to motivate a more expansive perspective on what constitutes an automated/autonomous ML system. In doing so, we survey developments in the following research areas. We develop a conceptual framework throughout the review, augmented by each topic, to illustrate one possible way of fusing high-level mechanisms into an autonomous ML system.
  arXiv  Detail & Related papers  (2020-12-23T11:01:10Z)
• AutoML to Date and Beyond: Challenges and Opportunities [30.60364966752454]
  AutoML tools aim to make machine learning accessible for non-machine learning experts. We introduce a new classification system for AutoML systems. We lay out a roadmap for the future, pinpointing the research required to further automate the end-to-end machine learning pipeline.
  arXiv  Detail & Related papers  (2020-10-21T06:08:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.