BO-Muse: A human expert and AI teaming framework for accelerated experimental design

• URL: http://arxiv.org/abs/2303.01684v2
• Date: Thu, 30 Mar 2023 18:28:16 GMT
• Title: BO-Muse: A human expert and AI teaming framework for accelerated experimental design
• Authors: Sunil Gupta, Alistair Shilton, Arun Kumar A V, Shannon Ryan, Majid Abdolshah, Hung Le, Santu Rana, Julian Berk, Mahad Rashid, Svetha Venkatesh
• Abstract summary: Our algorithm lets the human expert take the lead in the experimental process. We show that our algorithm converges sub-linearly, at a rate faster than the AI or human alone.
• Score: 58.61002520273518
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we introduce BO-Muse, a new approach to human-AI teaming for the optimization of expensive black-box functions. Inspired by the intrinsic difficulty of extracting expert knowledge and distilling it back into AI models and by observations of human behavior in real-world experimental design, our algorithm lets the human expert take the lead in the experimental process. The human expert can use their domain expertise to its full potential, while the AI plays the role of a muse, injecting novelty and searching for areas of weakness to break the human out of over-exploitation induced by cognitive entrenchment. With mild assumptions, we show that our algorithm converges sub-linearly, at a rate faster than the AI or human alone. We validate our algorithm using synthetic data and with human experts performing real-world experiments.

Related papers

• Unexploited Information Value in Human-AI Collaboration [23.353778024330165]
  How to improve performance of a human-AI team is often not clear without knowing what particular information and strategies each agent employs. We propose a model based in statistically decision theory to analyze human-AI collaboration.
  arXiv  Detail & Related papers  (2024-11-03T01:34:45Z)
• CREW: Facilitating Human-AI Teaming Research [3.7324091969140776]
  We introduce CREW, a platform to facilitate Human-AI teaming research and engage collaborations from multiple scientific disciplines. It includes pre-built tasks for cognitive studies and Human-AI teaming with expandable potentials from our modular design. CREW benchmarks real-time human-guided reinforcement learning agents using state-of-the-art algorithms and well-tuned baselines.
  arXiv  Detail & Related papers  (2024-07-31T21:43:55Z)
• Collaborative Intelligence in Sequential Experiments: A Human-in-the-Loop Framework for Drug Discovery [13.438499600701578]
  We introduce a human-in-the-loop framework for sequential experiments in drug discovery. The proposed algorithm processes experimental data to recommend both promising molecules and those that could improve its performance to human experts. Human experts retain the final decision-making authority based on these recommendations and their domain expertise.
  arXiv  Detail & Related papers  (2024-05-07T02:03:07Z)
• Exploration with Principles for Diverse AI Supervision [88.61687950039662]
  Training large transformers using next-token prediction has given rise to groundbreaking advancements in AI. While this generative AI approach has produced impressive results, it heavily leans on human supervision. This strong reliance on human oversight poses a significant hurdle to the advancement of AI innovation. We propose a novel paradigm termed Exploratory AI (EAI) aimed at autonomously generating high-quality training data.
  arXiv  Detail & Related papers  (2023-10-13T07:03:39Z)
• Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment [52.07473934146584]
  We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process. Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications. It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
  arXiv  Detail & Related papers  (2022-08-04T23:53:51Z)
• A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interaction [70.11080854486953]
  We propose a user-centred framework for XAI that focuses on its social-interactive aspect. The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
  arXiv  Detail & Related papers  (2021-09-27T09:56:23Z)
• Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making [46.625616262738404]
  We use knowledge from the field of cognitive science to account for cognitive biases in the human-AI collaborative decision-making setting. We focus specifically on anchoring bias, a bias commonly encountered in human-AI collaboration.
  arXiv  Detail & Related papers  (2020-10-15T22:25:41Z)
• Learning to Complement Humans [67.38348247794949]
  A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams.
  arXiv  Detail & Related papers  (2020-05-01T20:00:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.