Human in the Loop Novelty Generation

• URL: http://arxiv.org/abs/2306.04813v2
• Date: Mon, 12 Jun 2023 23:09:30 GMT
• Title: Human in the Loop Novelty Generation
• Authors: Mark Bercasio, Allison Wong, Dustin Dannenhauer
• Abstract summary: We introduce a new approach to novelty generation that uses abstract models of environments that do not require domain-dependent human guidance to generate novelties. We describe our Human-in-the-Loop novelty generation process using our open-source novelty generation library to test baseline agents in two domains: Monopoly and VizDoom. Our results shows the Human-in-the-Loop method enables users to develop, implement, test, and revise novelties within 4 hours for both Monopoly and VizDoom domains.
• Score: 2.320417845168326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Developing artificial intelligence approaches to overcome novel, unexpected circumstances is a difficult, unsolved problem. One challenge to advancing the state of the art in novelty accommodation is the availability of testing frameworks for evaluating performance against novel situations. Recent novelty generation approaches in domains such as Science Birds and Monopoly leverage human domain expertise during the search to discover new novelties. Such approaches introduce human guidance before novelty generation occurs and yield novelties that can be directly loaded into a simulated environment. We introduce a new approach to novelty generation that uses abstract models of environments (including simulation domains) that do not require domain-dependent human guidance to generate novelties. A key result is a larger, often infinite space of novelties capable of being generated, with the trade-off being a requirement to involve human guidance to select and filter novelties post generation. We describe our Human-in-the-Loop novelty generation process using our open-source novelty generation library to test baseline agents in two domains: Monopoly and VizDoom. Our results shows the Human-in-the-Loop method enables users to develop, implement, test, and revise novelties within 4 hours for both Monopoly and VizDoom domains.

Related papers

• Conserving Human Creativity with Evolutionary Generative Algorithms: A Case Study in Music Generation [0.0]
  This study explores the application of evolutionary generative algorithms in music production to preserve and enhance human creativity. By integrating human feedback into Differential Evolution algorithms, we produced six songs that were submitted to international record labels, all of which received contract offers.
  arXiv  Detail & Related papers  (2024-06-09T18:11:05Z)
• On the Resurgence of Recurrent Models for Long Sequences -- Survey and Research Opportunities in the Transformer Era [59.279784235147254]
  This survey is aimed at providing an overview of these trends framed under the unifying umbrella of Recurrence. It emphasizes novel research opportunities that become prominent when abandoning the idea of processing long sequences.
  arXiv  Detail & Related papers  (2024-02-12T23:55:55Z)
• Human Motion Generation: A Survey [67.38982546213371]
  Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Most research within this field focuses on generating human motions based on conditional signals, such as text, audio, and scene contexts. We present a comprehensive literature review of human motion generation, which is the first of its kind in this field.
  arXiv  Detail & Related papers  (2023-07-20T14:15:20Z)
• Novelty Accommodating Multi-Agent Planning in High Fidelity Simulated Open World [0.0]
  Novelty is an unexpected phenomenon that can alter the core characteristics, composition, and dynamics of the environment. Previous studies show that novelty has catastrophic impact on agent performance. In this work, we demonstrate that a domain-independent AI agent can be adapted to successfully perform and reason with novelty in realistic high-fidelity simulator of the military domain.
  arXiv  Detail & Related papers  (2023-06-22T03:44:04Z)
• SciMON: Scientific Inspiration Machines Optimized for Novelty [68.46036589035539]
  We explore and enhance the ability of neural language models to generate novel scientific directions grounded in literature. We take a dramatic departure with a novel setting in which models use as input background contexts. We present SciMON, a modeling framework that uses retrieval of "inspirations" from past scientific papers.
  arXiv  Detail & Related papers  (2023-05-23T17:12:08Z)
• Continuous Trajectory Generation Based on Two-Stage GAN [50.55181727145379]
  We propose a novel two-stage generative adversarial framework to generate the continuous trajectory on the road network. Specifically, we build the generator under the human mobility hypothesis of the A* algorithm to learn the human mobility behavior. For the discriminator, we combine the sequential reward with the mobility yaw reward to enhance the effectiveness of the generator.
  arXiv  Detail & Related papers  (2023-01-16T09:54:02Z)
• Maximum entropy exploration in contextual bandits with neural networks and energy based models [63.872634680339644]
  We present two classes of models, one with neural networks as reward estimators, and the other with energy based models. We show that both techniques outperform well-known standard algorithms, where energy based models have the best overall performance. This provides practitioners with new techniques that perform well in static and dynamic settings, and are particularly well suited to non-linear scenarios with continuous action spaces.
  arXiv  Detail & Related papers  (2022-10-12T15:09:45Z)
• NovGrid: A Flexible Grid World for Evaluating Agent Response to Novelty [8.705624336757461]
  We introduce NovGrid, a novelty generation framework built on MiniGrid. Along with the core NovGrid we provide exemplar novelties aligned with our ontology and instantiate them as novelty templates. We present a set of metrics built into our framework for the evaluation of novelty-adaptation-enabled machine-learning techniques.
  arXiv  Detail & Related papers  (2022-03-23T01:06:04Z)
• A Unifying Framework for Formal Theories of Novelty:Framework, Examples and Discussion [0.0]
  Managing inputs that are novel, unknown, or out-of-distribution is critical as an agent moves from the lab to the open world. We present the first unified framework for formal theories of novelty and use the framework to formally define a family of novelty types. Our framework can be applied across a wide range of domains, from symbolic AI to reinforcement learning, and beyond to open world image recognition.
  arXiv  Detail & Related papers  (2020-12-08T05:24:51Z)
• Novel Policy Seeking with Constrained Optimization [131.67409598529287]
  We propose to rethink the problem of generating novel policies in reinforcement learning tasks. We first introduce a new metric to evaluate the difference between policies and then design two practical novel policy generation methods. The two proposed methods, namely the Constrained Task Novel Bisector (CTNB) and the Interior Policy Differentiation (IPD), are derived from the feasible direction method and the interior point method commonly known in the constrained optimization literature.
  arXiv  Detail & Related papers  (2020-05-21T14:39:14Z)
• Domain Independent Unsupervised Learning to grasp the Novel Objects [14.667956818920738]
  We present a novel unsupervised learning based algorithm for the selection of feasible grasp regions. We define a novel concept of Grasp Decide Index (GDI) to select the best grasp pose in image plane. We have conducted several experiments in clutter or isolated environment on standard objects of Amazon Robotics Challenge 2017 and Amazon Picking Challenge 2016.
  arXiv  Detail & Related papers  (2020-01-09T12:05:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.