Preference-Learning Emitters for Mixed-Initiative Quality-Diversity Algorithms

• URL: http://arxiv.org/abs/2210.13839v2
• Date: Sat, 15 Apr 2023 02:50:47 GMT
• Title: Preference-Learning Emitters for Mixed-Initiative Quality-Diversity Algorithms
• Authors: Roberto Gallotta, Kai Arulkumaran, L. B. Soros
• Abstract summary: In mixed-initiative co-creation tasks, it is important to provide multiple relevant suggestions to the designer. We propose a general framework for preference-learning emitters (PLEs) and apply it to a procedural content generation task in the video game Space Engineers.
• Score: 0.6445605125467573
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In mixed-initiative co-creation tasks, wherein a human and a machine jointly create items, it is important to provide multiple relevant suggestions to the designer. Quality-diversity algorithms are commonly used for this purpose, as they can provide diverse suggestions that represent salient areas of the solution space, showcasing designs with high fitness and wide variety. Because generated suggestions drive the search process, it is important that they provide inspiration, but also stay aligned with the designer's intentions. Additionally, often many interactions with the system are required before the designer is content with a solution. In this work, we tackle these challenges with an interactive constrained MAP-Elites system that leverages emitters to learn the preferences of the designer and then use them in automated steps. By learning preferences, the generated designs remain aligned with the designer's intent, and by applying automatic steps, we generate more solutions per user interaction, giving a larger number of choices to the designer and thereby speeding up the search. We propose a general framework for preference-learning emitters (PLEs) and apply it to a procedural content generation task in the video game Space Engineers. We built an interactive application for our algorithm and performed a user study with players.

Related papers

• Survey of User Interface Design and Interaction Techniques in Generative AI Applications [79.55963742878684]
  We aim to create a compendium of different user-interaction patterns that can be used as a reference for designers and developers alike. We also strive to lower the entry barrier for those attempting to learn more about the design of generative AI applications.
  arXiv  Detail & Related papers  (2024-10-28T23:10:06Z)
• Deep Generative Model for Mechanical System Configuration Design [3.2194137462952126]
  We propose a deep generative model to predict the optimal combination of components and interfaces for a given design problem. We then train a Transformer using this dataset, named GearFormer, which can generate quality solutions on its own. We show that GearFormer outperforms search methods on their own in terms of satisfying the specified design requirements.
  arXiv  Detail & Related papers  (2024-09-09T19:15:45Z)
• A Design Space for Intelligent and Interactive Writing Assistants [55.9780345526642]
  We explore five aspects of writing assistants: task, user, technology, interaction, and ecosystem. Within each aspect, we define dimensions (i.e., fundamental components of an aspect) and codes (i.e., potential options for each dimension) by systematically reviewing 115 papers. Our design space aims to offer researchers and designers a practical tool to navigate, comprehend, and compare the various possibilities of writing assistants.
  arXiv  Detail & Related papers  (2024-03-21T04:03:16Z)
• Compositional Generative Inverse Design [69.22782875567547]
  Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem. We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples. In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
  arXiv  Detail & Related papers  (2024-01-24T01:33:39Z)
• Machine Learning-Based Multi-Objective Design Exploration Of Flexible Disc Elements [1.5638419778920147]
  This paper showcases Artificial Neural Network (ANN) architecture applied to an engineering design problem to explore and identify improved design solutions. The case problem of this study is the design of flexible disc elements used in disc couplings. To accomplish this objective, we employ ANN coupled with genetic algorithm in the design exploration step to identify designs that meet the specified criteria.
  arXiv  Detail & Related papers  (2023-04-14T16:48:51Z)
• ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Design [0.0]
  We present a collaborative game design framework that combines interactive evolution and large language models. In our framework, the process starts with a brief and a set of candidate designs, either generated using a language model or proposed by the users. Next, users collaborate on the design process by providing feedback to an interactive genetic algorithm that selects, recombines, and mutates the most promising designs.
  arXiv  Detail & Related papers  (2023-02-09T15:44:43Z)
• LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [80.61492265221817]
  Graphic layout designs play an essential role in visual communication. Yet handcrafting layout designs is skill-demanding, time-consuming, and non-scalable to batch production. Generative models emerge to make design automation scalable but it remains non-trivial to produce designs that comply with designers' desires.
  arXiv  Detail & Related papers  (2022-12-19T21:57:35Z)
• Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques [55.492211642128446]
  Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives. Model-based computational design algorithms assist designers by generating design examples during design. Black box methods for assistance, on the other hand, can work with any design problem.
  arXiv  Detail & Related papers  (2022-04-15T20:40:43Z)
• Sequential Gallery for Interactive Visual Design Optimization [51.52002870143971]
  We propose a novel user-in-the-loop optimization method that allows users to efficiently find an appropriate parameter set. We also propose using a gallery-based interface that provides options in the two-dimensional subspace arranged in an adaptive grid view. Our experiment with synthetic functions shows that our sequential plane search can find satisfactory solutions in fewer iterations than baselines.
  arXiv  Detail & Related papers  (2020-05-08T15:24:35Z)
• Computational Design with Crowds [34.76077954140923]
  Computational design is aimed at supporting or automating design processes using computational techniques. One promising approach is to leverage human computation; that is, to incorporate human input into the process. We discuss such computational design with crowds in the domain of parameter working system.
  arXiv  Detail & Related papers  (2020-02-20T10:40:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.