Preference-Learning Emitters for Mixed-Initiative Quality-Diversity
Algorithms
- URL: http://arxiv.org/abs/2210.13839v2
- Date: Sat, 15 Apr 2023 02:50:47 GMT
- Title: Preference-Learning Emitters for Mixed-Initiative Quality-Diversity
Algorithms
- Authors: Roberto Gallotta, Kai Arulkumaran, L. B. Soros
- Abstract summary: In mixed-initiative co-creation tasks, it is important to provide multiple relevant suggestions to the designer.
We propose a general framework for preference-learning emitters (PLEs) and apply it to a procedural content generation task in the video game Space Engineers.
- Score: 0.6445605125467573
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In mixed-initiative co-creation tasks, wherein a human and a machine jointly
create items, it is important to provide multiple relevant suggestions to the
designer. Quality-diversity algorithms are commonly used for this purpose, as
they can provide diverse suggestions that represent salient areas of the
solution space, showcasing designs with high fitness and wide variety. Because
generated suggestions drive the search process, it is important that they
provide inspiration, but also stay aligned with the designer's intentions.
Additionally, often many interactions with the system are required before the
designer is content with a solution. In this work, we tackle these challenges
with an interactive constrained MAP-Elites system that leverages emitters to
learn the preferences of the designer and then use them in automated steps. By
learning preferences, the generated designs remain aligned with the designer's
intent, and by applying automatic steps, we generate more solutions per user
interaction, giving a larger number of choices to the designer and thereby
speeding up the search. We propose a general framework for preference-learning
emitters (PLEs) and apply it to a procedural content generation task in the
video game Space Engineers. We built an interactive application for our
algorithm and performed a user study with players.
Related papers
- I-Design: Personalized LLM Interior Designer [57.00412237555167]
I-Design is a personalized interior designer that allows users to generate and visualize their design goals through natural language communication.
I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another.
The final design is then constructed in 3D by retrieving and integrating assets from an existing object database.
arXiv Detail & Related papers (2024-04-03T16:17:53Z) - A Design Space for Intelligent and Interactive Writing Assistants [55.9780345526642]
We explore five aspects of writing assistants: task, user, technology, interaction, and ecosystem.
Within each aspect, we define dimensions (i.e., fundamental components of an aspect) and codes (i.e., potential options for each dimension) by systematically reviewing 115 papers.
Our design space aims to offer researchers and designers a practical tool to navigate, comprehend, and compare the various possibilities of writing assistants.
arXiv Detail & Related papers (2024-03-21T04:03:16Z) - Compositional Generative Inverse Design [69.22782875567547]
Inverse design, where we seek to design input variables in order to optimize an underlying objective function, is an important problem.
We show that by instead optimizing over the learned energy function captured by the diffusion model, we can avoid such adversarial examples.
In an N-body interaction task and a challenging 2D multi-airfoil design task, we demonstrate that by composing the learned diffusion model at test time, our method allows us to design initial states and boundary shapes.
arXiv Detail & Related papers (2024-01-24T01:33:39Z) - Machine Learning-Based Multi-Objective Design Exploration Of Flexible
Disc Elements [1.5638419778920147]
This paper showcases Artificial Neural Network (ANN) architecture applied to an engineering design problem to explore and identify improved design solutions.
The case problem of this study is the design of flexible disc elements used in disc couplings.
To accomplish this objective, we employ ANN coupled with genetic algorithm in the design exploration step to identify designs that meet the specified criteria.
arXiv Detail & Related papers (2023-04-14T16:48:51Z) - ChatGPT and Other Large Language Models as Evolutionary Engines for
Online Interactive Collaborative Game Design [0.0]
We present a collaborative game design framework that combines interactive evolution and large language models.
In our framework, the process starts with a brief and a set of candidate designs, either generated using a language model or proposed by the users.
Next, users collaborate on the design process by providing feedback to an interactive genetic algorithm that selects, recombines, and mutates the most promising designs.
arXiv Detail & Related papers (2023-02-09T15:44:43Z) - LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [81.5482196644596]
Graphic layout designs play an essential role in visual communication.
Yet handcrafting layout designs is skill-demanding, time-consuming, and non-scalable to batch production.
Generative models emerge to make design automation scalable but it remains non-trivial to produce designs that comply with designers' desires.
arXiv Detail & Related papers (2022-12-19T21:57:35Z) - Investigating Positive and Negative Qualities of Human-in-the-Loop
Optimization for Designing Interaction Techniques [55.492211642128446]
Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives.
Model-based computational design algorithms assist designers by generating design examples during design.
Black box methods for assistance, on the other hand, can work with any design problem.
arXiv Detail & Related papers (2022-04-15T20:40:43Z) - Sequential Gallery for Interactive Visual Design Optimization [51.52002870143971]
We propose a novel user-in-the-loop optimization method that allows users to efficiently find an appropriate parameter set.
We also propose using a gallery-based interface that provides options in the two-dimensional subspace arranged in an adaptive grid view.
Our experiment with synthetic functions shows that our sequential plane search can find satisfactory solutions in fewer iterations than baselines.
arXiv Detail & Related papers (2020-05-08T15:24:35Z) - Computational Design with Crowds [34.76077954140923]
Computational design is aimed at supporting or automating design processes using computational techniques.
One promising approach is to leverage human computation; that is, to incorporate human input into the process.
We discuss such computational design with crowds in the domain of parameter working system.
arXiv Detail & Related papers (2020-02-20T10:40:13Z) - Scout: Rapid Exploration of Interface Layout Alternatives through
High-Level Design Constraints [19.91735675022113]
Scout helps designers explore alternatives through mixed-initiative interaction with high-level constraints and design feedback.
Scout formalizes low-level spatial constraints that a solver uses to generate potential layouts.
In an evaluation with 18 interface designers, we found that Scout: (1) helps designers create more spatially diverse layouts with similar quality to those created with a baseline tool; and (2) can help designers avoid a linear design process and quickly ideate layouts they do not believe they would have thought of on their own.
arXiv Detail & Related papers (2020-01-15T16:49:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.