Latent Combinational Game Design
- URL: http://arxiv.org/abs/2206.14203v3
- Date: Wed, 20 Dec 2023 23:53:54 GMT
- Title: Latent Combinational Game Design
- Authors: Anurag Sarkar, Seth Cooper
- Abstract summary: We present an approach for generating playable games that blend a given set of games in a desired combination using deep generative latent variable models.
Results show that these approaches can generate playable games that blend the input games in specified combinations.
- Score: 4.8951183832371
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present latent combinational game design -- an approach for generating
playable games that blend a given set of games in a desired combination using
deep generative latent variable models. We use Gaussian Mixture Variational
Autoencoders (GMVAEs) which model the VAE latent space via a mixture of
Gaussian components. Through supervised training, each component encodes levels
from one game and lets us define blended games as linear combinations of these
components. This enables generating new games that blend the input games as
well as controlling the relative proportions of each game in the blend. We also
extend prior blending work using conditional VAEs and compare against the GMVAE
and additionally introduce a hybrid conditional GMVAE (CGMVAE) architecture
which lets us generate whole blended levels and layouts. Results show that
these approaches can generate playable games that blend the input games in
specified combinations. We use both platformers and dungeon-based games to
demonstrate our results.
Related papers
- Runtime analysis of a coevolutionary algorithm on impartial combinatorial games [1.104960878651584]
Coevolutionary algorithms (CoEAs) evolve a population of individuals by iteratively selecting the strongest based on their interactions against contemporaries, and using those selected as parents for the following generation.
However, the successful application of CoEAs for game playing is difficult due to pathological behaviours such as cycling, an issue especially critical for games with in runtime payoff landscapes.
In this paper, we push the scope of analysis to discover an optimal strategy for an impartial game.
This result applies to any impartial game, and for many games the implied bound is or quasipolynomial as a function of the number of
arXiv Detail & Related papers (2024-09-06T10:39:17Z) - MM-Mixing: Multi-Modal Mixing Alignment for 3D Understanding [64.65145700121442]
We introduce MM-Mixing, a multi-modal mixing alignment framework for 3D understanding.
Our proposed two-stage training pipeline combines feature-level and input-level mixing to optimize the 3D encoder.
We demonstrate that MM-Mixing significantly improves baseline performance across various learning scenarios.
arXiv Detail & Related papers (2024-05-28T18:44:15Z) - Neural Population Learning beyond Symmetric Zero-sum Games [52.20454809055356]
We introduce NeuPL-JPSRO, a neural population learning algorithm that benefits from transfer learning of skills and converges to a Coarse Correlated (CCE) of the game.
Our work shows that equilibrium convergent population learning can be implemented at scale and in generality.
arXiv Detail & Related papers (2024-01-10T12:56:24Z) - Learning with MISELBO: The Mixture Cookbook [62.75516608080322]
We present the first ever mixture of variational approximations for a normalizing flow-based hierarchical variational autoencoder (VAE) with VampPrior and a PixelCNN decoder network.
We explain this cooperative behavior by drawing a novel connection between VI and adaptive importance sampling.
We obtain state-of-the-art results among VAE architectures in terms of negative log-likelihood on the MNIST and FashionMNIST datasets.
arXiv Detail & Related papers (2022-09-30T15:01:35Z) - MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose
Estimation in Video [75.23812405203778]
Recent solutions have been introduced to estimate 3D human pose from 2D keypoint sequence by considering body joints among all frames globally to learn-temporal correlation.
We propose Mix Mix, which has temporal transformer block to separately model the temporal motion of each joint and a transformer block inter-joint spatial correlation.
In addition, the network output is extended from the central frame to entire frames of input video, improving the coherence between the input and output benchmarks.
arXiv Detail & Related papers (2022-03-02T04:20:59Z) - Dungeon and Platformer Level Blending and Generation using Conditional
VAEs [7.919213739992465]
conditional VAEs (CVAEs) were recently shown capable of generating output that can be modified using labels specifying desired content.
We expand these works by using CVAEs for generating whole platformer and dungeon levels, and blending levels across these genres.
arXiv Detail & Related papers (2021-06-17T05:46:03Z) - Generating and Blending Game Levels via Quality-Diversity in the Latent
Space of a Variational Autoencoder [7.919213739992465]
We present a level generation and game blending approach that combines the use of VAEs and QD algorithms.
Specifically, we train VAEs on game levels and then run the MAP-Elites QD algorithm using the learned latent space of the VAE as the search space.
arXiv Detail & Related papers (2021-02-24T18:44:23Z) - Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks [75.69896269357005]
Mixup is the latest data augmentation technique that linearly interpolates input examples and the corresponding labels.
In this paper, we explore how to apply mixup to natural language processing tasks.
We incorporate mixup to transformer-based pre-trained architecture, named "mixup-transformer", for a wide range of NLP tasks.
arXiv Detail & Related papers (2020-10-05T23:37:30Z) - Game Level Clustering and Generation using Gaussian Mixture VAEs [6.217860411034386]
Variational autoencoders (VAEs) have been shown to be able to generate game levels but require manual exploration of the learned latent space to generate outputs with desired attributes.
In this paper, we apply a variant of the VAE which imposes a mixture of Gaussians (GM) on the latent space, unlike regular VAEs which impose a unimodal Gaussian.
This allows GMVAEs to cluster levels in an unsupervised manner using the components of the GM and then generate new levels using the learned components.
arXiv Detail & Related papers (2020-08-22T15:07:30Z) - Learning to Simulate Dynamic Environments with GameGAN [109.25308647431952]
In this paper, we aim to learn a simulator by simply watching an agent interact with an environment.
We introduce GameGAN, a generative model that learns to visually imitate a desired game by ingesting screenplay and keyboard actions during training.
arXiv Detail & Related papers (2020-05-25T14:10:17Z) - Controllable Level Blending between Games using Variational Autoencoders [6.217860411034386]
We train a VAE on level data from Super Mario Bros. and Kid Icarus, enabling it to capture the latent space spanning both games.
We then use this space to generate level segments that combine properties of levels from both games.
We argue that these affordances make the VAE-based approach especially suitable for co-creative level design.
arXiv Detail & Related papers (2020-02-27T01:38:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.