Online Game Level Generation from Music

• URL: http://arxiv.org/abs/2207.05271v1
• Date: Tue, 12 Jul 2022 02:44:50 GMT
• Title: Online Game Level Generation from Music
• Authors: Ziqi Wang, Jialin Liu
• Abstract summary: OPARL is built upon the experience-driven reinforcement learning and controllable reinforcement learning. A novel control policy based on local search and k-nearest neighbours is proposed and integrated into OPARL to control the level generator. Results of simulation-based experiments show that our implementation of OPARL is competent to generate playable levels with difficulty degree matched to the energy'' dynamic of music for different artificial players in an online fashion.
• Score: 10.903226537887557
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Game consists of multiple types of content, while the harmony of different content types play an essential role in game design. However, most works on procedural content generation consider only one type of content at a time. In this paper, we propose and formulate online level generation from music, in a way of matching a level feature to a music feature in real-time, while adapting to players' play speed. A generic framework named online player-adaptive procedural content generation via reinforcement learning, OPARL for short, is built upon the experience-driven reinforcement learning and controllable reinforcement learning, to enable online level generation from music. Furthermore, a novel control policy based on local search and k-nearest neighbours is proposed and integrated into OPARL to control the level generator considering the play data collected online. Results of simulation-based experiments show that our implementation of OPARL is competent to generate playable levels with difficulty degree matched to the ``energy'' dynamic of music for different artificial players in an online fashion.

Related papers

• Simple and Controllable Music Generation [94.61958781346176]
  MusicGen is a single Language Model (LM) that operates over several streams of compressed discrete music representation, i.e., tokens. Unlike prior work, MusicGen is comprised of a single-stage transformer LM together with efficient token interleaving patterns.
  arXiv  Detail & Related papers  (2023-06-08T15:31:05Z)
• DIAMBRA Arena: a New Reinforcement Learning Platform for Research and Experimentation [91.3755431537592]
  This work presents DIAMBRA Arena, a new platform for reinforcement learning research and experimentation. It features a collection of high-quality environments exposing a Python API fully compliant with OpenAI Gym standard. They are episodic tasks with discrete actions and observations composed by raw pixels plus additional numerical values.
  arXiv  Detail & Related papers  (2022-10-19T14:39:10Z)
• Procedural Content Generation using Neuroevolution and Novelty Search for Diverse Video Game Levels [2.320417845168326]
  Procedurally generated video game content has the potential to drastically reduce the content creation budget of game developers and large studios. However, adoption is hindered by limitations such as slow generation, as well as low quality and diversity of content. We introduce an evolutionary search-based approach for evolving level generators using novelty search to procedurally generate diverse levels in real time.
  arXiv  Detail & Related papers  (2022-04-14T12:54:32Z)
• Experience-Driven PCG via Reinforcement Learning: A Super Mario Bros Study [2.2215852332444905]
  The framework is tested initially in the Super Mario Bros game. The correctness of the generation is ensured by a neural net-assisted evolutionary level repairer. Our proposed framework is capable of generating endless, playable Super Mario Bros levels.
  arXiv  Detail & Related papers  (2021-06-30T08:10:45Z)
• Video Game Level Repair via Mixed Integer Linear Programming [20.815591392882716]
  The proposed framework constructs levels using a generative adversarial network (GAN) trained with human-authored examples and repairs them using a mixed-integer linear program (MIP) with playability constraints. Results show that the proposed framework generates a diverse range of playable levels, that capture the spatial relationships between objects exhibited in the human-authored levels.
  arXiv  Detail & Related papers  (2020-10-13T18:37:58Z)
• Incorporating Music Knowledge in Continual Dataset Augmentation for Music Generation [69.06413031969674]
  Aug-Gen is a method of dataset augmentation for any music generation system trained on a resource-constrained domain. We apply Aug-Gen to Transformer-based chorale generation in the style of J.S. Bach, and show that this allows for longer training and results in better generative output.
  arXiv  Detail & Related papers  (2020-06-23T21:06:15Z)
• Learning to Simulate Dynamic Environments with GameGAN [109.25308647431952]
  In this paper, we aim to learn a simulator by simply watching an agent interact with an environment. We introduce GameGAN, a generative model that learns to visually imitate a desired game by ingesting screenplay and keyboard actions during training.
  arXiv  Detail & Related papers  (2020-05-25T14:10:17Z)
• Controllable Level Blending between Games using Variational Autoencoders [6.217860411034386]
  We train a VAE on level data from Super Mario Bros. and Kid Icarus, enabling it to capture the latent space spanning both games. We then use this space to generate level segments that combine properties of levels from both games. We argue that these affordances make the VAE-based approach especially suitable for co-creative level design.
  arXiv  Detail & Related papers  (2020-02-27T01:38:35Z)
• Learning to Generate Levels From Nothing [5.2508303190856624]
  We propose Generative Playing Networks which design levels for itself to play. The algorithm is built in two parts; an agent that learns to play game levels, and a generator that learns the distribution of playable levels. We demonstrate the capability of this framework by training an agent and level generator for a 2D dungeon crawler game.
  arXiv  Detail & Related papers  (2020-02-12T22:07:23Z)
• RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning [69.20460466735852]
  This paper presents a deep reinforcement learning algorithm for online accompaniment generation. The proposed algorithm is able to respond to the human part and generate a melodic, harmonic and diverse machine part.
  arXiv  Detail & Related papers  (2020-02-08T03:53:52Z)
• Neural MMO v1.3: A Massively Multiagent Game Environment for Training and Evaluating Neural Networks [48.5733173329785]
  We present Neural MMO, a massively multiagent game environment inspired by MMOs. We discuss our progress on two more general challenges in multiagent systems engineering for AI research: distributed infrastructure and game IO.
  arXiv  Detail & Related papers  (2020-01-31T18:50:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.