Learning To Play Atari Games Using Dueling Q-Learning and Hebbian Plasticity

• URL: http://arxiv.org/abs/2405.13960v1
• Date: Wed, 22 May 2024 19:55:33 GMT
• Title: Learning To Play Atari Games Using Dueling Q-Learning and Hebbian Plasticity
• Authors: Md Ashfaq Salehin,
• Abstract summary: In this work, an advanced deep reinforcement learning architecture is used to train neural network agents playing atari games. At first, this system uses advanced techniques like deep Q-networks and dueling Q-networks to train efficient agents. Plastic neural networks are used as agents, and their feasibility is analyzed in this scenario.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, an advanced deep reinforcement learning architecture is used to train neural network agents playing atari games. Given only the raw game pixels, action space, and reward information, the system can train agents to play any Atari game. At first, this system uses advanced techniques like deep Q-networks and dueling Q-networks to train efficient agents, the same techniques used by DeepMind to train agents that beat human players in Atari games. As an extension, plastic neural networks are used as agents, and their feasibility is analyzed in this scenario. The plasticity implementation was based on backpropagation and the Hebbian update rule. Plastic neural networks have excellent features like lifelong learning after the initial training, which makes them highly suitable in adaptive learning environments. As a new analysis of plasticity in this context, this work might provide valuable insights and direction for future works.

Related papers

• Reinforcement Learning in Strategy-Based and Atari Games: A Review of Google DeepMinds Innovations [0.0]
  Reinforcement Learning (RL) has been widely used in many applications, particularly in gaming. Google DeepMind has pioneered innovations in this field, employing reinforcement learning algorithms to create advanced AI models. This paper reviews the significance of reinforcement learning applications in Atari and strategy-based games.
  arXiv  Detail & Related papers  (2025-02-14T17:06:34Z)
• Human-like Bots for Tactical Shooters Using Compute-Efficient Sensors [13.743654443419384]
  This paper introduces a novel methodology for training neural networks via imitation learning to play a complex, commercial-standard, VALORANT-like 2v2 tactical shooter game. Our approach leverages an innovative, pixel-free perception architecture using a small set of ray-cast sensors, which capture essential spatial information efficiently. Human evaluation tests confirm that our AI agents provide human-like gameplay experiences while operating efficiently under computational constraints.
  arXiv  Detail & Related papers  (2024-12-30T12:06:37Z)
• Neuromorphic dreaming: A pathway to efficient learning in artificial agents [2.6542148964152923]
  We present a hardware implementation of model-based reinforcement learning (MBRL) using spiking neural networks (SNNs) on mixed-signal analog/digital neuromorphic hardware. This approach leverages the energy efficiency of mixed-signal neuromorphic chips while achieving high sample efficiency. We validate the model by training the hardware implementation to play the Atari game Pong.
  arXiv  Detail & Related papers  (2024-05-24T15:03:56Z)
• Robot Fine-Tuning Made Easy: Pre-Training Rewards and Policies for Autonomous Real-World Reinforcement Learning [58.3994826169858]
  We introduce RoboFuME, a reset-free fine-tuning system for robotic reinforcement learning. Our insights are to utilize offline reinforcement learning techniques to ensure efficient online fine-tuning of a pre-trained policy. Our method can incorporate data from an existing robot dataset and improve on a target task within as little as 3 hours of autonomous real-world experience.
  arXiv  Detail & Related papers  (2023-10-23T17:50:08Z)
• NetHack is Hard to Hack [37.24009814390211]
  In the NeurIPS 2021 NetHack Challenge, symbolic agents outperformed neural approaches by over four times in median game score. We present an extensive study on neural policy learning for NetHack. We produce a state-of-the-art neural agent that surpasses previous fully neural policies by 127% in offline settings and 25% in online settings on median game score.
  arXiv  Detail & Related papers  (2023-05-30T17:30:17Z)
• Explaining Deep Reinforcement Learning Agents In The Atari Domain through a Surrogate Model [78.69367679848632]
  We describe a lightweight and effective method to derive explanations for deep RL agents. Our method relies on a transformation of the pixel-based input of the RL agent to an interpretable, percept-like input representation. We then train a surrogate model, which is itself interpretable, to replicate the behavior of the target, deep RL agent.
  arXiv  Detail & Related papers  (2021-10-07T05:01:44Z)
• Teach me to play, gamer! Imitative learning in computer games via linguistic description of complex phenomena and decision tree [55.41644538483948]
  We present a new machine learning model by imitation based on the linguistic description of complex phenomena. The method can be a good alternative to design and implement the behaviour of intelligent agents in video game development.
  arXiv  Detail & Related papers  (2021-01-06T21:14:10Z)
• Deep Policy Networks for NPC Behaviors that Adapt to Changing Design Parameters in Roguelike Games [137.86426963572214]
  Turn-based strategy games like Roguelikes, for example, present unique challenges to Deep Reinforcement Learning (DRL) We propose two network architectures to better handle complex categorical state spaces and to mitigate the need for retraining forced by design decisions.
  arXiv  Detail & Related papers  (2020-12-07T08:47:25Z)
• DeepCrawl: Deep Reinforcement Learning for Turn-based Strategy Games [137.86426963572214]
  We introduce DeepCrawl, a fully-playable Roguelike prototype for iOS and Android in which all agents are controlled by policy networks trained using Deep Reinforcement Learning (DRL) Our aim is to understand whether recent advances in DRL can be used to develop convincing behavioral models for non-player characters in videogames.
  arXiv  Detail & Related papers  (2020-12-03T13:53:29Z)
• FRESH: Interactive Reward Shaping in High-Dimensional State Spaces using Human Feedback [9.548547582558662]
  Reinforcement learning has been successful in training autonomous agents to accomplish goals in complex environments. Human players often find it easier to obtain higher rewards in some environments than reinforcement learning algorithms. This is especially true of high-dimensional state spaces where the reward obtained by the agent is sparse or extremely delayed.
  arXiv  Detail & Related papers  (2020-01-19T06:07:20Z)
• Model-Based Reinforcement Learning for Atari [89.3039240303797]
  We show how video prediction models can enable agents to solve Atari games with fewer interactions than model-free methods. Our experiments evaluate SimPLe on a range of Atari games in low data regime of 100k interactions between the agent and the environment.
  arXiv  Detail & Related papers  (2019-03-01T15:40:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.