MineStudio: A Streamlined Package for Minecraft AI Agent Development

• URL: http://arxiv.org/abs/2412.18293v2
• Date: Wed, 25 Dec 2024 04:51:04 GMT
• Title: MineStudio: A Streamlined Package for Minecraft AI Agent Development
• Authors: Shaofei Cai, Zhancun Mu, Kaichen He, Bowei Zhang, Xinyue Zheng, Anji Liu, Yitao Liang,
• Abstract summary: Minecraft has emerged as a valuable testbed for embodied intelligence and sequential decision-making research.<n>This paper presents MineStudio, an open-source software package designed to streamline embodied policy development in Minecraft.
• Score: 12.327116914644627
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Minecraft has emerged as a valuable testbed for embodied intelligence and sequential decision-making research, yet the development and validation of novel agents remains hindered by significant engineering challenges. This paper presents MineStudio, an open-source software package designed to streamline embodied policy development in Minecraft. MineStudio represents the first comprehensive integration of seven critical engineering components: simulator, data, model, offline pretraining, online finetuning, inference, and benchmark, thereby allowing users to concentrate their efforts on algorithm innovation. We provide a user-friendly API design accompanied by comprehensive documentation and tutorials. The complete codebase is publicly available at https://github.com/CraftJarvis/MineStudio.

Related papers

• Craftium: An Extensible Framework for Creating Reinforcement Learning Environments [0.5461938536945723]
  This paper presents Craftium, a novel framework for exploring and creating rich 3D visual RL environments. Craftium builds upon the Minetest game engine and the popular Gymnasium API.
  arXiv  Detail & Related papers  (2024-07-04T14:38:02Z)
• CodeTF: One-stop Transformer Library for State-of-the-art Code LLM [72.1638273937025]
  We present CodeTF, an open-source Transformer-based library for state-of-the-art Code LLMs and code intelligence. Our library supports a collection of pretrained Code LLM models and popular code benchmarks. We hope CodeTF is able to bridge the gap between machine learning/generative AI and software engineering.
  arXiv  Detail & Related papers  (2023-05-31T05:24:48Z)
• Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory [97.87093169454431]
  Ghost in the Minecraft (GITM) is a novel framework that integrates Large Language Models (LLMs) with text-based knowledge and memory. We develop a set of structured actions and leverage LLMs to generate action plans for the agents to execute. The resulting LLM-based agent markedly surpasses previous methods, achieving a remarkable improvement of +47.5% in success rate.
  arXiv  Detail & Related papers  (2023-05-25T17:59:49Z)
• OpenAGI: When LLM Meets Domain Experts [51.86179657467822]
  Human Intelligence (HI) excels at combining basic skills to solve complex tasks. This capability is vital for Artificial Intelligence (AI) and should be embedded in comprehensive AI Agents. We introduce OpenAGI, an open-source platform designed for solving multi-step, real-world tasks.
  arXiv  Detail & Related papers  (2023-04-10T03:55:35Z)
• Nerfstudio: A Modular Framework for Neural Radiance Field Development [60.210943944285184]
  Nerfstudio is a modular PyTorch framework for implementing Neural Radiance Fields (NeRF) methods. NeRF is a rapidly growing area of research with wide-ranging applications in computer vision, graphics, robotics, and more. Our framework includes plug-and-play components for implementing NeRF-based methods, which make it easy for researchers and practitioners to incorporate NeRF into their projects.
  arXiv  Detail & Related papers  (2023-02-08T18:58:00Z)
• MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge [70.47759528596711]
  We introduce MineDojo, a new framework built on the popular Minecraft game. We propose a novel agent learning algorithm that leverages large pre-trained video-language models as a learned reward function. Our agent is able to solve a variety of open-ended tasks specified in free-form language without any manually designed dense shaping reward.
  arXiv  Detail & Related papers  (2022-06-17T15:53:05Z)
• EvoCraft: A New Challenge for Open-Endedness [7.927206441149002]
  EvoCraft is a framework for Minecraft designed to study open-ended algorithms. EvoCraft offers a challenging new environment for automated search methods (such as evolution) to find complex artifacts.
  arXiv  Detail & Related papers  (2020-12-08T21:36:18Z)
• Scaling Imitation Learning in Minecraft [114.6964571273486]
  We apply imitation learning to attain state-of-the-art performance on hard exploration problems in the Minecraft environment. An early version of our approach reached second place in the MineRL competition at NeurIPS 2019.
  arXiv  Detail & Related papers  (2020-07-06T12:47:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.