AllenAct: A Framework for Embodied AI Research
- URL: http://arxiv.org/abs/2008.12760v1
- Date: Fri, 28 Aug 2020 17:35:22 GMT
- Title: AllenAct: A Framework for Embodied AI Research
- Authors: Luca Weihs, Jordi Salvador, Klemen Kotar, Unnat Jain, Kuo-Hao Zeng,
Roozbeh Mottaghi, Aniruddha Kembhavi
- Abstract summary: Embodied AI is in which agents learn to complete tasks through interaction with their environment from egocentric observations.
AllenAct is a modular and flexible learning framework designed with a focus on the unique requirements of Embodied AI research.
- Score: 37.25733386769186
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The domain of Embodied AI, in which agents learn to complete tasks through
interaction with their environment from egocentric observations, has
experienced substantial growth with the advent of deep reinforcement learning
and increased interest from the computer vision, NLP, and robotics communities.
This growth has been facilitated by the creation of a large number of simulated
environments (such as AI2-THOR, Habitat and CARLA), tasks (like point
navigation, instruction following, and embodied question answering), and
associated leaderboards. While this diversity has been beneficial and organic,
it has also fragmented the community: a huge amount of effort is required to do
something as simple as taking a model trained in one environment and testing it
in another. This discourages good science. We introduce AllenAct, a modular and
flexible learning framework designed with a focus on the unique requirements of
Embodied AI research. AllenAct provides first-class support for a growing
collection of embodied environments, tasks and algorithms, provides
reproductions of state-of-the-art models and includes extensive documentation,
tutorials, start-up code, and pre-trained models. We hope that our framework
makes Embodied AI more accessible and encourages new researchers to join this
exciting area. The framework can be accessed at: https://allenact.org/
Related papers
- Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI [129.08019405056262]
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial Intelligence (AGI)
MLMs andWMs have attracted significant attention due to their remarkable perception, interaction, and reasoning capabilities.
In this survey, we give a comprehensive exploration of the latest advancements in Embodied AI.
arXiv Detail & Related papers (2024-07-09T14:14:47Z) - OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Code [6.067502582087556]
Open-ended and AI-generating algorithms aim to continuously generate and solve increasingly complex tasks indefinitely.
To accomplish this grand vision, learning must occur within a vast array of potential tasks.
We introduce a novel framework, OMNI-EPIC, that augments previous work in Open-endedness.
arXiv Detail & Related papers (2024-05-24T13:57:32Z) - A call for embodied AI [1.7544885995294304]
We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence.
By broadening the scope of Embodied AI, we introduce a theoretical framework based on cognitive architectures.
This framework is aligned with Friston's active inference principle, offering a comprehensive approach to EAI development.
arXiv Detail & Related papers (2024-02-06T09:11:20Z) - OpenAGI: When LLM Meets Domain Experts [51.86179657467822]
Human Intelligence (HI) excels at combining basic skills to solve complex tasks.
This capability is vital for Artificial Intelligence (AI) and should be embedded in comprehensive AI Agents.
We introduce OpenAGI, an open-source platform designed for solving multi-step, real-world tasks.
arXiv Detail & Related papers (2023-04-10T03:55:35Z) - DIAMBRA Arena: a New Reinforcement Learning Platform for Research and
Experimentation [91.3755431537592]
This work presents DIAMBRA Arena, a new platform for reinforcement learning research and experimentation.
It features a collection of high-quality environments exposing a Python API fully compliant with OpenAI Gym standard.
They are episodic tasks with discrete actions and observations composed by raw pixels plus additional numerical values.
arXiv Detail & Related papers (2022-10-19T14:39:10Z) - WenLan 2.0: Make AI Imagine via a Multimodal Foundation Model [74.4875156387271]
We develop a novel foundation model pre-trained with huge multimodal (visual and textual) data.
We show that state-of-the-art results can be obtained on a wide range of downstream tasks.
arXiv Detail & Related papers (2021-10-27T12:25:21Z) - Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society.
A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests.
This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
arXiv Detail & Related papers (2021-06-25T22:31:55Z) - rSoccer: A Framework for Studying Reinforcement Learning in Small and
Very Small Size Robot Soccer [0.0]
This article introduces an open-source simulator for the IEEE Very Small Size Soccer and the Small Size League optimized for reinforcement learning experiments.
We also propose a framework for creating OpenAI Gym environments with a set of benchmarks tasks for evaluating single-agent and multi-agent robot soccer skills.
arXiv Detail & Related papers (2021-06-15T01:30:21Z) - Learning as Reinforcement: Applying Principles of Neuroscience for More
General Reinforcement Learning Agents [1.0742675209112622]
We implement an architecture founded in principles of experimental neuroscience, by combining computationally efficient abstractions of biological algorithms.
Our approach is inspired by research on spike-timing dependent plasticity, the transition between short and long term memory, and the role of various neurotransmitters in rewarding curiosity.
The Neurons-in-a-Box architecture can learn in a wholly generalizable manner, and demonstrates an efficient way to build and apply representations without explicitly optimizing over a set of criteria or actions.
arXiv Detail & Related papers (2020-04-20T04:06:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.