The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents

• URL: http://arxiv.org/abs/2201.00411v1
• Date: Sun, 2 Jan 2022 20:14:01 GMT
• Title: The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents
• Authors: Sarah Pratt, Luca Weihs, Ali Farhadi
• Abstract summary: We argue for an introspective agent, which considers its own abilities in the context of its environment. Just as in nature, we hope to reframe strategy as one tool, among many, to succeed in an environment.
• Score: 51.94554095091305
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success, biological organisms still hold one large advantage over these simulated agents: adaptation. While both living and simulated agents make decisions to achieve goals (strategy), biological organisms have evolved to understand their environment (sensing) and respond to it (physiology). The net gain of these factors depends on the environment, and organisms have adapted accordingly. For example, in a low vision aquatic environment some fish have evolved specific neurons which offer a predictable, but incredibly rapid, strategy to escape from predators. Mammals have lost these reactive systems, but they have a much larger fields of view and brain circuitry capable of understanding many future possibilities. While traditional embodied agents manipulate an environment to best achieve a goal, we argue for an introspective agent, which considers its own abilities in the context of its environment. We show that different environments yield vastly different optimal designs, and increasing long-term planning is often far less beneficial than other improvements, such as increased physical ability. We present these findings to broaden the definition of improvement in embodied AI passed increasingly complex models. Just as in nature, we hope to reframe strategy as one tool, among many, to succeed in an environment. Code is available at: https://github.com/sarahpratt/introspective.

Related papers

• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• Evolving Reservoirs for Meta Reinforcement Learning [1.6874375111244329]
  We propose a computational model for studying a mechanism that can enable such a process. At the evolutionary scale, we evolve reservoirs, a family of recurrent neural networks. We employ these evolved reservoirs to facilitate the learning of a behavioral policy through Reinforcement Learning (RL) Our results show that the evolution of reservoirs can improve the learning of diverse challenging tasks.
  arXiv  Detail & Related papers  (2023-12-09T16:11:48Z)
• DARLEI: Deep Accelerated Reinforcement Learning with Evolutionary Intelligence [77.78795329701367]
  We present DARLEI, a framework that combines evolutionary algorithms with parallelized reinforcement learning. We characterize DARLEI's performance under various conditions, revealing factors impacting diversity of evolved morphologies. We hope to extend DARLEI in future work to include interactions between diverse morphologies in richer environments.
  arXiv  Detail & Related papers  (2023-12-08T16:51:10Z)
• Learning Goal-based Movement via Motivational-based Models in Cognitive Mobile Robots [58.720142291102135]
  Humans have needs motivating their behavior according to intensity and context. We also create preferences associated with each action's perceived pleasure, which is susceptible to changes over time. This makes decision-making more complex, requiring learning to balance needs and preferences according to the context.
  arXiv  Detail & Related papers  (2023-02-20T04:52:24Z)
• Eco-evolutionary Dynamics of Non-episodic Neuroevolution in Large Multi-agent Environments [0.0]
  We present a method for continuously evolving adaptive agents without any environment or population reset. We show that NE can operate in an ecologically non-episodic multi-agent setting, finding sustainable collective foraging strategies.
  arXiv  Detail & Related papers  (2023-02-18T13:57:27Z)
• Neuromorphic Computing and Sensing in Space [69.34740063574921]
  Neuromorphic computer chips are designed to mimic the architecture of a biological brain. The emphasis on low power and energy efficiency of neuromorphic devices is a perfect match for space applications.
  arXiv  Detail & Related papers  (2022-12-10T07:46:29Z)
• The scaling of goals via homeostasis: an evolutionary simulation, experiment and analysis [0.0]
  We propose that evolution pivoted the collective intelligence of cells during morphogenesis into behavioral intelligence by scaling up the goal states at the center of homeostatic processes. We found that these emergent morphogenetic agents exhibit a number of predicted features, including the use of stress propagation dynamics to achieve its target morphology. We propose that this system is a first step toward a quantitative understanding of how evolution scales minimal goal-directed behavior (homeostatic loops) into higher-level problem-solving agents in morphogenetic and other spaces.
  arXiv  Detail & Related papers  (2022-11-15T21:48:44Z)
• Towards the Neuroevolution of Low-level Artificial General Intelligence [5.2611228017034435]
  We argue that the search for Artificial General Intelligence (AGI) should start from a much lower level than human-level intelligence. Our hypothesis is that learning occurs through sensory feedback when an agent acts in an environment. We evaluate a method to evolve a biologically-inspired artificial neural network that learns from environment reactions.
  arXiv  Detail & Related papers  (2022-07-27T15:30:50Z)
• Co-optimising Robot Morphology and Controller in a Simulated Open-Ended Environment [1.4502611532302039]
  We show how changing the environment, where the agent locomotes, affects the convergence of morphologies. We show that agent-populations evolving in open-endedly evolving environments exhibit larger morphological diversity than agent-populations evolving in hand crafted curricula of environments.
  arXiv  Detail & Related papers  (2021-04-07T11:28:23Z)
• Embodied Intelligence via Learning and Evolution [92.26791530545479]
  We show that environmental complexity fosters the evolution of morphological intelligence. We also show that evolution rapidly selects morphologies that learn faster. Our experiments suggest a mechanistic basis for both the Baldwin effect and the emergence of morphological intelligence.
  arXiv  Detail & Related papers  (2021-02-03T18:58:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.