World Models and Predictive Coding for Cognitive and Developmental
Robotics: Frontiers and Challenges
- URL: http://arxiv.org/abs/2301.05832v1
- Date: Sat, 14 Jan 2023 06:38:14 GMT
- Title: World Models and Predictive Coding for Cognitive and Developmental
Robotics: Frontiers and Challenges
- Authors: Tadahiro Taniguchi, Shingo Murata, Masahiro Suzuki, Dimitri Ognibene,
Pablo Lanillos, Emre Ugur, Lorenzo Jamone, Tomoaki Nakamura, Alejandra Ciria,
Bruno Lara, and Giovanni Pezzulo
- Abstract summary: We focus on the two concepts of world models and predictive coding.
In neuroscience, predictive coding proposes that the brain continuously predicts its inputs and adapts to model its own dynamics and control behavior in its environment.
- Score: 51.92834011423463
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Creating autonomous robots that can actively explore the environment, acquire
knowledge and learn skills continuously is the ultimate achievement envisioned
in cognitive and developmental robotics. Their learning processes should be
based on interactions with their physical and social world in the manner of
human learning and cognitive development. Based on this context, in this paper,
we focus on the two concepts of world models and predictive coding. Recently,
world models have attracted renewed attention as a topic of considerable
interest in artificial intelligence. Cognitive systems learn world models to
better predict future sensory observations and optimize their policies, i.e.,
controllers. Alternatively, in neuroscience, predictive coding proposes that
the brain continuously predicts its inputs and adapts to model its own dynamics
and control behavior in its environment. Both ideas may be considered as
underpinning the cognitive development of robots and humans capable of
continual or lifelong learning. Although many studies have been conducted on
predictive coding in cognitive robotics and neurorobotics, the relationship
between world model-based approaches in AI and predictive coding in robotics
has rarely been discussed. Therefore, in this paper, we clarify the
definitions, relationships, and status of current research on these topics, as
well as missing pieces of world models and predictive coding in conjunction
with crucially related concepts such as the free-energy principle and active
inference in the context of cognitive and developmental robotics. Furthermore,
we outline the frontiers and challenges involved in world models and predictive
coding toward the further integration of AI and robotics, as well as the
creation of robots with real cognitive and developmental capabilities in the
future.
Related papers
- Aligning Generalisation Between Humans and Machines [74.120848518198]
Recent advances in AI have resulted in technology that can support humans in scientific discovery and decision support but may also disrupt democracies and target individuals.
The responsible use of AI increasingly shows the need for human-AI teaming.
A crucial yet often overlooked aspect of these interactions is the different ways in which humans and machines generalise.
arXiv Detail & Related papers (2024-11-23T18:36:07Z) - $π_0$: A Vision-Language-Action Flow Model for General Robot Control [77.32743739202543]
We propose a novel flow matching architecture built on top of a pre-trained vision-language model (VLM) to inherit Internet-scale semantic knowledge.
We evaluate our model in terms of its ability to perform tasks in zero shot after pre-training, follow language instructions from people, and its ability to acquire new skills via fine-tuning.
arXiv Detail & Related papers (2024-10-31T17:22:30Z) - Embodied Neuromorphic Artificial Intelligence for Robotics: Perspectives, Challenges, and Research Development Stack [7.253801704452419]
Recent advances in neuromorphic computing with Spiking Neural Networks (SNN) have demonstrated the potential to enable the embodied intelligence for robotics.
This paper will discuss how we can enable embodied neuromorphic AI for robotic systems through our perspectives.
arXiv Detail & Related papers (2024-04-04T09:52:22Z) - Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions.
In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
arXiv Detail & Related papers (2024-02-28T16:09:56Z) - A call for embodied AI [1.7544885995294304]
We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence.
By broadening the scope of Embodied AI, we introduce a theoretical framework based on cognitive architectures.
This framework is aligned with Friston's active inference principle, offering a comprehensive approach to EAI development.
arXiv Detail & Related papers (2024-02-06T09:11:20Z) - The Future of Fundamental Science Led by Generative Closed-Loop
Artificial Intelligence [67.70415658080121]
Recent advances in machine learning and AI are disrupting technological innovation, product development, and society as a whole.
AI has contributed less to fundamental science in part because large data sets of high-quality data for scientific practice and model discovery are more difficult to access.
Here we explore and investigate aspects of an AI-driven, automated, closed-loop approach to scientific discovery.
arXiv Detail & Related papers (2023-07-09T21:16:56Z) - Machine Psychology [54.287802134327485]
We argue that a fruitful direction for research is engaging large language models in behavioral experiments inspired by psychology.
We highlight theoretical perspectives, experimental paradigms, and computational analysis techniques that this approach brings to the table.
It paves the way for a "machine psychology" for generative artificial intelligence (AI) that goes beyond performance benchmarks.
arXiv Detail & Related papers (2023-03-24T13:24:41Z) - Cognitive science as a source of forward and inverse models of human
decisions for robotics and control [13.502912109138249]
We look at how cognitive science can provide forward models of human decision-making.
We highlight approaches that synthesize blackbox and theory-driven modeling.
We aim to provide readers with a glimpse of the range of frameworks, methodologies, and actionable insights that lie at the intersection of cognitive science and control research.
arXiv Detail & Related papers (2021-09-01T00:28:28Z) - Neuroscience-inspired perception-action in robotics: applying active
inference for state estimation, control and self-perception [2.1067139116005595]
We discuss how neuroscience findings open up opportunities to improve current estimation and control algorithms in robotics.
This paper summarizes some experiments and lessons learned from developing such a computational model on real embodied platforms.
arXiv Detail & Related papers (2021-05-10T10:59:38Z) - Intelligent behavior depends on the ecological niche: Scaling up AI to
human-like intelligence in socio-cultural environments [17.238068736229017]
This paper outlines a perspective on the future of AI, discussing directions for machines models of human-like intelligence.
We emphasize the role of ecological niches in sculpting intelligent behavior, and in particular that human intelligence was fundamentally shaped to adapt to a constantly changing socio-cultural environment.
arXiv Detail & Related papers (2021-03-11T16:24:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.