Neuroscience-inspired perception-action in robotics: applying active inference for state estimation, control and self-perception

• URL: http://arxiv.org/abs/2105.04261v1
• Date: Mon, 10 May 2021 10:59:38 GMT
• Title: Neuroscience-inspired perception-action in robotics: applying active inference for state estimation, control and self-perception
• Authors: Pablo Lanillos, Marcel van Gerven
• Abstract summary: We discuss how neuroscience findings open up opportunities to improve current estimation and control algorithms in robotics. This paper summarizes some experiments and lessons learned from developing such a computational model on real embodied platforms.
• Score: 2.1067139116005595
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Unlike robots, humans learn, adapt and perceive their bodies by interacting with the world. Discovering how the brain represents the body and generates actions is of major importance for robotics and artificial intelligence. Here we discuss how neuroscience findings open up opportunities to improve current estimation and control algorithms in robotics. In particular, how active inference, a mathematical formulation of how the brain resists a natural tendency to disorder, provides a unified recipe to potentially solve some of the major challenges in robotics, such as adaptation, robustness, flexibility, generalization and safe interaction. This paper summarizes some experiments and lessons learned from developing such a computational model on real embodied platforms, i.e., humanoid and industrial robots. Finally, we showcase the limitations and challenges that we are still facing to give robots human-like perception

Related papers

• HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation [50.616995671367704]
  We present a high-dimensional, simulated robot learning benchmark, HumanoidBench, featuring a humanoid robot equipped with dexterous hands. Our findings reveal that state-of-the-art reinforcement learning algorithms struggle with most tasks, whereas a hierarchical learning approach achieves superior performance when supported by robust low-level policies.
  arXiv  Detail & Related papers  (2024-03-15T17:45:44Z)
• Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning [54.636562516974884]
  In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on. In this work, we propose MEDAL++, a novel design for self-improving robotic systems. The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
  arXiv  Detail & Related papers  (2023-03-02T18:51:38Z)
• World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challenges [51.92834011423463]
  We focus on the two concepts of world models and predictive coding. In neuroscience, predictive coding proposes that the brain continuously predicts its inputs and adapts to model its own dynamics and control behavior in its environment.
  arXiv  Detail & Related papers  (2023-01-14T06:38:14Z)
• Towards Modeling and Influencing the Dynamics of Human Learning [26.961274302321343]
  We take a step towards enabling robots to understand the influence they have, leverage it to better assist people, and help human models more quickly align with reality. Our key idea is to model the human's learning as a nonlinear dynamical system which evolves the human's internal model given new observations. We then formalize how robots can influence human learning by embedding the human's learning dynamics model into the robot planning problem.
  arXiv  Detail & Related papers  (2023-01-02T23:59:45Z)
• HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration [57.045140028275036]
  We show that manipulation skills can be transferred from a human to a robot through the use of micro-evolutionary reinforcement learning. We propose an algorithm for multi-dimensional evolution path searching that allows joint optimization of both the robot evolution path and the policy.
  arXiv  Detail & Related papers  (2022-12-08T15:56:13Z)
• Learning body models: from humans to humanoids [2.855485723554975]
  Humans and animals excel in combining information from multiple sensory modalities, controlling their complex bodies, adapting to growth, failures, or using tools. Key foundation is an internal representation of the body that the agent - human, animal, or robot - has developed. mechanisms of operation of body models in the brain are largely unknown and even less is known about how they are constructed from experience after birth.
  arXiv  Detail & Related papers  (2022-11-06T07:30:01Z)
• Robots with Different Embodiments Can Express and Influence Carefulness in Object Manipulation [104.5440430194206]
  This work investigates the perception of object manipulations performed with a communicative intent by two robots. We designed the robots' movements to communicate carefulness or not during the transportation of objects.
  arXiv  Detail & Related papers  (2022-08-03T13:26:52Z)
• Data-driven emotional body language generation for social robotics [58.88028813371423]
  In social robotics, endowing humanoid robots with the ability to generate bodily expressions of affect can improve human-robot interaction and collaboration. We implement a deep learning data-driven framework that learns from a few hand-designed robotic bodily expressions. The evaluation study found that the anthropomorphism and animacy of the generated expressions are not perceived differently from the hand-designed ones.
  arXiv  Detail & Related papers  (2022-05-02T09:21:39Z)
• Sensorimotor representation learning for an "active self" in robots: A model survey [10.649413494649293]
  In humans, these capabilities are thought to be related to our ability to perceive our body in space. This paper reviews the developmental processes of underlying mechanisms of these abilities. We propose a theoretical computational framework, which aims to allow the emergence of the sense of self in artificial agents.
  arXiv  Detail & Related papers  (2020-11-25T16:31:01Z)
• Modeling emotion for human-like behavior in future intelligent robots [0.913755431537592]
  We show how neuroscience can help advance the current state of the art. We argue that a stronger integration of emotion-related processes in robot models is critical for the design of human-like behavior.
  arXiv  Detail & Related papers  (2020-09-30T17:32:30Z)
• A Survey of Behavior Learning Applications in Robotics -- State of the Art and Perspectives [44.45953630612019]
  Recent success of machine learning in many domains has been overwhelming. We will give a broad overview of behaviors that have been learned and used on real robots.
  arXiv  Detail & Related papers  (2019-06-05T07:54:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.