Robot in the mirror: toward an embodied computational model of mirror self-recognition

• URL: http://arxiv.org/abs/2011.04485v1
• Date: Mon, 9 Nov 2020 15:11:31 GMT
• Title: Robot in the mirror: toward an embodied computational model of mirror self-recognition
• Authors: Matej Hoffmann, Shengzhi Wang, Vojtech Outrata, Elisabet Alzueta, Pablo Lanillos
• Abstract summary: The mirror self-recognition test consists in covertly putting a mark on the face of the tested subject, placing her in front of a mirror, and observing the reactions. In this work, we provide a mechanistic decomposition, or process model, of what components are required to pass this test. We develop a model to enable the humanoid robot Nao to pass the test.
• Score: 1.9686770963118383
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Self-recognition or self-awareness is a capacity attributed typically only to humans and few other species. The definitions of these concepts vary and little is known about the mechanisms behind them. However, there is a Turing test-like benchmark: the mirror self-recognition, which consists in covertly putting a mark on the face of the tested subject, placing her in front of a mirror, and observing the reactions. In this work, first, we provide a mechanistic decomposition, or process model, of what components are required to pass this test. Based on these, we provide suggestions for empirical research. In particular, in our view, the way the infants or animals reach for the mark should be studied in detail. Second, we develop a model to enable the humanoid robot Nao to pass the test. The core of our technical contribution is learning the appearance representation and visual novelty detection by means of learning the generative model of the face with deep auto-encoders and exploiting the prediction error. The mark is identified as a salient region on the face and reaching action is triggered, relying on a previously learned mapping to arm joint angles. The architecture is tested on two robots with a completely different face.

Related papers

• Where Am I and What Will I See: An Auto-Regressive Model for Spatial Localization and View Prediction [60.964512894143475]
  We present Generative Spatial Transformer ( GST), a novel auto-regressive framework that jointly addresses spatial localization and view prediction. Our model simultaneously estimates the camera pose from a single image and predicts the view from a new camera pose, effectively bridging the gap between spatial awareness and visual prediction.
  arXiv  Detail & Related papers  (2024-10-24T17:58:05Z)
• Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption [64.07607726562841]
  Existing multi-person human reconstruction approaches mainly focus on recovering accurate poses or avoiding penetration. In this work, we tackle the task of reconstructing closely interactive humans from a monocular video. We propose to leverage knowledge from proxemic behavior and physics to compensate the lack of visual information.
  arXiv  Detail & Related papers  (2024-04-17T11:55:45Z)
• Robot at the Mirror: Learning to Imitate via Associating Self-supervised Models [0.0]
  We introduce an approach to building a custom model from ready-made self-supervised models via their associating instead of training and fine-tuning. We demonstrate it with an example of a humanoid robot looking at the mirror and learning to detect the 3D pose of its own body from the image it perceives.
  arXiv  Detail & Related papers  (2023-11-22T08:30:20Z)
• Robot Learning with Sensorimotor Pre-training [98.7755895548928]
  We present a self-supervised sensorimotor pre-training approach for robotics. Our model, called RPT, is a Transformer that operates on sequences of sensorimotor tokens. We find that sensorimotor pre-training consistently outperforms training from scratch, has favorable scaling properties, and enables transfer across different tasks, environments, and robots.
  arXiv  Detail & Related papers  (2023-06-16T17:58:10Z)
• Do humans and machines have the same eyes? Human-machine perceptual differences on image classification [8.474744196892722]
  Trained computer vision models are assumed to solve vision tasks by imitating human behavior learned from training labels. Our study first quantifies and analyzes the statistical distributions of mistakes from the two sources. We empirically demonstrate a post-hoc human-machine collaboration that outperforms humans or machines alone.
  arXiv  Detail & Related papers  (2023-04-18T05:09:07Z)
• Aligning Robot and Human Representations [50.070982136315784]
  We argue that current representation learning approaches in robotics should be studied from the perspective of how well they accomplish the objective of representation alignment. We mathematically define the problem, identify its key desiderata, and situate current methods within this formalism.
  arXiv  Detail & Related papers  (2023-02-03T18:59:55Z)
• Data-driven emotional body language generation for social robotics [58.88028813371423]
  In social robotics, endowing humanoid robots with the ability to generate bodily expressions of affect can improve human-robot interaction and collaboration. We implement a deep learning data-driven framework that learns from a few hand-designed robotic bodily expressions. The evaluation study found that the anthropomorphism and animacy of the generated expressions are not perceived differently from the hand-designed ones.
  arXiv  Detail & Related papers  (2022-05-02T09:21:39Z)
• Full-Body Visual Self-Modeling of Robot Morphologies [29.76701883250049]
  Internal computational models of physical bodies are fundamental to the ability of robots and animals alike to plan and control their actions. Recent progress in fully data-driven self-modeling has enabled machines to learn their own forward kinematics directly from task-agnostic interaction data. Here, we propose that instead of directly modeling forward-kinematics, a more useful form of self-modeling is one that could answer space occupancy queries.
  arXiv  Detail & Related papers  (2021-11-11T18:58:07Z)
• Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Models [11.925808365657936]
  Ability to generate intelligent and generalizable facial expressions is essential for building human-like social robots. We develop a vision-based self-supervised learning framework for facial mimicry. Our method enables accurate and diverse face mimicry across diverse human subjects.
  arXiv  Detail & Related papers  (2021-05-26T17:57:19Z)
• A robot that counts like a child: a developmental model of counting and pointing [69.26619423111092]
  A novel neuro-robotics model capable of counting real items is introduced. The model allows us to investigate the interaction between embodiment and numerical cognition. The trained model is able to count a set of items and at the same time points to them.
  arXiv  Detail & Related papers  (2020-08-05T21:06:27Z)
• Robot self/other distinction: active inference meets neural networks learning in a mirror [9.398766540452632]
  We present an algorithm that enables a robot to perform non-appearance self-recognition on a mirror. The algorithm combines active inference, a theoretical model of perception and action in the brain, with neural network learning. Experimental results on a humanoid robot show the reliability of the algorithm for different initial conditions.
  arXiv  Detail & Related papers  (2020-04-11T19:51:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.