Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?

• URL: http://arxiv.org/abs/2605.08816v1
• Date: Sat, 09 May 2026 09:10:00 GMT
• Title: Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?
• Abstract summary: In the animal kingdom, mirror self-recognition is a canonical probe of higher-order cognition, emerging only in some species.<n>We ask whether an analogous functional capability emerges in embodied vision-language model (VLM) agents: can they recognize themselves in a mirror?
• Score: 12.841846686021023
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the animal kingdom, mirror self-recognition is a canonical probe of higher-order cognition, emerging only in some species. We ask whether an analogous functional capability emerges in embodied vision-language model (VLM) agents: can they recognize themselves in a mirror? We introduce a controlled 3D benchmark where a first-person VLM agent must infer a hidden body attribute from its reflection and select the matching target, while avoiding self-other misattribution. To separate mirror-grounded self-identification from shortcuts, we test mirror removal, misleading cues, and occluded reflections. We also evaluate the decision process through mirror seeking, temporal ordering, self-attribution, and reasoning-action consistency. Our experiments show that mirror-based self-identification emerges mainly in stronger VLMs. These models can use reflected evidence for action, whereas weaker models often inspect the mirror but fail to extract self-relevant information or misattribute their reflection. Language-vision conflict further shows that self-referential language alone is not evidence of grounded self-identification. Overall, mirror-based evaluation provides a diagnostic for whether embodied self-grounding is causally rooted in perception and action rather than priors, prompt compliance, or confabulation.

Related papers

• Are VLMs Seeing or Just Saying? Uncovering the Illusion of Visual Re-examination [39.713386491199884]
  Vision-Language Models (VLMs) often produce self-reflective statements like "let me check the figure again" during reasoning.<n>Do such statements trigger genuine visual re-examination, or are they merely learned textual patterns?<n>We investigate this via VisualSwap, an image-swap probing framework.
  arXiv  Detail & Related papers  (2026-05-15T11:31:14Z)
• MirrorBench: Evaluating Self-centric Intelligence in MLLMs by Introducing a Mirror [68.92922229518848]
  We introduce MirrorBench, a simulation-based benchmark inspired by the classical Mirror Self-Recognition (MSR) test in psychology.<n>MirrorBench extends this paradigm to embodied MLLMs through a tiered framework of progressively challenging tasks.<n>Our study bridges psychological paradigms and embodied intelligence, offering a principled framework for evaluating the emergence of general intelligence in large models.
  arXiv  Detail & Related papers  (2026-04-16T08:45:34Z)
• Active Inference with a Self-Prior in the Mirror-Mark Task [7.031699672463923]
  The mirror self-recognition test evaluates whether a subject touches a mark on its own body that is visible only in a mirror, and is widely used as an indicator of self-awareness.<n>We present a computational model in which this behavior emerges spontaneously through a single mechanism, the self-prior, without any external reward.
  arXiv  Detail & Related papers  (2026-04-02T08:15:03Z)
• Through the Lens of Contrast: Self-Improving Visual Reasoning in VLMs [60.93949629734977]
  We propose Visual Contrastive Self-Taught Reasoner (VC-STaR) to mitigate hallucinations in model-generated rationales.<n>We collect a diverse suite of VQA datasets, curate contrastive pairs according to multi-modal similarity, and generate rationales using VC-STaR.<n>Extensive experiments show that VC-STaR not only outperforms existing self-improving approaches but also surpasses models finetuned on the SoTA visual reasoning datasets.
  arXiv  Detail & Related papers  (2026-03-03T03:18:31Z)
• Learning from Trials and Errors: Reflective Test-Time Planning for Embodied LLMs [63.88783817420284]
  Embodied robots cannot reflect on what went wrong or why, turning deployment into a sequence of independent trials.<n>We introduce Reflective Test-Time Planning, which integrates two modes of reflection: textitreflection-in-action and textitreflection-on-action<n>We also include retrospective reflection, allowing the agent to re-evaluate earlier decisions and perform model updates with hindsight.
  arXiv  Detail & Related papers  (2026-02-24T18:55:18Z)
• Agent0-VL: Exploring Self-Evolving Agent for Tool-Integrated Vision-Language Reasoning [52.99434388759101]
  We propose a self-evolving vision-language agent that achieves continual improvement with tool-integrated reasoning.<n>Agent0-VL incorporates tool usage not only into reasoning but also into self-evaluation and self-repair.<n>Our experiments show that Agent0-VL achieves an 12.5% improvement over the base model.
  arXiv  Detail & Related papers  (2025-11-25T04:15:14Z)
• Mirror-Consistency: Harnessing Inconsistency in Majority Voting [37.707204723835765]
  We present Mirror-Consistency, an enhancement of the standard Self-Consistency approach.<n>Mirror-Consistency incorporates a'reflective mirror' into the self-ensemble decoding process.<n>We show that Mirror-Consistency yields superior performance in both reasoning accuracy and confidence calibration compared to Self-Consistency.
  arXiv  Detail & Related papers  (2024-10-07T03:41:08Z)
• AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models [91.78328878860003]
  Large vision-language models (LVLMs) are prone to hallucinations. benchmarks often rely on hand-crafted corner cases whose failure patterns may not generalize well. We develop AutoHallusion, the first automated benchmark generation approach.
  arXiv  Detail & Related papers  (2024-06-16T11:44:43Z)
• Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives [45.87069217634753]
  Research indicates without external feedback, Large Language Model's intrinsic reflection is unstable. Our investigation unveils that the key bottleneck is the quality of the self-evaluated feedback. We advocate Self-Contrast: It adaptively explores diverse solving perspectives tailored to the request, contrasts the differences, and summarizes these discrepancies into a checklist which could be used to re-examine and eliminate discrepancies.
  arXiv  Detail & Related papers  (2024-01-04T00:32:33Z)
• Robot in the mirror: toward an embodied computational model of mirror self-recognition [1.9686770963118383]
  The mirror self-recognition test consists in covertly putting a mark on the face of the tested subject, placing her in front of a mirror, and observing the reactions. In this work, we provide a mechanistic decomposition, or process model, of what components are required to pass this test. We develop a model to enable the humanoid robot Nao to pass the test.
  arXiv  Detail & Related papers  (2020-11-09T15:11:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.