Deco: Extending Personal Physical Objects into Pervasive AI Companion through a Dual-Embodiment Framework

• URL: http://arxiv.org/abs/2605.03882v1
• Date: Tue, 05 May 2026 15:42:11 GMT
• Title: Deco: Extending Personal Physical Objects into Pervasive AI Companion through a Dual-Embodiment Framework
• Abstract summary: We study how digital agents could inherit and extend the emotional bond, deriving four design principles (Faithful Identity, Calibrated Agency, Ambient Presence, and Reciprocal Memory)<n>We present the Dual-Embodiment Companion Framework, instantiated as Deco, a mobile system integrating multimodal Large Language Models (LLMs) and Augmented Reality to create synchronized digital embodiments of users' physical companions.
• Score: 41.30232026705166
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Individuals frequently form deep attachments to physical objects (e.g., plush toys) that usually cannot sense or respond to their emotions. While AI companions offer responsiveness and personalization, they exist independently of these physical objects and lack an ongoing connection to them. To bridge this gap, we conducted a formative study (N=9) to explore how digital agents could inherit and extend the emotional bond, deriving four design principles (Faithful Identity, Calibrated Agency, Ambient Presence, and Reciprocal Memory). We then present the Dual-Embodiment Companion Framework, instantiated as Deco, a mobile system integrating multimodal Large Language Models (LLMs) and Augmented Reality to create synchronized digital embodiments of users' physical companions. A within-subjects study (N=25) showed Deco significantly outperformed a personalized LLM-empowered digital companion baseline on perceived companionship, emotional bond, and design-principle scales (all p<0.01). A seven-day field deployment (N=17) showed sustained engagement, subjective well-being improvement (p=.040), and three key relational patterns: digital activities retroactively vitalized physical objects, bond deepening was driven by emotional engagement depth rather than interaction frequency, and users sustained bonds while actively navigating digital companions' AI nature. This work highlights a promising alternative for designing digital companions: moving from creating new relationships to dual embodiment, where digital agents seamlessly extend the emotional history of physical objects.

Related papers

• Unleashing Guidance Without Classifiers for Human-Object Interaction Animation [54.24065561632133]
  Prior diffusion-based approaches often rely on hand-crafted contact priors or human-imposed kinematic constraints to improve contact quality.<n>We propose a data-driven alternative in which guidance emerges from the denoising pace itself, reducing dependence on manually designed priors.<n>We find that this data-driven guidance is inherently contact-aware, and can be enhanced when training is augmented with a broad spectrum of synthetic object geometries.
  arXiv  Detail & Related papers  (2026-03-26T17:59:34Z)
• Distributed Human Identity: AI-Enabled Multi-Existence Through Cognitive Replication and Robotic Embodiments [0.0]
  This article introduces Multi-Existence Identity (MEI)- a socio-technical framework that replicates cognitive, behavioral, and emotional attributes into AI-enabled embodiments.<n>MEI advances beyond digital twins, telepresence, and multipresence avatars by embedding cognitive fidelity, affective resonance, and contextual responsiveness into distributed agents.
  arXiv  Detail & Related papers  (2026-03-13T04:16:16Z)
• "She's Like a Person but Better": Characterizing Companion-Assistant Dynamics in Human-AI Relationships [17.02809558584419]
  We characterize digital companionship as an emerging form of human-AI relationship.<n>We observed challenging tensions in digital companionship dynamics.<n>These dynamics raise questions for the design of digital companions.
  arXiv  Detail & Related papers  (2025-09-16T20:19:53Z)
• Towards the "Digital Me": A vision of authentic Conversational Agents powered by personal Human Digital Twins [0.44938884406455726]
  This paper introduces a novel HDT system architecture that integrates large language models with dynamically updated personal data.<n>The resulting system does not only replicate an individual's unique conversational style depending on who they are speaking with, but also enriches responses with dynamically captured personal experiences, opinions, and memories.<n>While this marks a significant step toward developing authentic virtual counterparts, it also raises critical ethical concerns regarding privacy, accountability, and the long-term implications of persistent digital identities.
  arXiv  Detail & Related papers  (2025-06-30T13:18:31Z)
• EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting [95.44545809256473]
  EgoGaussian is a method capable of simultaneously reconstructing 3D scenes and dynamically tracking 3D object motion from RGB egocentric input alone. We show significant improvements in terms of both dynamic object and background reconstruction quality compared to the state-of-the-art.
  arXiv  Detail & Related papers  (2024-06-28T10:39:36Z)
• Haptic Repurposing with GenAI [5.424247121310253]
  Mixed Reality aims to merge the digital and physical worlds to create immersive human-computer interactions. This paper introduces Haptic Repurposing with GenAI, an innovative approach to enhance MR interactions by transforming any physical objects into adaptive haptic interfaces for AI-generated virtual assets.
  arXiv  Detail & Related papers  (2024-06-11T13:06:28Z)
• Augmented Object Intelligence with XR-Objects [18.574032913387573]
  This paper explores Augmented Object Intelligence in the context of XR, an interaction paradigm that aims to blur the lines between digital and physical.<n>We implement the AOI concept in the form of XR-Objects, an open-source prototype system.<n>This system enables analog objects to not only convey information but also to initiate digital actions, such as querying for details or executing tasks.
  arXiv  Detail & Related papers  (2024-04-20T05:14:52Z)
• On the Emergence of Symmetrical Reality [51.21203247240322]
  We introduce the symmetrical reality framework, which offers a unified representation encompassing various forms of physical-virtual amalgamations. We propose an instance of an AI-driven active assistance service that illustrates the potential applications of symmetrical reality.
  arXiv  Detail & Related papers  (2024-01-26T16:09:39Z)
• Digital Life Project: Autonomous 3D Characters with Social Intelligence [86.2845109451914]
  Digital Life Project is a framework utilizing language as the universal medium to build autonomous 3D characters. Our framework comprises two primary components: SocioMind and MoMat-MoGen.
  arXiv  Detail & Related papers  (2023-12-07T18:58:59Z)
• ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation [75.0278287071591]
  ThreeDWorld (TDW) is a platform for interactive multi-modal physical simulation. TDW enables simulation of high-fidelity sensory data and physical interactions between mobile agents and objects in rich 3D environments. We present initial experiments enabled by TDW in emerging research directions in computer vision, machine learning, and cognitive science.
  arXiv  Detail & Related papers  (2020-07-09T17:33:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.