Simulating the Resident: Generating Executable Smart Home Schedules via LLM Personas

• URL: http://arxiv.org/abs/2607.08231v1
• Date: Thu, 09 Jul 2026 08:26:50 GMT
• Title: Simulating the Resident: Generating Executable Smart Home Schedules via LLM Personas
• Abstract summary: We propose using LLMs to generate diverse resident personas that interact with a simulated smart home.<n>We present (1) a design framework configuring simulated households across five socio-technical dimensions, (2) a multi-stage LLM pipeline that produces structured, executable device interaction schedules, and (3) a proof of concept demonstrating feasibility.<n>As a work in progress, we aim to support scalable, privacy-conscious smart-home experimentation without relying on intrusive real-world data collection.
• Score: 1.1666234644810893
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Smart homes have emerged as an important domain for HCI research, including work on usable security and privacy. Ideally, studies in these areas draw on datasets collected in real homes with real residents, capturing authentic device interactions, network traffic, and daily routines. However, creating such datasets is slow, expensive, and raises significant privacy concerns, as it requires long-term observation of people in their most private spaces. We propose using LLMs to generate diverse resident personas that interact with a simulated smart home, producing behaviorally grounded interaction schedules that can be executed on physical testbeds. We present (1) a design framework configuring simulated households across five socio-technical dimensions, (2) a multi-stage LLM pipeline that produces structured, executable device interaction schedules, and (3) a proof of concept demonstrating feasibility. As a work in progress, we aim to support scalable, privacy-conscious smart-home experimentation without relying on intrusive real-world data collection.

Related papers

• Spatial-Knowledge-Graph-Grounded LLM Agents for Neighborhood Livability Evaluation [0.0]
  Neighborhood livability is commonly assessed with static built-environment indicators, such as facility proximity, street connectivity, and access to public space.<n>This paper presents a prototype framework that uses a spatial knowledge graph (KG) and large language models (LLMs) to generate household schedules.<n>The framework offers an auditable way to connect spatial opportunity, household activity constraints, and resident-specific livability interpretation.
  arXiv  Detail & Related papers  (2026-08-26T16:05:57Z)
• SMH-Bench: Benchmarking LLM Agents for Environment-Grounded Reasoning and Action in Smart Homes [21.9224048962238]
  We introduce SMH-Bench, a comprehensive benchmark for evaluating Large Language Models (LLMs) in smart-home environments.<n>Built upon HomeEnv, an executable and verifiable smart-home simulator, SMH-Bench contains 1,100 high-quality tasks spanning 7 categories and 22 fine-grained subcategories.
  arXiv  Detail & Related papers  (2026-06-01T08:48:15Z)
• Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistants [85.1155076383488]
  Pare is a framework for building and evaluating proactive agents in digital environments.<n>Pare-Bench is a benchmark of 143 diverse tasks spanning communication, productivity, scheduling, and lifestyle apps.
  arXiv  Detail & Related papers  (2026-04-01T12:53:01Z)
• Individual Turing Test: A Case Study of LLM-based Simulation Using Longitudinal Personal Data [54.145424717168794]
  Large Language Models (LLMs) have demonstrated remarkable human-like capabilities, yet their ability to replicate a specific individual remains under-explored.<n>This paper presents a case study to investigate LLM-based individual simulation with a volunteer-contributed archive of private messaging history spanning over ten years.<n>We propose the "Individual Turing Test" to evaluate whether acquaintances of the volunteer can correctly identify which response in a multi-candidate pool most plausibly comes from the volunteer.
  arXiv  Detail & Related papers  (2026-03-01T21:46:27Z)
• MolmoSpaces: A Large-Scale Open Ecosystem for Robot Navigation and Manipulation [56.30931340537373]
  MolmoSpaces is a fully open ecosystem to support benchmarking of robot policies.<n>MolmoSpaces consists of over 230k diverse indoor environments.<n>MolmoSpaces-Bench is a benchmark suite of 8 tasks in which robots interact with our diverse scenes and richly annotated objects.
  arXiv  Detail & Related papers  (2026-02-11T20:16:31Z)
• DomusFM: A Foundation Model for Smart-Home Sensor Data [11.28458211143065]
  We introduce DomusFM, the first foundation model specifically designed and pretrained for smart-home sensor data.<n>DomusFM employs a self-supervised dual contrastive learning paradigm to capture both token-level semantic attributes and sequence-level temporal dependencies.<n>Our approach addresses data scarcity while maintaining practical deployability for real-world smart-home systems.
  arXiv  Detail & Related papers  (2026-02-02T10:16:34Z)
• TongSIM: A General Platform for Simulating Intelligent Machines [59.27575233453533]
  Embodied intelligence focuses on training agents within realistic simulated environments.<n>TongSIM is a high-fidelity, general-purpose platform for training and evaluating embodied agents.
  arXiv  Detail & Related papers  (2025-12-23T10:00:43Z)
• SimuHome: A Temporal- and Environment-Aware Benchmark for Smart Home LLM Agents [10.925787133867951]
  SimuHome is a time-accelerated home environment that simulates smart devices, supports API calls, and reflects changes in environmental variables.<n>SimuHome provides a high-fidelity environment, and agents validated in SimuHome can be deployed on real Matter-compliant devices with minimal adaptation.<n>Our evaluation of 11 agents under a unified ReAct framework reveals that while models perform well on simple tasks, they struggle with latent intent inference, state verification, and especially temporal scheduling.
  arXiv  Detail & Related papers  (2025-09-29T04:54:20Z)
• AgentSense: Virtual Sensor Data Generation Using LLM Agents in Simulated Home Environments [2.9698967396161624]
  We leverage the idea of embodied AI agents-virtual agents that perceive and act within simulated environments guided by internal world models.<n>We introduce AgentSense, a virtual data generation pipeline in which agents live out daily routines in simulated smart homes.<n>Our approach produces rich, privacy-preserving sensor data that reflects real-world diversity.
  arXiv  Detail & Related papers  (2025-06-13T13:31:08Z)
• OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation [56.47029531207105]
  OPERA is the first public dataset that comprehensively captures user personas, browser observations, fine-grained web actions, and self-reported just-in-time rationales.<n>We establish the first benchmark to evaluate how well current LLMs can predict a specific user's next action and rationale.
  arXiv  Detail & Related papers  (2025-06-05T21:37:49Z)
• Learning to Move with Affordance Maps [57.198806691838364]
  The ability to autonomously explore and navigate a physical space is a fundamental requirement for virtually any mobile autonomous agent. Traditional SLAM-based approaches for exploration and navigation largely focus on leveraging scene geometry. We show that learned affordance maps can be used to augment traditional approaches for both exploration and navigation, providing significant improvements in performance.
  arXiv  Detail & Related papers  (2020-01-08T04:05:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.