IndoorWorld: Integrating Physical Task Solving and Social Simulation in A Heterogeneous Multi-Agent Environment

• URL: http://arxiv.org/abs/2506.12331v1
• Date: Sat, 14 Jun 2025 03:44:09 GMT
• Title: IndoorWorld: Integrating Physical Task Solving and Social Simulation in A Heterogeneous Multi-Agent Environment
• Authors: Dekun Wu, Frederik Brudy, Bang Liu, Yi Wang,
• Abstract summary: We introduce IndoorWorld, a heterogeneous multi-agent environment that tightly integrates physical and social dynamics.<n>We demonstrate the potential with a series of experiments within an office setting to examine the impact of multi-agent collaboration, resource competition, and spatial layout on agent behavior.
• Score: 24.052929297990953
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Virtual environments are essential to AI agent research. Existing environments for LLM agent research typically focus on either physical task solving or social simulation, with the former oversimplifying agent individuality and social dynamics, and the latter lacking physical grounding of social behaviors. We introduce IndoorWorld, a heterogeneous multi-agent environment that tightly integrates physical and social dynamics. By introducing novel challenges for LLM-driven agents in orchestrating social dynamics to influence physical environments and anchoring social interactions within world states, IndoorWorld opens up possibilities of LLM-based building occupant simulation for architectural design. We demonstrate the potential with a series of experiments within an office setting to examine the impact of multi-agent collaboration, resource competition, and spatial layout on agent behavior.

Related papers

• Modeling Earth-Scale Human-Like Societies with One Billion Agents [54.465233996410156]
  Light Society is an agent-based simulation framework.<n>It formalizes social processes as structured transitions of agent and environment states.<n>It supports efficient simulation of societies with over one billion agents.
  arXiv  Detail & Related papers  (2025-06-07T09:14:12Z)
• SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users [70.02370111025617]
  We introduce SocioVerse, an agent-driven world model for social simulation.<n>Our framework features four powerful alignment components and a user pool of 10 million real individuals.<n>Results demonstrate that SocioVerse can reflect large-scale population dynamics while ensuring diversity, credibility, and representativeness.
  arXiv  Detail & Related papers  (2025-04-14T12:12:52Z)
• AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society [32.849311155921264]
  We propose AgentSociety, a large-scale social simulator that integrates a realistic societal environment.<n>Based on the proposed simulator, we generate social lives for over 10k agents, simulating their 5 million interactions.<n>We focus on four key social issues: polarization, the spread of inflammatory messages, the effects of universal basic income policies, and the impact of external shocks such as hurricanes.
  arXiv  Detail & Related papers  (2025-02-12T15:27:07Z)
• AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making [45.71942183664368]
  We introduce AdaSociety, a customizable multi-agent environment featuring expanding state and action spaces.<n>As agents progress, the environment adaptively generates new tasks with social structures for agents to undertake.<n>AdaSociety serves as a valuable research platform for exploring intelligence in diverse physical and social settings.
  arXiv  Detail & Related papers  (2024-11-06T12:19:01Z)
• Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models [36.571597246832326]
  Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems. This paper aims to integrate agents & world interaction into a single simulation where multiple agents can work together to solve a problem. We implement two simulations: a physical studio apartment with two roommates, and another where agents collaborate to complete a programming task.
  arXiv  Detail & Related papers  (2024-09-14T21:53:35Z)
• Large Language Model-based Human-Agent Collaboration for Complex Task Solving [94.3914058341565]
  We introduce the problem of Large Language Models (LLMs)-based human-agent collaboration for complex task-solving. We propose a Reinforcement Learning-based Human-Agent Collaboration method, ReHAC. This approach includes a policy model designed to determine the most opportune stages for human intervention within the task-solving process.
  arXiv  Detail & Related papers  (2024-02-20T11:03:36Z)
• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents [107.4138224020773]
  We present SOTOPIA, an open-ended environment to simulate complex social interactions between artificial agents and humans. In our environment, agents role-play and interact under a wide variety of scenarios; they coordinate, collaborate, exchange, and compete with each other to achieve complex social goals. We find that GPT-4 achieves a significantly lower goal completion rate than humans and struggles to exhibit social commonsense reasoning and strategic communication skills.
  arXiv  Detail & Related papers  (2023-10-18T02:27:01Z)
• Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning [0.7161783472741748]
  We study the behavior of self-interested rational agents that learn world models in a multi-agent reinforcement learning setting. Our simulation results show that groups of agents endowed with world models outperform all the other tested ones when dealing with scenarios where social dilemmas can arise.
  arXiv  Detail & Related papers  (2023-05-19T00:31:26Z)
• PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception [50.551003004553806]
  We create a dataset of physically-grounded abstract social events, PHASE, that resemble a wide range of real-life social interactions. Phase is validated with human experiments demonstrating that humans perceive rich interactions in the social events. As a baseline model, we introduce a Bayesian inverse planning approach, SIMPLE, which outperforms state-of-the-art feed-forward neural networks.
  arXiv  Detail & Related papers  (2021-03-02T18:44:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.