360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents

• URL: http://arxiv.org/abs/2608.08814v1
• Date: Sun, 09 Aug 2026 17:03:15 GMT
• Title: 360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents
• Abstract summary: We present 360CityArena, a benchmark for evaluating the urban exploration capabilities of embodied agents in a photorealistic environment constructed from 360-degree videos.<n>360CityArena is built on a realistic reconstruction of the Akihabara district in Tokyo, Japan, using 602 360-degree video segments covering 85 streets, and consists of 175 meticulously human-crafted tasks.
• Score: 44.11713684689655
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present 360CityArena, a benchmark for evaluating the urban exploration capabilities of embodied agents within a photorealistic environment constructed from 360-degree videos. Existing outdoor benchmarks either lack sufficient photorealism or complexity, resulting in a considerable gap from real-world urban environments. 360CityArena is built on a realistic reconstruction of the Akihabara district in Tokyo, Japan, using 602 360-degree video segments covering 85 streets, and consists of 175 meticulously human-crafted tasks. It encompasses three task categories: Environment Understanding, Path Reasoning, and Spatial Reasoning, covering fundamental abilities required for urban exploration, such as localization, landmark search, path planning, and relational spatial reasoning, thereby enabling comprehensive evaluation in realistic urban scenes. Our evaluation using state-of-the-art LMM-based agents shows that even the strongest model, Gemini 2.5 Flash, performs far below human level (human: 77.3% vs. Gemini 2.5 Flash: 17.1%), revealing substantial challenges that remain in city-scale embodied navigation and reasoning. 360CityArena provides a necessary and challenging testbed for photorealistic urban-district navigation and spatial reasoning.

Related papers

• UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City [63.28750191463138]
  Multimodal large language models (MLLMs) can interpret a street view, but urban agency depends on whether such local evidence remains useful after the agent starts to move.<n>We investigate how far current MLLM agents can turn local urban perception into reliable action in a complicated real-scale city.<n>We propose UrbanGround, the first sandbox to make this question testable in a physically constrained replica of Hong Kong built from territory-wide 3D geospatial data.
  arXiv  Detail & Related papers  (2026-08-27T17:59:33Z)
• SemCityLoc: Aerial 6DoF Localization Using Semantic 3D City Models [51.121529170856064]
  We propose SemCityLoc, a semantic-geometric alignment system that reframes aerial pose estimation.<n>Instead of matching sparse contours or dense texture, our method aligns semantic surfaces and monocular depth with lightweight semantic 3D building models.<n>Experiments demonstrate substantial improvements over existing map-based approaches.
  arXiv  Detail & Related papers  (2026-06-25T18:13:39Z)
• Earth Embeddings Reveal Diverse Urban Signals from Space [17.134313498337804]
  We benchmark three Earth embedding families, AlphaEarth, Prithvi, and Clay, for urban signal prediction.<n>Using a unified supervised-learning framework, we predict 14 neighborhood-level indicators spanning crime, income, health, and travel behavior.<n>Results show that Earth embeddings capture substantial urban variation, with the highest predictive skill for outcomes tied to built-environment structure.
  arXiv  Detail & Related papers  (2026-04-03T20:58:37Z)
• LightCity: An Urban Dataset for Outdoor Inverse Rendering and Reconstruction under Multi-illumination Conditions [80.70675855203154]
  Inverse rendering in urban scenes is pivotal for applications like autonomous driving and digital twins.<n>Yet, it faces significant challenges due to complex illumination conditions, including multi-illumination and indirect light and shadow effects.<n>We present LightCity, a novel high-quality synthetic urban dataset featuring diverse illumination conditions with realistic indirect light and shadow effects.
  arXiv  Detail & Related papers  (2026-02-01T09:37:00Z)
• Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery [12.88788681361607]
  Sat2RealCity is a geometry-aware and appearance-controllable framework for 3D urban generation from real-world satellite imagery.<n>We introduce the OSM-based spatial priors strategy to achieve interpretable geometric generation from spatial topology to building instances.<n>We construct an MLLM-powered semantic-guided generation pipeline, bridging semantic interpretation and geometric reconstruction.
  arXiv  Detail & Related papers  (2025-11-14T16:42:03Z)
• UrbanVerse: Scaling Urban Simulation by Watching City-Tour Videos [64.22243628420799]
  We introduce UrbanVerse, a data-driven real-to-sim system that converts crowd-sourced city-tour videos into physics-aware, interactive simulation scenes.<n>Running in IsaacSim, UrbanVerse offers 160 high-quality constructed scenes from 24 countries, along with a curated benchmark of 10 artist-designed test scenes.<n>Experiments show that UrbanVerse scenes preserve real-world semantics and layouts, achieving human-evaluated realism comparable to manually crafted scenes.
  arXiv  Detail & Related papers  (2025-10-16T17:42:34Z)
• AerialGo: Walking-through City View Generation from Aerial Perspectives [48.53976414257845]
  AerialGo is a framework that generates realistic walking-through city views from aerial images.<n>By conditioning ground-view synthesis on accessible aerial data, AerialGo bypasses the privacy risks inherent in ground-level imagery.<n>Experiments show that AerialGo significantly enhances ground-level realism and structural coherence.
  arXiv  Detail & Related papers  (2024-11-29T08:14:07Z)
• UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentation [50.52615875873055]
  UrbanBIS comprises six real urban scenes, with 2.5 billion points, covering a vast area of 10.78 square kilometers. UrbanBIS provides semantic-level annotations on a rich set of urban objects, including buildings, vehicles, vegetation, roads, and bridges. UrbanBIS is the first 3D dataset that introduces fine-grained building sub-categories.
  arXiv  Detail & Related papers  (2023-05-04T08:01:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.