How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection

• URL: http://arxiv.org/abs/2607.20263v1
• Date: Wed, 22 Jul 2026 15:18:30 GMT
• Title: How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection
• Abstract summary: This study proposes a vision-POI fusion framework that combines multi-view visual inspection with POI-derived neighborhood context.<n>The empirical dataset covers 92 old residential communities, 3,237 residential buildings, and 25,608 field-acquired inspection images in Qingdao, China.
• Score: 36.37671978079458
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Housing-level urban physical examination is essential for identifying residential building problems and supporting targeted urban renewal. Existing automated inspection studies primarily rely on individual images and rarely examine whether surrounding urban functional context can provide supplementary information for building-level assessment. This study proposes a vision-POI fusion framework that combines multi-view visual inspection with POI-derived neighborhood context for residential building health assessment. The empirical dataset covers 92 old residential communities, 3,237 residential buildings, and 25,608 field-acquired inspection images in Qingdao, China, encompassing seven categories of housing-related issues. First, multiple object detection models are evaluated to extract issue locations, categories, and confidence scores from individual images. The image-level outputs are subsequently aggregated across multiple views to construct interpretable building-level representations. Second, POI features are extracted within 500m, 1,000m, and 1,500m neighborhood buffers to characterize surrounding functional environments. Pearson and Spearman correlation analyses, combined with false discovery rate correction, are used to identify candidate contextual features. Finally, visual and POI features are integrated using a cost-sensitive Random Forest classifier under community-isolated spatial cross-validation. The results show that multi-view aggregation provides the main performance improvement, increasing the building-level Macro-F1 from 60.84% under Direct Detection to 74.95%. Incorporating POI context further increases Macro-F1 to 76.79%, although the additional gain is modest and category-dependent. POI information therefore functions as a supplementary contextual prior rather than a substitute for direct visual evidence or a causal determinant of building condition.

Related papers

• PlaceSeek: Human-Centered Geospatial Retrieval of Urban Outdoor Places via Semantic Grounding and Affective Alignment [0.6445605125467574]
  We present PlaceSeek, a human-centered outdoor place retrieval framework that maps natural-language queries to geolocated street-view imagery.<n>PlaceSeek introduces an intent-aware retrieval mechanism that decomposes user queries into functional and affective sub-intents.<n>We evaluate PlaceSeek on 31,956 street-view locations in Milan across 10 naturallanguage queries annotated by five human evaluators.
  arXiv  Detail & Related papers  (2026-08-25T06:57:29Z)
• MDWD: A Street-Level Dataset for Municipal Solid Waste Detection in Dense Urban Environments [0.23332469289621785]
  This paper introduces the Maltese Domestic Waste dataset (MDWD)<n>MDWD is a street-level benchmark comprising 3,697 high-resolution images and 11,461 manually annotated instances.<n>Results indicate MDWD supports effective training across both compact real-time detectors and transformer-based models.
  arXiv  Detail & Related papers  (2026-07-31T19:54:25Z)
• A Joint Synthetic Housing-Household Inventory [1.338174941551702]
  High-fidelity datasets that jointly capture detailed housing structures and demographic characteristics at the household level do not currently exist.<n>This paper presents a framework for constructing a joint housing-household inventory that explicitly links individuals and households to compatible housing units.<n>The resulting inventory supports a broad range of applications, including disaster resilience planning, housing and affordability analysis, energy-use assessment, and public health research.
  arXiv  Detail & Related papers  (2026-05-16T14:58:44Z)
• Panoramic Affordance Prediction [94.50813972018504]
  Affordance prediction serves as a critical bridge between perception and action in embodied AI.<n>We present the first exploration into Panoramic Affordance Prediction, utilizing 360-degree imagery.<n>We propose PAP, a training-free, coarse-to-fine pipeline inspired by the human foveal visual system.
  arXiv  Detail & Related papers  (2026-03-16T17:21:49Z)
• VisitHGNN: Heterogeneous Graph Neural Networks for Modeling Point-of-Interest Visit Patterns [3.545082819007165]
  VisitHGNN is a relation-specific graph network designed to predict probabilities of individual Points of interest (POIs)<n>VisitHGNN achieves strong predictive performance with mean KL divergence of 0.287, MAE of 0.008, Top-1 accuracy of 0.853, and R-square of 0.853.<n>Model's potential for decision support in urban planning, transportation policy, mobility system, and public health.
  arXiv  Detail & Related papers  (2025-10-03T03:42:58Z)
• Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessment [53.45813302866466]
  We present ISG, a comprehensive evaluation framework for interleaved text-and-image generation.<n>ISG evaluates responses on four levels of granularity: holistic, structural, block-level, and image-specific.<n>In conjunction with ISG, we introduce a benchmark, ISG-Bench, encompassing 1,150 samples across 8 categories and 21 subcategories.
  arXiv  Detail & Related papers  (2024-11-26T07:55:57Z)
• Coverage and Bias of Street View Imagery in Mapping the Urban Environment [0.0]
  Street View Imagery (SVI) has emerged as a valuable data form in urban studies, enabling new ways to map and sense urban environments.<n>However, fundamental concerns regarding the representativeness, quality, and reliability of SVI remain underexplored.<n>This research proposes a novel and effective method to estimate SVI's element-level coverage in the urban environment.
  arXiv  Detail & Related papers  (2024-09-22T02:58:43Z)
• Identifying every building's function in large-scale urban areas with multi-modality remote-sensing data [5.18540804614798]
  This study proposes a semi-supervised framework to identify every building's function in large-scale urban areas. optical images, building height, and nighttime-light data are collected to describe the morphological attributes of buildings. Results are evaluated by 20,000 validation points and statistical survey reports from the government.
  arXiv  Detail & Related papers  (2024-05-08T15:32:20Z)
• Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training [79.27663870280038]
  We introduce Contrastive Region Guidance (CRG), a training-free guidance method that enables open-source vision-language models to respond to visual prompts. When region annotations are provided, CRG increases absolute accuracy by up to 11.1% on ViP-Bench. We also show CRG's applicability to spatial reasoning, with 10% improvement on What'sUp.
  arXiv  Detail & Related papers  (2024-03-04T18:55:30Z)
• BEV-Net: Assessing Social Distancing Compliance by Joint People Localization and Geometric Reasoning [77.08836528980248]
  Social distancing, an essential public health measure, has gained significant attention since the outbreak of the COVID-19 pandemic. In this work, the problem of visual social distancing compliance assessment in busy public areas with wide field-of-view cameras is considered. A dataset of crowd scenes with people annotations under a bird's eye view (BEV) and ground truth for metric distances is introduced. A multi-branch network, BEV-Net, is proposed to localize individuals in world coordinates and identify high-risk regions where social distancing is violated.
  arXiv  Detail & Related papers  (2021-10-10T23:56:37Z)
• FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning [49.30194762653723]
  This work tackles the problem of locating floor-level lines in street-view images, using a supervised deep learning approach. We first compile a new dataset and develop a new data augmentation scheme to synthesize training samples. Next, we design FloorLevel-Net, a multi-task learning network that associates explicit features of building facades and implicit floor-level lines.
  arXiv  Detail & Related papers  (2021-07-06T08:17:59Z)
• Holistic Multi-View Building Analysis in the Wild with Projection Pooling [18.93067906200084]
  We address six different classification tasks related to fine-grained building attributes. Tackling such a remote building analysis problem became possible only recently due to growing large-scale datasets of urban scenes. We introduce a new benchmarking dataset, consisting of 49426 images (top-view and street-view) of 9674 buildings.
  arXiv  Detail & Related papers  (2020-08-23T13:49:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.