Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit

• URL: http://arxiv.org/abs/2608.01753v1
• Date: Mon, 03 Aug 2026 06:21:05 GMT
• Title: Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit
• Abstract summary: This study introduced a scalable framework for estimating residential blight using open-source large vision-language models on multiple views.<n>We compared professional human annotations of these features across several models, including an ensemble stacking approach based on XGBoost and a weighted scoring system.<n>Results showed that (i) multiple street views can contribute to the improvement of accuracy, (ii) large vision-language models have different strengths of inference, (iii) the ensemble learner outperforms individual base models, enhancing robustness across all residential conditions and blight assessment.
• Score: 0.5747738795689892
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Addressing urban blight has seen increased focus in the past 15 years. Assessing urban blight is essential for guiding urban planning, targeting rehabilitation, and safeguarding public health, yet traditional residential blight surveys are difficult to maintain at scale due to the labor-intensive cost and long-term cycle. This study introduced a scalable framework for estimating residential blight using open-source large vision-language models on multiple views. Structured prompts guided models to evaluate housing attributes, including roof integrity, wall damage, and broken or boarded openings, producing both binary assessments and probabilistic estimates of disrepair. To evaluate the performance of these visual assessments, we compared professional human annotations of these features across several models, including an ensemble stacking approach based on XGBoost and a weighted scoring system. Results showed that (i) multiple street views can contribute to the improvement of accuracy, (ii) large vision-language models have different strengths of inference, (iii) the ensemble learner outperforms individual base models, enhancing robustness across all residential conditions and blight assessment. The practical application of the method allows low-cost tracking and management of housing stock conditions, providing a regularly updatable complement to traditional blight surveys.

Related papers

• Housing Potential Common Data Model and City Digital Twin [0.0]
  This research introduces the Housing Potential Common Data Model (HPCDM) to overcome existing data silos.<n>The report details the evaluation of the model along with the creation of a City Digital Twin for housing and a pilot dashboard application to demonstrate a practical implementation.
  arXiv  Detail & Related papers  (2026-05-07T00:27:47Z)
• How Well Do Vision--Language Models Understand Cities? A Comparative Study on Spatial Reasoning from Street-View Images [3.836101499114879]
  Urban scenes require fine-grained spatial reasoning about objects, layouts, and depth cues.<n>Current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban domain remains underexplored.<n>This study introduces urban spatial reasoning as a new challenge for VLMs and demonstrates synthetic dataset construction as a practical path for adapting general-purpose models to specialized domains.
  arXiv  Detail & Related papers  (2025-08-29T12:21:57Z)
• From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models [18.69630838520861]
  Urban and transportation research has long sought to uncover statistically meaningful relationships between key variables and societal outcomes such as road safety.<n>We propose a Multimodal Large Language Model (MLLM)-based approach for interpretable hypothesis inference.
  arXiv  Detail & Related papers  (2025-06-02T20:40:56Z)
• REOBench: Benchmarking Robustness of Earth Observation Foundation Models [48.24281482353377]
  REOBench is the first comprehensive benchmark for evaluating the robustness of Earth observation foundation models.<n>We conduct a systematic evaluation of a broad range of models trained using masked image modeling, contrastive learning, and vision-language pre-training paradigms.<n>Results reveal that existing Earth observation foundation models experience significant performance degradation when exposed to input corruptions.
  arXiv  Detail & Related papers  (2025-05-22T15:34:50Z)
• VHELM: A Holistic Evaluation of Vision Language Models [75.88987277686914]
  We present the Holistic Evaluation of Vision Language Models (VHELM) VHELM aggregates various datasets to cover one or more of the 9 aspects: visual perception, knowledge, reasoning, bias, fairness, multilinguality, robustness, toxicity, and safety. Our framework is designed to be lightweight and automatic so that evaluation runs are cheap and fast.
  arXiv  Detail & Related papers  (2024-10-09T17:46:34Z)
• VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models [57.43276586087863]
  Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs. Existing benchmarks are often limited in scope, focusing mainly on object hallucinations. We introduce a multi-dimensional benchmark covering objects, attributes, and relations, with challenging images selected based on associative biases.
  arXiv  Detail & Related papers  (2024-04-22T04:49:22Z)
• ELEV-VISION-SAM: Integrated Vision Language and Foundation Model for Automated Estimation of Building Lowest Floor Elevation [1.2070884166650049]
  This study integrates the Segment Anything model, a segmentation foundation model, with vision language models to conduct text-prompt image segmentation on street view images for LFE estimation. Our proposed method significantly enhances the availability of LFE estimation to almost all properties in which the front door is visible in the street view image.
  arXiv  Detail & Related papers  (2024-04-19T03:16:08Z)
• Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models [73.40350756742231]
  Visually-conditioned language models (VLMs) have seen growing adoption in applications such as visual dialogue, scene understanding, and robotic task planning. Despite the volume of new releases, key design decisions around image preprocessing, architecture, and optimization are under-explored.
  arXiv  Detail & Related papers  (2024-02-12T18:21:14Z)
• Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models [55.919653720979824]
  This paper focuses on the concept of weak-to-strong generalization, which involves using a weaker model to supervise a stronger one. We introduce a novel and adaptively adjustable loss function for weak-to-strong supervision. Our approach not only exceeds the performance benchmarks set by strong-to-strong generalization but also surpasses the outcomes of fine-tuning strong models with whole datasets.
  arXiv  Detail & Related papers  (2024-02-06T06:30:34Z)
• Visual Perception of Building and Household Vulnerability from Streets [0.294944680995069]
  In developing countries, building codes often are outdated or not enforced. A large portion of the housing stock is substandard and vulnerable to natural hazards and climate related events. We propose an evaluation framework that is cost-efficient for first capture and future updates.
  arXiv  Detail & Related papers  (2022-05-28T15:35:47Z)
• Predicting Livelihood Indicators from Community-Generated Street-Level Imagery [70.5081240396352]
  We propose an inexpensive, scalable, and interpretable approach to predict key livelihood indicators from public crowd-sourced street-level imagery. By comparing our results against ground data collected in nationally-representative household surveys, we demonstrate the performance of our approach in accurately predicting indicators of poverty, population, and health.
  arXiv  Detail & Related papers  (2020-06-15T18:12:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.