Self-supervised learning unveils change in urban housing from street-level images

• URL: http://arxiv.org/abs/2309.11354v2
• Date: Thu, 21 Sep 2023 13:18:35 GMT
• Title: Self-supervised learning unveils change in urban housing from street-level images
• Authors: Steven Stalder, Michele Volpi, Nicolas B\"uttner, Stephen Law, Kenneth Harttgen, Esra Suel
• Abstract summary: Street2Vec embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions toward more liveable, equitable, and sustainable cities.
• Score: 2.0971479389679337
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Cities around the world face a critical shortage of affordable and decent housing. Despite its critical importance for policy, our ability to effectively monitor and track progress in urban housing is limited. Deep learning-based computer vision methods applied to street-level images have been successful in the measurement of socioeconomic and environmental inequalities but did not fully utilize temporal images to track urban change as time-varying labels are often unavailable. We used self-supervised methods to measure change in London using 15 million street images taken between 2008 and 2021. Our novel adaptation of Barlow Twins, Street2Vec, embeds urban structure while being invariant to seasonal and daily changes without manual annotations. It outperformed generic embeddings, successfully identified point-level change in London's housing supply from street-level images, and distinguished between major and minor change. This capability can provide timely information for urban planning and policy decisions toward more liveable, equitable, and sustainable cities.

Related papers

• A utility-based spatial analysis of residential street-level conditions; A case study of Rotterdam [1.2289361708127877]
  This paper investigates the spatial distribution of utility derived from street-level conditions in residential location choices on a city-wide scale. We find that the utility derived from street-level conditions varies significantly on a highly localised scale. Our results also reveal that the high real-estate prices in the city centre cannot be attributed to attractive street-level conditions.
  arXiv  Detail & Related papers  (2024-10-23T13:52:22Z)
• StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting [85.67616000086232]
  StreetSurfGS is first method to employ Gaussian Splatting specifically tailored for scalable urban street scene surface reconstruction. StreetSurfGS utilizes a planar-based octree representation and segmented training to reduce memory costs, accommodate unique camera characteristics, and ensure scalability. To address sparse views and multi-scale challenges, we use a dual-step matching strategy that leverages adjacent and long-term information.
  arXiv  Detail & Related papers  (2024-10-06T04:21:59Z)
• URSimulator: Human-Perception-Driven Prompt Tuning for Enhanced Virtual Urban Renewal via Diffusion Models [10.498291811234726]
  Urban Physical Disorder negatively impacts safety, well-being, and psychological state of communities. Urban Renewal is the process of revitalizing neglected and decayed areas within a city to improve the physical environment and quality of life for residents. Current research lacks simulation tools that can quantitatively assess and visualize the impacts of renewal efforts. This paper presents a novel framework using human perception feedback to simulate street environment enhancement.
  arXiv  Detail & Related papers  (2024-09-22T20:39:32Z)
• Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion [61.929653153389964]
  We present a method for generating Streetscapes-long sequences of views through an on-the-fly synthesized city-scale scene. Our method can scale to much longer-range camera trajectories, spanning several city blocks, while maintaining visual quality and consistency.
  arXiv  Detail & Related papers  (2024-07-18T17:56:30Z)
• MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility [52.0930915607703]
  Recent advances in Robotics and Embodied AI make public urban spaces no longer exclusive to humans. Micromobility enabled by AI for short-distance travel in public urban spaces plays a crucial component in the future transportation system. We present MetaUrban, a compositional simulation platform for the AI-driven urban micromobility research.
  arXiv  Detail & Related papers  (2024-07-11T17:56:49Z)
• CityPulse: Fine-Grained Assessment of Urban Change with Street View Time Series [12.621355888239359]
  Urban transformations have profound societal impact on both individuals and communities at large. We propose an end-to-end change detection model to effectively capture physical alterations in the built environment at scale. Our approach has the potential to supplement existing dataset and serve as a fine-grained and accurate assessment of urban change.
  arXiv  Detail & Related papers  (2024-01-02T08:57:09Z)
• UrbanBIS: a Large-scale Benchmark for Fine-grained Urban Building Instance Segmentation [50.52615875873055]
  UrbanBIS comprises six real urban scenes, with 2.5 billion points, covering a vast area of 10.78 square kilometers. UrbanBIS provides semantic-level annotations on a rich set of urban objects, including buildings, vehicles, vegetation, roads, and bridges. UrbanBIS is the first 3D dataset that introduces fine-grained building sub-categories.
  arXiv  Detail & Related papers  (2023-05-04T08:01:38Z)
• City-Wide Perceptions of Neighbourhood Quality using Street View Images [5.340189314359048]
  This paper describes our methodology, based in London, including collection of images and ratings, web development, model training and mapping. Perceived neighbourhood quality is a core component of urban vitality, influencing social cohesion, sense of community, safety, activity and mental health of residents.
  arXiv  Detail & Related papers  (2022-11-22T10:16:35Z)
• Urban form and COVID-19 cases and deaths in Greater London: an urban morphometric approach [63.29165619502806]
  The COVID-19 pandemic generated a considerable debate in relation to urban density. This is an old debate, originated in mid 19th century's England with the emergence of public health and urban planning disciplines. We describe urban form at individual building level and then aggregate information for official neighbourhoods.
  arXiv  Detail & Related papers  (2022-10-16T10:01:10Z)
• Modeling Fashion Influence from Photos [108.58097776743331]
  We explore fashion influence along two channels: geolocation and fashion brands. We leverage public large-scale datasets of 7.7M Instagram photos from 44 major world cities. Our results indicate the advantage of grounding visual style evolution both spatially and temporally.
  arXiv  Detail & Related papers  (2020-11-17T20:24:03Z)
• Urban Mosaic: Visual Exploration of Streetscapes Using Large-Scale Image Data [13.01318877814786]
  Urban Mosaic is a tool for exploring the urban fabric through a spatially and temporally dense data set of 7.7 million street-level images from New York City.
  arXiv  Detail & Related papers  (2020-08-31T02:23:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.