Granularity at Scale: Estimating Neighborhood Socioeconomic Indicators from High-Resolution Orthographic Imagery and Hybrid Learning

• URL: http://arxiv.org/abs/2309.16808v3
• Date: Sun, 18 Feb 2024 22:56:37 GMT
• Title: Granularity at Scale: Estimating Neighborhood Socioeconomic Indicators from High-Resolution Orthographic Imagery and Hybrid Learning
• Authors: Ethan Brewer, Giovani Valdrighi, Parikshit Solunke, Joao Rulff, Yurii Piadyk, Zhonghui Lv, Jorge Poco, and Claudio Silva
• Abstract summary: Overhead images can help fill in the gaps where community information is sparse. Recent advancements in machine learning and computer vision have made it possible to quickly extract features from and detect patterns in image data. In this work, we explore how well two approaches, a supervised convolutional neural network and semi-supervised clustering can estimate population density, median household income, and educational attainment.
• Score: 1.8369448205408005
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Many areas of the world are without basic information on the socioeconomic well-being of the residing population due to limitations in existing data collection methods. Overhead images obtained remotely, such as from satellite or aircraft, can help serve as windows into the state of life on the ground and help "fill in the gaps" where community information is sparse, with estimates at smaller geographic scales requiring higher resolution sensors. Concurrent with improved sensor resolutions, recent advancements in machine learning and computer vision have made it possible to quickly extract features from and detect patterns in image data, in the process correlating these features with other information. In this work, we explore how well two approaches, a supervised convolutional neural network and semi-supervised clustering based on bag-of-visual-words, estimate population density, median household income, and educational attainment of individual neighborhoods from publicly available high-resolution imagery of cities throughout the United States. Results and analyses indicate that features extracted from the imagery can accurately estimate the density (R$^2$ up to 0.81) of neighborhoods, with the supervised approach able to explain about half the variation in a population's income and education. In addition to the presented approaches serving as a basis for further geographic generalization, the novel semi-supervised approach provides a foundation for future work seeking to estimate fine-scale information from aerial imagery without the need for label data.

Related papers

• Deep Learning for Slum Mapping in Remote Sensing Images: A Meta-analysis and Review [2.1383489372142503]
  Millions of people live in slums or informal settlements with poor living conditions in many major cities around the world. Remote sensing based mapping of slums has emerged as a prominent research area. Deep Learning has added a new dimension to this field as it allows automated analysis of satellite imagery to identify complex spatial patterns associated with slums.
  arXiv  Detail & Related papers  (2024-06-12T09:31:52Z)
• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• UB-FineNet: Urban Building Fine-grained Classification Network for Open-access Satellite Images [7.435848987082052]
  We propose a deep network approach to fine-grained classification of urban buildings using open-access satellite images. A new fine-grained classification network with Category Information Balancing Module (CIBM) and Contrastive Supervision (CS) technique is proposed to mitigate the problem of class imbalance. Experiments on Hong Kong data set with 11 fine building types revealed promising classification results with a mean Top-1 accuracy of 60.45%.
  arXiv  Detail & Related papers  (2024-03-04T15:40:31Z)
• Building Coverage Estimation with Low-resolution Remote Sensing Imagery [65.95520230761544]
  We propose a method for estimating building coverage using only publicly available low-resolution satellite imagery. Our model achieves a coefficient of determination as high as 0.968 on predicting building coverage in regions of different levels of development around the world.
  arXiv  Detail & Related papers  (2023-01-04T05:19:33Z)
• Semantic Segmentation of Vegetation in Remote Sensing Imagery Using Deep Learning [77.34726150561087]
  We propose an approach for creating a multi-modal and large-temporal dataset comprised of publicly available Remote Sensing data. We use Convolutional Neural Networks (CNN) models that are capable of separating different classes of vegetation.
  arXiv  Detail & Related papers  (2022-09-28T18:51:59Z)
• IS-COUNT: Large-scale Object Counting from Satellite Images with Covariate-based Importance Sampling [90.97859312029615]
  We propose an approach to estimate object count statistics over large geographies through sampling. We show empirically that the proposed framework achieves strong performance on estimating the number of buildings in the United States and Africa, cars in Kenya, brick kilns in Bangladesh, and swimming pools in the U.S.
  arXiv  Detail & Related papers  (2021-12-16T18:59:29Z)
• Sensing population distribution from satellite imagery via deep learning: model selection, neighboring effect, and systematic biases [16.82118960055405]
  This study marks the first attempt to cross-compare performances of popular state-of-the-art deep learning models in estimating population distribution from remote sensing images. DenseNet outperforms the other three models, while VGG has the worst performances in all evaluating metrics under all selected neighboring scenarios. There exists a notable, universal bias that all selected deep learning models tend to overestimate sparsely populated image patches and underestimate densely populated image patches, regardless of neighboring sizes.
  arXiv  Detail & Related papers  (2021-03-03T03:40:24Z)
• Urban land-use analysis using proximate sensing imagery: a survey [3.79474411753363]
  Studies leveraging proximate sensing imagery have demonstrated great potential to address the need for local data in urban land-use analysis. This paper reviews and summarizes the state-of-the-art methods and publicly available datasets from proximate sensing to support land-use analysis.
  arXiv  Detail & Related papers  (2021-01-13T01:30:21Z)
• Predicting Livelihood Indicators from Community-Generated Street-Level Imagery [70.5081240396352]
  We propose an inexpensive, scalable, and interpretable approach to predict key livelihood indicators from public crowd-sourced street-level imagery. By comparing our results against ground data collected in nationally-representative household surveys, we demonstrate the performance of our approach in accurately predicting indicators of poverty, population, and health.
  arXiv  Detail & Related papers  (2020-06-15T18:12:12Z)
• Graph Representation Learning via Graphical Mutual Information Maximization [86.32278001019854]
  We propose a novel concept, Graphical Mutual Information (GMI), to measure the correlation between input graphs and high-level hidden representations. We develop an unsupervised learning model trained by maximizing GMI between the input and output of a graph neural encoder.
  arXiv  Detail & Related papers  (2020-02-04T08:33:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.