Leveraging ChatGPT's Multimodal Vision Capabilities to Rank Satellite Images by Poverty Level: Advancing Tools for Social Science Research

• URL: http://arxiv.org/abs/2501.14546v1
• Date: Fri, 24 Jan 2025 14:49:00 GMT
• Title: Leveraging ChatGPT's Multimodal Vision Capabilities to Rank Satellite Images by Poverty Level: Advancing Tools for Social Science Research
• Authors: Hamid Sarmadi, Ola Hall, Thorsteinn Rögnvaldsson, Mattias Ohlsson,
• Abstract summary: Large Language Models (LLMs) with vision capabilities analyze satellite imagery for village-level poverty prediction. ChatGPT can rank satellite images based on poverty levels with accuracy comparable to domain experts.
• Score: 0.0
• License:
• Abstract: This paper investigates the novel application of Large Language Models (LLMs) with vision capabilities to analyze satellite imagery for village-level poverty prediction. Although LLMs were originally designed for natural language understanding, their adaptability to multimodal tasks, including geospatial analysis, has opened new frontiers in data-driven research. By leveraging advancements in vision-enabled LLMs, we assess their ability to provide interpretable, scalable, and reliable insights into human poverty from satellite images. Using a pairwise comparison approach, we demonstrate that ChatGPT can rank satellite images based on poverty levels with accuracy comparable to domain experts. These findings highlight both the promise and the limitations of LLMs in socioeconomic research, providing a foundation for their integration into poverty assessment workflows. This study contributes to the ongoing exploration of unconventional data sources for welfare analysis and opens pathways for cost-effective, large-scale poverty monitoring.

Related papers

• EVOLvE: Evaluating and Optimizing LLMs For Exploration [76.66831821738927]
  Large language models (LLMs) remain under-studied in scenarios requiring optimal decision-making under uncertainty. We measure LLMs' (in)ability to make optimal decisions in bandits, a state-less reinforcement learning setting relevant to many applications. Motivated by the existence of optimal exploration algorithms, we propose efficient ways to integrate this algorithmic knowledge into LLMs.
  arXiv  Detail & Related papers  (2024-10-08T17:54:03Z)
• Chain-of-Thought Prompting for Demographic Inference with Large Multimodal Models [58.58594658683919]
  Large multimodal models (LMMs) have shown transformative potential across various research tasks. Our findings indicate LMMs possess advantages in zero-shot learning, interpretability, and handling uncurated 'in-the-wild' inputs. We propose a Chain-of-Thought augmented prompting approach, which effectively mitigates the off-target prediction issue.
  arXiv  Detail & Related papers  (2024-05-24T16:26:56Z)
• Survey of Social Bias in Vision-Language Models [65.44579542312489]
  Survey aims to provide researchers with a high-level insight into the similarities and differences of social bias studies in pre-trained models across NLP, CV, and VL. The findings and recommendations presented here can benefit the ML community, fostering the development of fairer and non-biased AI models.
  arXiv  Detail & Related papers  (2023-09-24T15:34:56Z)
• Aligning Large Language Models with Human: A Survey [53.6014921995006]
  Large Language Models (LLMs) trained on extensive textual corpora have emerged as leading solutions for a broad array of Natural Language Processing (NLP) tasks. Despite their notable performance, these models are prone to certain limitations such as misunderstanding human instructions, generating potentially biased content, or factually incorrect information. This survey presents a comprehensive overview of these alignment technologies, including the following aspects.
  arXiv  Detail & Related papers  (2023-07-24T17:44:58Z)
• Learning and Reasoning Multifaceted and Longitudinal Data for Poverty Estimates and Livelihood Capabilities of Lagged Regions in Rural India [22.98110639419913]
  The project aims to examine the poverty situation of rural India for the period of 1990-2022 based on the quality of life and livelihood indicators. The project also intends to examine causation and longitudinal analysis to examine the reasons for poverty.
  arXiv  Detail & Related papers  (2023-04-27T05:33:08Z)
• Predicting Poverty Level from Satellite Imagery using Deep Neural Networks [0.0]
  I develop deep learning computer vision methods that can predict a region's poverty level from an overhead satellite image. I explore the impact that data quantity and data augmentation have on the representational power and overall accuracy of the networks.
  arXiv  Detail & Related papers  (2021-11-30T18:57:24Z)
• Seeing poverty from space, how much can it be tuned? [0.0]
  We demonstrate that individuals with no organizational affiliation can participate in the improvement of predicting local poverty levels in a given agro-ecological environment. The approach builds upon several pioneering efforts related to mapping poverty by deep learning to process satellite imagery and "ground-truth" data from the field. A key goal of the project was to intentionally keep costs as low as possible - by using freely available resources - so that citizen scientists, students and organizations could replicate the method in other areas of interest.
  arXiv  Detail & Related papers  (2021-07-30T15:23:54Z)
• Interpretable Poverty Mapping using Social Media Data, Satellite Images, and Geospatial Information [0.0]
  We present a interpretable and cost-efficient approach to poverty estimation using machine learning and readily accessible data sources. We achieve an $R2$ of 0.66 for wealth estimation in the Philippines, compared to 0.63 using satellite imagery.
  arXiv  Detail & Related papers  (2020-11-27T05:24:53Z)
• Using satellite imagery to understand and promote sustainable development [87.72561825617062]
  We synthesize the growing literature that uses satellite imagery to understand sustainable development outcomes. We quantify the paucity of ground data on key human-related outcomes and the growing abundance and resolution of satellite imagery. We review recent machine learning approaches to model-building in the context of scarce and noisy training data.
  arXiv  Detail & Related papers  (2020-09-23T05:20:00Z)
• Generating Interpretable Poverty Maps using Object Detection in Satellite Images [80.35540308137043]
  We demonstrate an interpretable computational framework to accurately predict poverty at a local level by applying object detectors to satellite images. Using the weighted counts of objects as features, we achieve 0.539 Pearson's r2 in predicting village-level poverty in Uganda, a 31% improvement over existing (and less interpretable) benchmarks.
  arXiv  Detail & Related papers  (2020-02-05T02:50:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.