Analyzing Poverty through Intra-Annual Time-Series: A Wavelet Transform Approach

• URL: http://arxiv.org/abs/2411.02855v1
• Date: Tue, 05 Nov 2024 06:59:05 GMT
• Title: Analyzing Poverty through Intra-Annual Time-Series: A Wavelet Transform Approach
• Authors: Mohammad Kakooei, Klaudia Solska, Adel Daoud,
• Abstract summary: Using Landsat imagery and nighttime light data, we evaluate EO-ML methods that use intra-annual EO data. Our results indicate that integrating specific NDVI-derived features with multi-spectral data provides valuable insights for poverty analysis.
• Score: 2.3213238782019316
• License:
• Abstract: Reducing global poverty is a key objective of the Sustainable Development Goals (SDGs). Achieving this requires high-frequency, granular data to capture neighborhood-level changes, particularly in data scarce regions such as low- and middle-income countries. To fill in the data gaps, recent computer vision methods combining machine learning (ML) with earth observation (EO) data to improve poverty estimation. However, while much progress have been made, they often omit intra-annual variations, which are crucial for estimating poverty in agriculturally dependent countries. We explored the impact of integrating intra-annual NDVI information with annual multi-spectral data on model accuracy. To evaluate our method, we created a simulated dataset using Landsat imagery and nighttime light data to evaluate EO-ML methods that use intra-annual EO data. Additionally, we evaluated our method against the Demographic and Health Survey (DHS) dataset across Africa. Our results indicate that integrating specific NDVI-derived features with multi-spectral data provides valuable insights for poverty analysis, emphasizing the importance of retaining intra-annual information.

Related papers

• Detecting Training Data of Large Language Models via Expectation Maximization [62.28028046993391]
  Membership inference attacks (MIAs) aim to determine whether a specific instance was part of a target model's training data. Applying MIAs to large language models (LLMs) presents unique challenges due to the massive scale of pre-training data and the ambiguous nature of membership. We introduce EM-MIA, a novel MIA method for LLMs that iteratively refines membership scores and prefix scores via an expectation-maximization algorithm.
  arXiv  Detail & Related papers  (2024-10-10T03:31:16Z)
• Data-Centric AI in the Age of Large Language Models [51.20451986068925]
  This position paper proposes a data-centric viewpoint of AI research, focusing on large language models (LLMs) We make the key observation that data is instrumental in the developmental (e.g., pretraining and fine-tuning) and inferential stages (e.g., in-context learning) of LLMs. We identify four specific scenarios centered around data, covering data-centric benchmarks and data curation, data attribution, knowledge transfer, and inference contextualization.
  arXiv  Detail & Related papers  (2024-06-20T16:34:07Z)
• A Scoping Review of Earth Observation and Machine Learning for Causal Inference: Implications for the Geography of Poverty [3.4137115855910762]
  Early research in computer vision used predictive models to estimate living conditions. Recent work has progressed beyond using EO data to predict such outcomes -- now also using it to conduct causal inference.
  arXiv  Detail & Related papers  (2024-05-30T20:48:10Z)
• Data Valuation by Leveraging Global and Local Statistical Information [25.911043100052588]
  We show that both global and local value distributions hold significant potential for data valuation within the context of machine learning. We propose a new data valuation method that estimates Shapley values by incorporating the explored distribution characteristics into an existing method, AME. We also present a new path to address the dynamic data valuation problem by formulating an optimization problem that integrates information of both global and local value distributions.
  arXiv  Detail & Related papers  (2024-05-23T08:58:08Z)
• Using a Local Surrogate Model to Interpret Temporal Shifts in Global Annual Data [5.669106489320257]
  This paper focuses on explaining changes over time in globally-sourced, annual temporal data. We employ Local Interpretable Model-agnostic Explanations (LIME) to shed light on national happiness indices, economic freedom, and population metrics.
  arXiv  Detail & Related papers  (2024-04-18T03:17:45Z)
• Data Acquisition: A New Frontier in Data-centric AI [65.90972015426274]
  We first present an investigation of current data marketplaces, revealing lack of platforms offering detailed information about datasets. We then introduce the DAM challenge, a benchmark to model the interaction between the data providers and acquirers. Our evaluation of the submitted strategies underlines the need for effective data acquisition strategies in Machine Learning.
  arXiv  Detail & Related papers  (2023-11-22T22:15:17Z)
• Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices [72.61177465035031]
  We propose a generative AI-empowered federated learning to address these challenges by leveraging the idea of FIlling the MIssing (FIMI) portion of local data. Experiment results demonstrate that FIMI can save up to 50% of the device-side energy to achieve the target global test accuracy.
  arXiv  Detail & Related papers  (2023-10-21T12:07:04Z)
• Harnessing Administrative Data Inventories to Create a Reliable Transnational Reference Database for Crop Type Monitoring [0.0]
  We showcase E URO C ROPS, a reference dataset for crop type classification that aggregates and harmonizes administrative data surveyed in different countries with the goal of transnational interoperability.
  arXiv  Detail & Related papers  (2023-10-10T07:57:00Z)
• Seeing poverty from space, how much can it be tuned? [0.0]
  We demonstrate that individuals with no organizational affiliation can participate in the improvement of predicting local poverty levels in a given agro-ecological environment. The approach builds upon several pioneering efforts related to mapping poverty by deep learning to process satellite imagery and "ground-truth" data from the field. A key goal of the project was to intentionally keep costs as low as possible - by using freely available resources - so that citizen scientists, students and organizations could replicate the method in other areas of interest.
  arXiv  Detail & Related papers  (2021-07-30T15:23:54Z)
• OR-Net: Pointwise Relational Inference for Data Completion under Partial Observation [51.083573770706636]
  This work uses relational inference to fill in the incomplete data. We propose Omni-Relational Network (OR-Net) to model the pointwise relativity in two aspects.
  arXiv  Detail & Related papers  (2021-05-02T06:05:54Z)
• Provably Efficient Causal Reinforcement Learning with Confounded Observational Data [135.64775986546505]
  We study how to incorporate the dataset (observational data) collected offline, which is often abundantly available in practice, to improve the sample efficiency in the online setting. We propose the deconfounded optimistic value iteration (DOVI) algorithm, which incorporates the confounded observational data in a provably efficient manner.
  arXiv  Detail & Related papers  (2020-06-22T14:49:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.