Improve State-Level Wheat Yield Forecasts in Kazakhstan on GEOGLAM's EO
Data by Leveraging A Simple Spatial-Aware Technique
- URL: http://arxiv.org/abs/2306.04646v1
- Date: Thu, 1 Jun 2023 19:35:13 GMT
- Title: Improve State-Level Wheat Yield Forecasts in Kazakhstan on GEOGLAM's EO
Data by Leveraging A Simple Spatial-Aware Technique
- Authors: Anh Nhat Nhu, Ritvik Sahajpal, Christina Justice, Inbal Becker-Reshef
- Abstract summary: We propose and investigate a technique called state-wise additive bias to explicitly address the cross-region yield heterogeneity in Kazakhstan.
Our method reduces the overall RMSE by 8.9% and the highest state-wise RMSE by 28.37%.
The effectiveness of state-wise additive bias indicates machine learning's performance can be significantly improved.
- Score: 1.433758865948252
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurate yield forecasting is essential for making informed policies and
long-term decisions for food security. Earth Observation (EO) data and machine
learning algorithms play a key role in providing a comprehensive and timely
view of crop conditions from field to national scales. However, machine
learning algorithms' prediction accuracy is often harmed by spatial
heterogeneity caused by exogenous factors not reflected in remote sensing data,
such as differences in crop management strategies. In this paper, we propose
and investigate a simple technique called state-wise additive bias to
explicitly address the cross-region yield heterogeneity in Kazakhstan. Compared
to baseline machine learning models (Random Forest, CatBoost, XGBoost), our
method reduces the overall RMSE by 8.9\% and the highest state-wise RMSE by
28.37\%. The effectiveness of state-wise additive bias indicates machine
learning's performance can be significantly improved by explicitly addressing
the spatial heterogeneity, motivating future work on spatial-aware machine
learning algorithms for yield forecasts as well as for general geospatial
forecasting problems.
Related papers
- Quanv4EO: Empowering Earth Observation by means of Quanvolutional Neural Networks [62.12107686529827]
This article highlights a significant shift towards leveraging quantum computing techniques in processing large volumes of remote sensing data.
The proposed Quanv4EO model introduces a quanvolution method for preprocessing multi-dimensional EO data.
Key findings suggest that the proposed model not only maintains high precision in image classification but also shows improvements of around 5% in EO use cases.
arXiv Detail & Related papers (2024-07-24T09:11:34Z) - Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning [50.84938730450622]
We propose a trajectory-based method TV score, which uses trajectory volatility for OOD detection in mathematical reasoning.
Our method outperforms all traditional algorithms on GLMs under mathematical reasoning scenarios.
Our method can be extended to more applications with high-density features in output spaces, such as multiple-choice questions.
arXiv Detail & Related papers (2024-05-22T22:22:25Z) - An Ensemble Framework for Explainable Geospatial Machine Learning Models [16.010404125829876]
We introduce an integrated framework that merges local spatial weighting scheme, Explainable Artificial Intelligence (XAI) and cutting-edge machine learning technologies.
This framework is verified to enhance the interpretability and accuracy of predictions in both geographic regression and classification.
It significantly boosts prediction precision, offering a novel approach to understanding spatial phenomena.
arXiv Detail & Related papers (2024-03-05T21:12:10Z) - Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning [0.5999777817331317]
Data assimilation plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles.
Recent advancements have seen the emergence of deep learning approaches in this domain, primarily within a supervised learning framework.
In this study, we introduce a novel DA strategy that utilizes reinforcement learning (RL) to apply state corrections using full or partial observations of the state variables.
arXiv Detail & Related papers (2024-01-01T06:53:36Z) - Filling the Missing: Exploring Generative AI for Enhanced Federated
Learning over Heterogeneous Mobile Edge Devices [72.61177465035031]
We propose a generative AI-empowered federated learning to address these challenges by leveraging the idea of FIlling the MIssing (FIMI) portion of local data.
Experiment results demonstrate that FIMI can save up to 50% of the device-side energy to achieve the target global test accuracy.
arXiv Detail & Related papers (2023-10-21T12:07:04Z) - Evaluation Challenges for Geospatial ML [5.576083740549639]
Geospatial machine learning models and maps are increasingly used for downstream analyses in science and policy.
The correct way to measure performance of spatial machine learning outputs has been a topic of debate.
This paper delineates unique challenges of model evaluation for geospatial machine learning with global or remotely sensed datasets.
arXiv Detail & Related papers (2023-03-31T14:24:06Z) - Reservoir Prediction by Machine Learning Methods on The Well Data and
Seismic Attributes for Complex Coastal Conditions [0.0]
This research develops the direction of machine learning where training is conducted on well data and spatial attributes.
Considering the difficulties for seismic data interpretation in coastal area conditions, the proposed approach is a tool which is able to work with the whole totality of geological and geophysical data.
arXiv Detail & Related papers (2023-01-09T09:23:09Z) - Domain-Adjusted Regression or: ERM May Already Learn Features Sufficient
for Out-of-Distribution Generalization [52.7137956951533]
We argue that devising simpler methods for learning predictors on existing features is a promising direction for future research.
We introduce Domain-Adjusted Regression (DARE), a convex objective for learning a linear predictor that is provably robust under a new model of distribution shift.
Under a natural model, we prove that the DARE solution is the minimax-optimal predictor for a constrained set of test distributions.
arXiv Detail & Related papers (2022-02-14T16:42:16Z) - Leveraging Unlabeled Data to Predict Out-of-Distribution Performance [63.740181251997306]
Real-world machine learning deployments are characterized by mismatches between the source (training) and target (test) distributions.
In this work, we investigate methods for predicting the target domain accuracy using only labeled source data and unlabeled target data.
We propose Average Thresholded Confidence (ATC), a practical method that learns a threshold on the model's confidence, predicting accuracy as the fraction of unlabeled examples.
arXiv Detail & Related papers (2022-01-11T23:01:12Z) - A GNN-RNN Approach for Harnessing Geospatial and Temporal Information:
Application to Crop Yield Prediction [18.981160729510417]
We introduce a novel graph-based recurrent neural network for crop yield prediction, to incorporate both geographical and temporal knowledge.
Our method is trained, validated, and tested on over 2000 counties from 41 states in the US mainland, covering years from 1981 to 2019.
arXiv Detail & Related papers (2021-11-17T04:43:25Z) - Unsupervised Domain Adaptation for Speech Recognition via Uncertainty
Driven Self-Training [55.824641135682725]
Domain adaptation experiments using WSJ as a source domain and TED-LIUM 3 as well as SWITCHBOARD show that up to 80% of the performance of a system trained on ground-truth data can be recovered.
arXiv Detail & Related papers (2020-11-26T18:51:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.