Retrieval-Augmented Multi-scale Framework for County-Level Crop Yield Prediction Across Large Regions
- URL: http://arxiv.org/abs/2603.07305v1
- Date: Sat, 07 Mar 2026 18:17:54 GMT
- Title: Retrieval-Augmented Multi-scale Framework for County-Level Crop Yield Prediction Across Large Regions
- Abstract summary: This paper proposes a new method for crop yield prediction.<n>It is essential for developing management strategies, informing insurance assessments, and ensuring long-term food security.<n>Our experiments on real-world county-level corn yield data over 630 counties in the US demonstrate that our method consistently outperforms different types of baselines.
- Score: 34.58211268275732
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper proposes a new method for crop yield prediction, which is essential for developing management strategies, informing insurance assessments, and ensuring long-term food security. Although existing data-driven approaches have shown promise in this domain, their performance often degrades when applied across large geographic regions and long time periods. This limitation arises from two key challenges: (1) difficulty in jointly capturing short-term and long-term temporal patterns, and (2) inability to effectively accommodate spatial data variability in agricultural systems. Ignoring these issues often leads to unreliable predictions for specific regions or years, which ultimately affects policy decisions and resource allocation. In this paper, we propose a new predictive framework to address these challenges. First, we introduce a new backbone model architecture that captures both short-term daily-scale crop growth dynamics and long-term dependencies across years. To further improve generalization across diverse spatial regions, we augment this model with a retrieval-based adaptation strategy. Recognizing the substantial yield variation across years, we design a novel retrieval-and-refinement pipeline that adjusts retrieved samples by removing cross-year bias not explained by input features. Our experiments on real-world county-level corn yield data over 630 counties in the US demonstrate that our method consistently outperforms different types of baselines. The results also verify the effectiveness of the retrieval-based augmentation method in improving model robustness under spatial heterogeneity.
Related papers
- Data Leakage Inflates Generalizability of Power Outage Prediction Models [0.9558392439655014]
We identify three common methodological choices in power outage prediction models that influence their ability to generalize.<n>We compare the predictive performance impacts of different methodological decisions using publicly available data for the U.S. East Coast from 2018 to 2023.<n>While random train-test splits yield strong performance, we show that these results are inflated by spatial and temporal autocorrelation.<n>These findings suggest that, given current data availability and evaluation practices, publicly trained outage prediction models offer limited and uncertain operational value.
arXiv Detail & Related papers (2026-08-25T15:05:55Z) - Think Longer to Explore Deeper: Learn to Explore In-Context via Length-Incentivized Reinforcement Learning [53.58654277639939]
In-context exploration is the intrinsic ability to generate, verify, and refine hypotheses within a single continuous context.<n>We propose Length-Incentivized Exploration, which explicitly encourages models to explore more.<n>Our method achieves an average improvement of 4.4% on in-domain tasks and a 2.7% gain on out-of-domain benchmarks.
arXiv Detail & Related papers (2026-02-12T09:24:32Z) - Variational Autoencoded Multivariate Spatial Fay-Herriot Models [2.411699454065038]
Small area estimation models are essential for estimating population characteristics in regions with limited sample sizes.<n>The spatial Fay-Herriot model is one such approach that incorporates spatial dependence to improve estimation by borrowing strength from neighboring regions.<n>This paper proposes two methods that integrate the multivariate spatial Fay-Herriot model with spatial random effects, learned through variational autoencoders.
arXiv Detail & Related papers (2025-03-18T20:19:09Z) - State-Space Modeling in Long Sequence Processing: A Survey on Recurrence in the Transformer Era [59.279784235147254]
This survey provides an in-depth summary of the latest approaches that are based on recurrent models for sequential data processing.<n>The emerging picture suggests that there is room for exploring novel routes, constituted by learning algorithms that depart from the standard Backpropagation Through Time.
arXiv Detail & Related papers (2024-06-13T12:51:22Z) - Cross Domain Early Crop Mapping using CropSTGAN [12.271756709807898]
This paper introduces the Crop Mapping Spectral-temporal Generative Adrial Neural Network (CropSTGAN)
CropSTGAN learns to transform the target domain's spectral features to those of the source domain, effectively bridging large dissimilarities.
In experiments, CropSTGAN is benchmarked against various state-of-the-art (SOTA) methods.
arXiv Detail & Related papers (2024-01-15T00:27:41Z) - Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance.
We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach.
Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
arXiv Detail & Related papers (2023-09-12T13:28:06Z) - Implicit neural representation for change detection [15.741202788959075]
Most commonly used approaches to detecting changes in point clouds are based on supervised methods.
We propose an unsupervised approach that comprises two components: Implicit Neural Representation (INR) for continuous shape reconstruction and a Gaussian Mixture Model for categorising changes.
We apply our method to a benchmark dataset comprising simulated LiDAR point clouds for urban sprawling.
arXiv Detail & Related papers (2023-07-28T09:26:00Z) - Tackling Long-Tailed Category Distribution Under Domain Shifts [50.21255304847395]
Existing approaches cannot handle the scenario where both issues exist.
We designed three novel core functional blocks including Distribution Calibrated Classification Loss, Visual-Semantic Mapping and Semantic-Similarity Guided Augmentation.
Two new datasets were proposed for this problem, named AWA2-LTS and ImageNet-LTS.
arXiv Detail & Related papers (2022-07-20T19:07:46Z) - A GNN-RNN Approach for Harnessing Geospatial and Temporal Information:
Application to Crop Yield Prediction [18.981160729510417]
We introduce a novel graph-based recurrent neural network for crop yield prediction, to incorporate both geographical and temporal knowledge.
Our method is trained, validated, and tested on over 2000 counties from 41 states in the US mainland, covering years from 1981 to 2019.
arXiv Detail & Related papers (2021-11-17T04:43:25Z) - Unsupervised Domain Adaptation in Person re-ID via k-Reciprocal
Clustering and Large-Scale Heterogeneous Environment Synthesis [76.46004354572956]
We introduce an unsupervised domain adaptation approach for person re-identification.
Experimental results show that the proposed ktCUDA and SHRED approach achieves an average improvement of +5.7 mAP in re-identification performance.
arXiv Detail & Related papers (2020-01-14T17:43:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.