AgroSense 2.0: Cross-Modal Transformer Fusion with Geospatial Raster Integration and Interpretable Multi-Task Learning for Precision Crop Recommendation

• URL: http://arxiv.org/abs/2606.21892v1
• Date: Sat, 20 Jun 2026 05:58:39 GMT
• Title: AgroSense 2.0: Cross-Modal Transformer Fusion with Geospatial Raster Integration and Interpretable Multi-Task Learning for Precision Crop Recommendation
• Abstract summary: AgroSense2.0 is a more principled, interpretable, and geospatially grounded framework for precision agriculture.<n>First, we introduce continental-scale geospatial integration via a seven-band soil spanning India.<n>Second, we replace feature concatenation with a cross-modal Transformer fusion module.<n>Third, we adopt a multi-task objective jointly optimizing soil classification and crop recommendation.
• Score: 0.5599792629509229
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Crop recommendation systems in precision agriculture have long suffered from a fundamental modality gap: visual soil characterization and chemical nutrient profiling are typically treated as independent inference problems, with fusion often reduced to late-stage feature concatenation. AgroSense~2.0 addresses this limitation through three architectural advances. First, we introduce continental-scale geospatial integration via a seven-band soil raster (\texttt{india\_soil\_7bands.tif}) spanning India, encoding Nitrogen, pH, SOC, Clay, Sand, Silt, and Bulk Density as $32\times32$ spatial patches, a modality entirely absent from prior work. Second, we replace naive feature concatenation with a cross-modal Transformer fusion module, where tabular nutrient features attend over image representations via multi-head attention, enabling richer inter-modal dependency modeling than shallow fusion. Third, we adopt a multi-task objective jointly optimizing soil classification and crop recommendation through a shared backbone, improving generalization via complementary cross-task signal. To enhance interpretability, we apply TreeSHAP to the tabular branch, revealing crop-conditioned nutrient sensitivity: humidity and rainfall emerge as the most influential features globally, while crop-specific profiles diverge meaningfully rainfall dominates rice, nitrogen and potassium dominate maize, and humidity and nitrogen dominate coffee. These explanations provide transparency into model decisions and surface both agronomically consistent patterns and dataset-specific divergences worth further study. Together, these contributions establish AgroSense~2.0 as a more principled, interpretable, and geospatially grounded framework for precision agriculture.

Related papers

• Learning to Synergize Semantic and Geometric Priors for Limited-Data Wheat Disease Segmentation [51.06355116973389]
  We propose a framework that treats wheat disease segmentation as a coupled task of disease-specific semantic perception and disease boundary localization.<n>Our core insight is that pretrained DINOv2 provides robust category-aware semantic priors to handle appearance shifts.<n>We show that SGPer consistently achieves state-of-the-art performance on wheat disease and organ segmentation benchmarks.
  arXiv  Detail & Related papers  (2026-04-07T04:19:39Z)
• Geodiffussr: Generative Terrain Texturing with Elevation Fidelity [48.82552523546255]
  We introduce Geodiffussr, a flow-matching pipeline that synthesizes text-guided texture maps.<n>The core mechanism is multi-scale content aggregation (MCA): DEM features are injected into UNet blocks at multiple resolutions to enforce global-to-local elevation consistency.<n>To train and evaluate Geodiffussr, we assemble a globally distributed, biome- and climate-stratified corpus of triplets pairing SRTM-derived DEMs with Sentinel-2 imagery and vision-grounded natural-appearance captions.
  arXiv  Detail & Related papers  (2025-11-28T09:52:44Z)
• Invariant Features for Global Crop Type Classification [5.330800669964927]
  CropGlobe is a global crop type dataset with 300,000 pixel-level samples from eight countries across five continents.<n>With broad geographic coverage, CropGlobe enables a systematic evaluation under cross-country, cross-continent, and cross-hemisphere transfer.<n>CropNet is a lightweight and robust CNN tailored for pixel-level crop classification.
  arXiv  Detail & Related papers  (2025-09-03T17:28:33Z)
• DFYP: A Dynamic Fusion Framework with Spectral Channel Attention and Adaptive Operator learning for Crop Yield Prediction [18.24061967822792]
  DFYP is a novel Dynamic Fusion framework for crop Yield Prediction.<n>It combines spectral channel attention, edge-adaptive spatial modeling and a learnable fusion mechanism.<n> DFYP consistently outperforms current state-of-the-art baselines in RMSE, MAE, and R2.
  arXiv  Detail & Related papers  (2025-07-08T10:24:04Z)
• Data Augmentation and Resolution Enhancement using GANs and Diffusion Models for Tree Segmentation [49.13393683126712]
  Urban forests play a key role in enhancing environmental quality and supporting biodiversity in cities.<n> accurately detecting trees is challenging due to complex landscapes and the variability in image resolution caused by different satellite sensors or UAV flight altitudes.<n>We propose a novel pipeline that integrates domain adaptation with GANs and Diffusion models to enhance the quality of low-resolution aerial images.
  arXiv  Detail & Related papers  (2025-05-21T03:57:10Z)
• MaizeField3D: A Curated 3D Point Cloud and Procedural Model Dataset of Field-Grown Maize from a Diversity Panel [12.89812013060155]
  We present a curated dataset of 3D point clouds of field-grown maize plants from a diverse genetic panel.<n>MaizeField3D will serve as a foundational dataset for AI-driven phenotyping, plant structural analysis, and 3D applications in agricultural research.
  arXiv  Detail & Related papers  (2025-03-10T19:53:20Z)
• It Takes Two: Accurate Gait Recognition in the Wild via Cross-granularity Alignment [72.75844404617959]
  This paper proposes a novel cross-granularity alignment gait recognition method, named XGait. To achieve this goal, the XGait first contains two branches of backbone encoders to map the silhouette sequences and the parsing sequences into two latent spaces. Comprehensive experiments on two large-scale gait datasets show XGait with the Rank-1 accuracy of 80.5% on Gait3D and 88.3% CCPG.
  arXiv  Detail & Related papers  (2024-11-16T08:54:27Z)
• Tackling fluffy clouds: robust field boundary delineation across global agricultural landscapes with Sentinel-1 and Sentinel-2 Time Series [1.0251998687197121]
  We introduce PTAViT3D, a deep learning architecture specifically designed for processing three-dimensional time series satellite imagery.<n>We also present PTAViT3D-CA, an extension to the PTAViT3D model incorporating cross-attention mechanisms to fuse S1 and S2 datasets.<n>Our results consistently demonstrate state-of-the-art performance, highlighting excellent global transferability and robustness.
  arXiv  Detail & Related papers  (2024-09-20T15:10:04Z)
• Dual Attribute-Spatial Relation Alignment for 3D Visual Grounding [59.600122444681524]
  3D visual grounding is an emerging research area dedicated to making connections between the 3D physical world and natural language. We propose DASANet, a Dual Attribute-Spatial relation alignment network. Our method achieves the highest grounding accuracy 65.1% on the Nr3D dataset, 1.3% higher than the best competitor.
  arXiv  Detail & Related papers  (2024-06-13T08:06:57Z)
• AGSPNet: A framework for parcel-scale crop fine-grained semantic change detection from UAV high-resolution imagery with agricultural geographic scene constraints [1.9151076515142376]
  This paper proposes an agricultural geographic scene and parcel-scale constrained SCD framework for crops (AGSPNet) We produce and introduce an UAV image SCD dataset (CSCD) dedicated to agricultural monitoring, encompassing multiple semantic variation types of crops in complex geographical scene. The results show that the crop SCD results of AGSPNet consistently outperform other deep learning SCD models in terms of quantity and quality.
  arXiv  Detail & Related papers  (2024-01-11T20:47:28Z)
• Agave crop segmentation and maturity classification with deep learning data-centric strategies using very high-resolution satellite imagery [101.18253437732933]
  We present an Agave tequilana Weber azul crop segmentation and maturity classification using very high resolution satellite imagery. We solve real-world deep learning problems in the very specific context of agave crop segmentation. With the resulting accurate models, agave production forecasting can be made available for large regions.
  arXiv  Detail & Related papers  (2023-03-21T03:15:29Z)
• Multi-resolution Outlier Pooling for Sorghum Classification [4.434302808728865]
  We introduce the Sorghum-100 dataset, a large dataset of RGB imagery of sorghum captured by a state-of-the-art gantry system. A new global pooling strategy called Dynamic Outlier Pooling outperforms standard global pooling strategies on this task.
  arXiv  Detail & Related papers  (2021-06-10T13:57:33Z)
• Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations [58.17039841385472]
  We take advantage of all parallel developments in mechanistic modeling and satellite data availability for advanced monitoring of crop productivity. Our model successfully estimates gross primary productivity across a variety of C3 crop types and environmental conditions even though it does not use any local information from the corresponding sites. This highlights its potential to map crop productivity from new satellite sensors at a global scale with the help of current Earth observation cloud computing platforms.
  arXiv  Detail & Related papers  (2020-12-07T16:23:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.