Forecasting the Number of Harvest-ready Fruits of Sweet Peppers Using Multimodal Time-Series Data

• URL: http://arxiv.org/abs/2607.19975v1
• Date: Wed, 22 Jul 2026 09:58:03 GMT
• Title: Forecasting the Number of Harvest-ready Fruits of Sweet Peppers Using Multimodal Time-Series Data
• Abstract summary: We introduce a novel, annotated image time-series dataset of 691 sweet pepper plants monitored over two growing seasons.<n>We propose a multimodal deep learning framework that fuses high-dimensional image features, extracted using the DinoV3 encoder, with numerical count measurements.
• Score: 22.381746023690173
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate yield forecasting at the individual-plant level is critical for precision agriculture and supply-chain planning, yet public datasets capturing both visual growth dynamics and per-plant measurement labels are scarce. In this paper, we introduce a novel, annotated image time-series dataset of 691 sweet pepper plants monitored over two growing seasons, comprising 4837 images with per-plant fruit counts categorized by maturity. We propose a multimodal deep learning framework that fuses high-dimensional image features, extracted using the DinoV3 encoder, with numerical count measurements. Our architecture utilizes a Long Short-Term Memory (LSTM) network to model temporal dependencies and handles irregular sampling intervals common in greenhouse monitoring. Through quantitative experiments, we demonstrate that this multimodal approach reduces RMSE over a persistence baseline by 33% and 38% in the 2022 and 2023 seasons, respectively, with a further 1.2% average gain over a measurement-only model. Furthermore, we employ Deep Ensembles and Gaussian Negative Log-Likelihood (NLL) to provide calibrated uncertainty estimates, with an Uncertainty Calibration Error (UCE) ranging from 0.39 to 0.89 depending on the cross-season evaluation direction, offering a principled confidence signal for real-world agricultural decision-making. We release the dataset and code to support reproducible research and to accelerate development of data-driven yield forecasting methods for horticultural crops.

Related papers

• Forecasting the Maintained Score from the OpenSSF Scorecard for GitHub Repositories linked to PyPI libraries [78.48200143057376]
  We study to what extent future maintenance activity, as captured by the OpenSSF maintained score, can be forecasted.<n>We analyze 3,220 GitHub repositories associated with the top 1% most central PyPI libraries by PageRank.<n>Our results show that future maintenance activity can be predicted with meaningful accuracy.
  arXiv  Detail & Related papers  (2026-01-26T10:32:54Z)
• Maize Seedling Detection Dataset (MSDD): A Curated High-Resolution RGB Dataset for Seedling Maize Detection and Benchmarking with YOLOv9, YOLO11, YOLOv12 and Faster-RCNN [0.28647133890966986]
  Stand counting determines how many plants germinated, guiding timely decisions such as replanting or adjusting inputs.<n>We introduce MSDD, a high-quality aerial image dataset for maize seedling stand counting, with applications in early-season crop monitoring, yield prediction, and in-field management.<n> MSDD contains three classes-single, double, and triple plants-capturing diverse growth stages, planting setups, soil types, lighting conditions, camera angles, and densities, ensuring robustness for real-world use.
  arXiv  Detail & Related papers  (2025-09-18T17:41:59Z)
• Soybean Maturity Prediction using 2D Contour Plots from Drone based Time Series Imagery [5.604868960444558]
  Plant breeding programs require assessments of days to maturity for accurate selection and placement of entries in appropriate tests.<n>Traditionally, the estimation of maturity value for breeding varieties has involved breeders manually inspecting fields and assessing maturity value visually.<n>This study developed a machine-learning model for evaluating soybean maturity using UAV-based time-series imagery.
  arXiv  Detail & Related papers  (2024-12-12T19:23:50Z)
• CMAViT: Integrating Climate, Managment, and Remote Sensing Data for Crop Yield Estimation with Multimodel Vision Transformers [0.0]
  We introduce a deep learning-based multi-model called Climate-Management Aware Vision Transformer (CMAViT) CMAViT integrates both spatial and temporal data by leveraging remote sensing imagery and short-term meteorological data. It outperforms traditional models like UNet-ConvLSTM, excelling in spatial variability capture and yield prediction.
  arXiv  Detail & Related papers  (2024-11-25T23:34:53Z)
• An Open and Large-Scale Dataset for Multi-Modal Climate Change-aware Crop Yield Predictions [20.44172558372343]
  CropNet dataset is the first terabyte-sized, publicly available, and multi-modal dataset specifically targeting climate change-aware crop yield predictions. CropNet dataset is composed of three modalities of data, i.e., Sentinel-2 Imagery, WRF-HRRR, and USDA Cropd dataset, for over 2200 U.S. counties spanning 6 years.
  arXiv  Detail & Related papers  (2024-06-10T07:54:56Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement [51.55157852647306]
  Time series forecasting has been a widely explored task of great importance in many applications. It is common that real-world time series data are recorded in a short time period, which results in a big gap between the deep model and the limited and noisy time series. We propose to address the time series forecasting problem with generative modeling and propose a bidirectional variational auto-encoder equipped with diffusion, denoise, and disentanglement.
  arXiv  Detail & Related papers  (2023-01-08T12:20:46Z)
• High-Resolution Satellite Imagery for Modeling the Impact of Aridification on Crop Production [2.5402662954395097]
  We introduce a first-of-its-kind dataset, SICKLE, having time-series images at different spatial resolutions from 3 different satellites. The dataset comprises of 2,398 season-wise samples from 388 unique plots distributed across 4 districts of the Delta. We benchmark the dataset on 3 separate tasks, namely crop type, phenology date (sowing, transplanting, harvesting) and yield prediction, and develop an end-to-end framework for predicting key crop parameters in a real-world setting.
  arXiv  Detail & Related papers  (2022-09-25T14:54:50Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Mitigating Data Redundancy to Revitalize Transformer-based Long-Term Time Series Forecasting System [46.39662315849883]
  We introduce CLMFormer, a novel framework that mitigates redundancy through curriculum learning and a memory-driven decoder.<n>CLMFormer consistently improves Transformer-based models by up to 30%, demonstrating its effectiveness in long-horizon forecasting.
  arXiv  Detail & Related papers  (2022-07-16T04:05:15Z)
• TACTiS: Transformer-Attentional Copulas for Time Series [76.71406465526454]
  estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. We propose a versatile method that estimates joint distributions using an attention-based decoder. We show that our model produces state-of-the-art predictions on several real-world datasets.
  arXiv  Detail & Related papers  (2022-02-07T21:37:29Z)
• A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagery [56.10033255997329]
  We propose a novel deep learning method based on a Convolutional Neural Network (CNN) It simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops.
  arXiv  Detail & Related papers  (2020-12-31T18:51:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.