Data-Driven Worker Activity Recognition and Efficiency Estimation in Manual Fruit Harvesting

• URL: http://arxiv.org/abs/2503.22809v2
• Date: Mon, 28 Apr 2025 23:11:07 GMT
• Title: Data-Driven Worker Activity Recognition and Efficiency Estimation in Manual Fruit Harvesting
• Abstract summary: Accurately identifying picking vs. non-picking activity is crucial for estimating picker efficiency.<n>In this study, a practical system was developed to calculate the efficiency of pickers in commercial strawberry harvesting.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Manual fruit harvesting is common in agriculture, but the amount of time pickers spend on non-productive activities can make it very inefficient. Accurately identifying picking vs. non-picking activity is crucial for estimating picker efficiency and optimising labour management and harvest processes. In this study, a practical system was developed to calculate the efficiency of pickers in commercial strawberry harvesting. Instrumented picking carts were developed to record the harvested fruit weight, geolocation, and cart movement in real time. These carts were deployed during the commercial strawberry harvest season in Santa Maria, CA. The collected data was then used to train a CNN-LSTM-based deep neural network to classify a picker's activity into "Pick" and "NoPick" classes. Experimental evaluations showed that the CNN-LSTM model showed promising activity recognition performance with an F1 score accuracy of over 0.97. The recognition results were then used to compute picker efficiency and the time required to fill a tray. Analysis of the season-long harvest data showed that the average picker efficiency was 75.07% with an estimation accuracy of 95.22%. Furthermore, the average tray fill time was 6.79 minutes with an estimation accuracy of 96.43%. When integrated into commercial harvesting, the proposed technology can aid growers in monitoring automated worker activity and optimising harvests to reduce non-productive time and enhance overall harvest efficiency.

Related papers

• Learning What Can Be Picked: Active Reachability Estimation for Efficient Robotic Fruit Harvesting [13.01419242528195]
  Agriculture remains a cornerstone of global health and economic sustainability, yet labor-intensive tasks such as harvesting high-value crops continue to face growing workforce shortages.<n>Our approach combines RGB-D perception with active learning to directly learn reachability as a binary decision problem.<n>Our framework achieves accurate reachability prediction with substantially fewer labeled samples, yielding approximately 6--8% higher accuracy than random sampling and enabling label-efficient adaptation to new orchard configurations.
  arXiv  Detail & Related papers  (2026-03-24T19:35:22Z)
• Efficient Data Selection at Scale via Influence Distillation [53.03573620682107]
  This paper introduces Influence Distillation, a mathematicallyjustified framework for data selection.<n>By distilling each sample's influence on a target distribution, our method assigns model-specific weights that are used to select training data.<n>Experiments show that Influence Distillation matches or outperforms state-of-the-art performance while achieving up to $3.5times$ faster selection.
  arXiv  Detail & Related papers  (2025-05-25T09:08:00Z)
• Raspberry PhenoSet: A Phenology-based Dataset for Automated Growth Detection and Yield Estimation [1.2661567777618703]
  We introduce Raspberry PhenoSet, a phenology-based dataset for detecting and segmenting raspberry fruit across seven developmental stages. This dataset contains 1,853 high-resolution images, the highest quality in the literature, captured under controlled artificial lighting in a vertical farm. We benchmarked several state-of-the-art deep learning models, including YOLOv8, YOLOv10, RT-DETR, and Mask R-CNN, to provide a comprehensive evaluation of their performance on the dataset.
  arXiv  Detail & Related papers  (2024-11-01T18:34:26Z)
• Strawberry detection and counting based on YOLOv7 pruning and information based tracking algorithm [2.8246025005347875]
  This study proposed an optimal pruning of detection heads of the deep learning model (YOLOv7 and its variants) that could achieve fast and precise strawberry flower, immature fruit, and mature fruit detection. The proposed pruning of detection heads across YOLOv7 variants, notably Pruning-YOLOv7-tiny with detection head 3 and Pruning-YOLOv7-tiny with heads 2 and 3 achieved the best inference speed (163.9 frames per second) and detection accuracy (89.1%)
  arXiv  Detail & Related papers  (2024-07-17T14:41:57Z)
• Incremental Self-training for Semi-supervised Learning [56.57057576885672]
  IST is simple yet effective and fits existing self-training-based semi-supervised learning methods. We verify the proposed IST on five datasets and two types of backbone, effectively improving the recognition accuracy and learning speed.
  arXiv  Detail & Related papers  (2024-04-14T05:02:00Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• Fruit Picker Activity Recognition with Wearable Sensors and Machine Learning [1.9036571490366496]
  We present a novel application of detecting fruit picker activities based on time series data generated from wearable sensors. For farmers and managers, the knowledge of when a picker bag is emptied is important for managing harvesting bins more effectively. We propose a means to detect these bag-emptying events using human activity recognition with wearable sensors and machine learning methods.
  arXiv  Detail & Related papers  (2023-04-20T03:38:08Z)
• ASPEST: Bridging the Gap Between Active Learning and Selective Prediction [56.001808843574395]
  Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. Active learning aims to lower the overall labeling effort, and hence human dependence, by querying the most informative examples. In this work, we introduce a new learning paradigm, active selective prediction, which aims to query more informative samples from the shifted target domain.
  arXiv  Detail & Related papers  (2023-04-07T23:51:07Z)
• Autonomous Apple Fruitlet Sizing and Growth Rate Tracking using Computer Vision [6.303112417588331]
  We present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets across multiple days. We demonstrate that our system is able to predict abscise rates within 3.5% of the current method with a 6 times improvement in speed.
  arXiv  Detail & Related papers  (2022-12-03T01:59:46Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Deep Learning approach for Classifying Trusses and Runners of Strawberries [1.6799377888527687]
  This paper proposes the use of Deep Learning for the classification of trusses and runners of strawberry plants. The proposed approach is based on the use of noises (i.e. Gaussian, Speckle, Poisson and Salt-and-Pepper) to artificially augment the dataset. The results are evaluated using mean average of precision, recall and F1 score.
  arXiv  Detail & Related papers  (2022-07-06T14:48:35Z)
• Compactness Score: A Fast Filter Method for Unsupervised Feature Selection [66.84571085643928]
  We propose a fast unsupervised feature selection method, named as, Compactness Score (CSUFS) to select desired features. Our proposed algorithm seems to be more accurate and efficient compared with existing algorithms.
  arXiv  Detail & Related papers  (2022-01-31T13:01:37Z)
• Learning from Data to Optimize Control in Precision Farming [77.34726150561087]
  Special issue presents the latest development in statistical inference, machine learning and optimum control for precision farming. Satellite positioning and navigation followed by Internet-of-Things generate vast information that can be used to optimize farming processes in real-time.
  arXiv  Detail & Related papers  (2020-07-07T12:44:17Z)
• Finding Berries: Segmentation and Counting of Cranberries using Point Supervision and Shape Priors [3.6704226968275258]
  We present a deep learning method for simultaneous segmentation and counting of cranberries to aid in yield estimation and sun exposure predictions. The approach, named Triple-S Network, incorporates a three-part loss with shape priors to promote better fitting to objects of known shape typical in agricultural scenes. Our results improve overall segmentation performance by more than 6.74% and counting results by 22.91% when compared to state-of-the-art.
  arXiv  Detail & Related papers  (2020-04-18T01:08:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.