Fruit Picker Activity Recognition with Wearable Sensors and Machine Learning

• URL: http://arxiv.org/abs/2304.10068v1
• Date: Thu, 20 Apr 2023 03:38:08 GMT
• Title: Fruit Picker Activity Recognition with Wearable Sensors and Machine Learning
• Abstract summary: We present a novel application of detecting fruit picker activities based on time series data generated from wearable sensors. For farmers and managers, the knowledge of when a picker bag is emptied is important for managing harvesting bins more effectively. We propose a means to detect these bag-emptying events using human activity recognition with wearable sensors and machine learning methods.
• Score: 1.9036571490366496
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper we present a novel application of detecting fruit picker activities based on time series data generated from wearable sensors. During harvesting, fruit pickers pick fruit into wearable bags and empty these bags into harvesting bins located in the orchard. Once full, these bins are quickly transported to a cooled pack house to improve the shelf life of picked fruits. For farmers and managers, the knowledge of when a picker bag is emptied is important for managing harvesting bins more effectively to minimise the time the picked fruit is left out in the heat (resulting in reduced shelf life). We propose a means to detect these bag-emptying events using human activity recognition with wearable sensors and machine learning methods. We develop a semi-supervised approach to labelling the data. A feature-based machine learning ensemble model and a deep recurrent convolutional neural network are developed and tested on a real-world dataset. When compared, the neural network achieves 86% detection accuracy.

Related papers

• An analysis of sensor selection for fruit picking with suction-based grippers [2.531608511874342]
  This paper explores a multimodal sensing suite integrated into a compliant suction-based apple gripper.<n>Our approach is unique because it identifies which sensors are most informative at different phases of the pick, enabling predictive detection of failures before they occur.<n>Experiments in a real apple orchard show that Random Forest and Multilayer Perceptron classifiers detect successful picks and impending failures with over 90% accuracy.
  arXiv  Detail & Related papers  (2026-04-27T18:39:21Z)
• Data-Driven Worker Activity Recognition and Efficiency Estimation in Manual Fruit Harvesting [0.0]
  Accurately identifying picking vs. non-picking activity is crucial for estimating picker efficiency. In this study, a practical system was developed to calculate the efficiency of pickers in commercial strawberry harvesting.
  arXiv  Detail & Related papers  (2025-03-28T18:16:28Z)
• Foundation Model-Based Apple Ripeness and Size Estimation for Selective Harvesting [8.944833667187913]
  This study introduces a novel foundation model-based framework for efficient apple ripeness and size estimation.<n>We curated two public RGBD-based Fuji apple image datasets, integrating expanded annotations for ripeness ("Ripe" vs. "Unripe") based on fruit color and image capture dates.<n>The resulting comprehensive dataset, Fuji-Ripeness-Size dataset, includes 4,027 images and 16,257 annotated apples with ripeness and size labels.
  arXiv  Detail & Related papers  (2025-02-03T21:55:02Z)
• Horticultural Temporal Fruit Monitoring via 3D Instance Segmentation and Re-Identification using Point Clouds [29.23207854514898]
  We present a novel approach for temporal fruit monitoring that addresses point clouds collected in a greenhouse over time. Our method segments fruits using a learning-based instance segmentation approach directly on the point cloud. Experimental results on a real dataset of strawberries demonstrate that our approach outperforms other methods for fruits re-identification over time.
  arXiv  Detail & Related papers  (2024-11-12T13:53:22Z)
• Enhancing Fruit and Vegetable Detection in Unconstrained Environment with a Novel Dataset [4.498047714838568]
  This paper presents an end-to-end pipeline for detecting and localizing fruits and vegetables in real-world scenarios. We have curated a dataset named FRUVEG67 that includes images of 67 classes of fruits and vegetables captured in unconstrained scenarios. For detection, we introduce the Fruit and Vegetable Detection Network (FVDNet), an ensemble version of YOLOv7 featuring three distinct grid configurations.
  arXiv  Detail & Related papers  (2024-09-20T08:46:03Z)
• Few-Shot Fruit Segmentation via Transfer Learning [4.616529139444651]
  We develop a few-shot semantic segmentation framework for infield fruits using transfer learning. Motivated by similar success in urban scene parsing, we propose specialized pre-training. We show that models with pre-training learn to distinguish between fruit still on the trees and fruit that have fallen on the ground.
  arXiv  Detail & Related papers  (2024-05-04T04:05:59Z)
• A noisy elephant in the room: Is your out-of-distribution detector robust to label noise? [49.88894124047644]
  We take a closer look at 20 state-of-the-art OOD detection methods. We show that poor separation between incorrectly classified ID samples vs. OOD samples is an overlooked yet important limitation of existing methods.
  arXiv  Detail & Related papers  (2024-04-02T09:40:22Z)
• A pipeline for multiple orange detection and tracking with 3-D fruit relocalization and neural-net based yield regression in commercial citrus orchards [0.0]
  We propose a non-invasive alternative that utilizes fruit counting from videos, implemented as a pipeline. To handle occluded and re-appeared fruit, we introduce a relocalization component that employs 3-D estimation of fruit locations. By ensuring that at least 30% of the fruit is accurately detected, tracked, and counted, our yield regressor achieves an impressive coefficient of determination of 0.85.
  arXiv  Detail & Related papers  (2023-12-27T21:22:43Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• Fruit Ripeness Classification: a Survey [59.11160990637616]
  Many automatic methods have been proposed that employ a variety of feature descriptors for the food item to be graded. Machine learning and deep learning techniques dominate the top-performing methods. Deep learning can operate on raw data and thus relieve the users from having to compute complex engineered features.
  arXiv  Detail & Related papers  (2022-12-29T19:32:20Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Facilitated machine learning for image-based fruit quality assessment in developing countries [68.8204255655161]
  Automated image classification is a common task for supervised machine learning in food science. We propose an alternative method based on pre-trained vision transformers (ViTs) It can be easily implemented with limited resources on a standard device.
  arXiv  Detail & Related papers  (2022-07-10T19:52:20Z)
• Dataset and Performance Comparison of Deep Learning Architectures for Plum Detection and Robotic Harvesting [3.7692411550925673]
  Two new datasets are gathered during day and night operation of an actual robotic plum harvesting system. A range of current generation deep learning object detectors are benchmarked against these. Two methods for fusing depth and image information are tested for their impact on detector performance.
  arXiv  Detail & Related papers  (2021-05-09T04:18:58Z)
• Automatic Recall Machines: Internal Replay, Continual Learning and the Brain [104.38824285741248]
  Replay in neural networks involves training on sequential data with memorized samples, which counteracts forgetting of previous behavior caused by non-stationarity. We present a method where these auxiliary samples are generated on the fly, given only the model that is being trained for the assessed objective. Instead the implicit memory of learned samples within the assessed model itself is exploited.
  arXiv  Detail & Related papers  (2020-06-22T15:07:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.