Autonomous Apple Fruitlet Sizing and Growth Rate Tracking using Computer Vision

• URL: http://arxiv.org/abs/2212.01506v2
• Date: Wed, 6 Dec 2023 19:43:16 GMT
• Title: Autonomous Apple Fruitlet Sizing and Growth Rate Tracking using Computer Vision
• Abstract summary: We present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets across multiple days. We demonstrate that our system is able to predict abscise rates within 3.5% of the current method with a 6 times improvement in speed.
• Score: 6.303112417588331
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. Measuring the growth rates of apple fruitlets is important because it allows apple growers to determine when to apply chemical thinners to their crops in order to optimize yield. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets across multiple days. Due to the number of fruitlets needed to be sized, this method is laborious, time-consuming, and prone to human error. With images collected by a hand-held stereo camera, our system, segments, clusters, and fits ellipses to fruitlets to measure their diameters. The growth rates are then calculated by temporally associating clustered fruitlets across days. We provide quantitative results on data collected in an apple orchard, and demonstrate that our system is able to predict abscise rates within 3.5% of the current method with a 6 times improvement in speed, while requiring significantly less manual effort. Moreover, we provide results on images captured by a robotic system in the field, and discuss the next steps required to make the process fully autonomous.

Related papers

• Visual-SLAM for the detection of hidden tomatoes in greenhouses by Hierarchical Localization and GLOMAP for robotized harvesting [39.55454029331185]
  This work proposes a Visual-SLAM system using a monocular camera, which is significantly more cost-effective and specifically tailored for agricultural applications.<n>Tests were carried out on a real tomato bunch, located in the Agroconnect experimental greenhouse.
  arXiv  Detail & Related papers  (2026-09-10T16:19:36Z)
• How to rewrite the stars: Mapping your orchard over time through constellations of fruits [8.064400168497373]
  We propose a new paradigm to tackle the problem of matching fruits across videos.<n>The proposed method can be successfully used to match fruits across videos and through time.<n>It can also be used to build an orchard map and later use it to locate the camera pose in 6DoF.
  arXiv  Detail & Related papers  (2026-02-04T16:31:32Z)
• Assessing SAM for Tree Crown Instance Segmentation from Drone Imagery [68.69685477556682]
  Current monitoring methods involve measuring trees by hand for each species, requiring extensive cost, time, and labour. Advances in drone remote sensing and computer vision offer great potential for mapping and characterizing trees from aerial imagery. We compare SAM methods for the task of automatic tree crown instance segmentation in high resolution drone imagery of young tree plantations. We find that methods using SAM out-of-the-box do not outperform a custom Mask R-CNN, even with well-designed prompts, but that there is potential for methods which tune SAM further.
  arXiv  Detail & Related papers  (2025-03-26T03:45:36Z)
• Foundation Model-Based Apple Ripeness and Size Estimation for Selective Harvesting [8.944833667187913]
  This study introduces a novel foundation model-based framework for efficient apple ripeness and size estimation. We curated two public RGBD-based Fuji apple image datasets, integrating expanded annotations for ripeness ("Ripe" vs. "Unripe") based on fruit color and image capture dates. The resulting comprehensive dataset, Fuji-Ripeness-Size dataset, includes 4,027 images and 16,257 annotated apples with ripeness and size labels.
  arXiv  Detail & Related papers  (2025-02-03T21:55:02Z)
• Retrieval Augmented Recipe Generation [96.43285670458803]
  We propose a retrieval augmented large multimodal model for recipe generation. It retrieves recipes semantically related to the image from an existing datastore as a supplement. It calculates the consistency among generated recipe candidates, which use different retrieval recipes as context for generation.
  arXiv  Detail & Related papers  (2024-11-13T15:58:50Z)
• Horticultural Temporal Fruit Monitoring via 3D Instance Segmentation and Re-Identification using Point Clouds [29.23207854514898]
  We present a novel approach for temporal fruit monitoring that addresses point clouds collected in a greenhouse over time. Our method segments fruits using a learning-based instance segmentation approach directly on the point cloud. Experimental results on a real dataset of strawberries demonstrate that our approach outperforms other methods for fruits re-identification over time.
  arXiv  Detail & Related papers  (2024-11-12T13:53:22Z)
• A pipeline for multiple orange detection and tracking with 3-D fruit relocalization and neural-net based yield regression in commercial citrus orchards [0.0]
  We propose a non-invasive alternative that utilizes fruit counting from videos, implemented as a pipeline. To handle occluded and re-appeared fruit, we introduce a relocalization component that employs 3-D estimation of fruit locations. By ensuring that at least 30% of the fruit is accurately detected, tracked, and counted, our yield regressor achieves an impressive coefficient of determination of 0.85.
  arXiv  Detail & Related papers  (2023-12-27T21:22:43Z)
• Vision-Based Cranberry Crop Ripening Assessment [1.8434042562191815]
  This work is the first of its kind in quantitative evaluation of ripening using computer vision methods. It has impact beyond cranberry crops including wine grapes, olives, blueberries, and maize.
  arXiv  Detail & Related papers  (2023-08-31T14:58:11Z)
• Panoptic Mapping with Fruit Completion and Pose Estimation for Horticultural Robots [33.21287030243106]
  Monitoring plants and fruits at high resolution play a key role in the future of agriculture. Accurate 3D information can pave the way to a diverse number of robotic applications in agriculture ranging from autonomous harvesting to precise yield estimation. We address the problem of jointly estimating complete 3D shapes of fruit and their pose in a 3D multi-resolution map built by a mobile robot.
  arXiv  Detail & Related papers  (2023-03-15T20:41:24Z)
• Fruit Ripeness Classification: a Survey [59.11160990637616]
  Many automatic methods have been proposed that employ a variety of feature descriptors for the food item to be graded. Machine learning and deep learning techniques dominate the top-performing methods. Deep learning can operate on raw data and thus relieve the users from having to compute complex engineered features.
  arXiv  Detail & Related papers  (2022-12-29T19:32:20Z)
• Apple Counting using Convolutional Neural Networks [22.504279159923765]
  Estimating accurate and reliable fruit and vegetable counts from images in real-world settings, such as orchards, is a challenging problem. We formulate fruit counting from images as a multi-class classification problem and solve it by training a Convolutional Neural Network. Our network outperforms it in three out of four datasets with a maximum of 94% accuracy.
  arXiv  Detail & Related papers  (2022-08-24T14:13:40Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Facilitated machine learning for image-based fruit quality assessment in developing countries [68.8204255655161]
  Automated image classification is a common task for supervised machine learning in food science. We propose an alternative method based on pre-trained vision transformers (ViTs) It can be easily implemented with limited resources on a standard device.
  arXiv  Detail & Related papers  (2022-07-10T19:52:20Z)
• A workflow for segmenting soil and plant X-ray CT images with deep learning in Googles Colaboratory [45.99558884106628]
  We develop a modular workflow for applying convolutional neural networks to X-ray microCT images. We show how parameters can be optimized to achieve best results using example scans from walnut leaves, almond flower buds, and a soil aggregate.
  arXiv  Detail & Related papers  (2022-03-18T00:47:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.