Weakly and Semi-Supervised Detection, Segmentation and Tracking of Table Grapes with Limited and Noisy Data

• URL: http://arxiv.org/abs/2208.13001v1
• Date: Sat, 27 Aug 2022 12:58:42 GMT
• Title: Weakly and Semi-Supervised Detection, Segmentation and Tracking of Table Grapes with Limited and Noisy Data
• Authors: Thomas A. Ciarfuglia, Ionut M. Motoi, Leonardo Saraceni, Mulham Fawakherji, Alberto Sanfeliu, Daniele Nardi
• Abstract summary: Modern algorithms are data hungry and it is not always possible to gather enough data to apply the best performing supervised approaches. We propose a weakly supervised solution to reduce the data needed to get state-of-the-art detection and segmentation in precision agriculture applications. We show how our methods are able to train new models that achieve high performances with few labelled images and with very simple labelling.
• Score: 7.754321012552764
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Detection, segmentation and tracking of fruits and vegetables are three fundamental tasks for precision agriculture, enabling robotic harvesting and yield estimation applications. However, modern algorithms are data hungry and it is not always possible to gather enough data to apply the best performing supervised approaches. Since data collection is an expensive and cumbersome task, the enabling technologies for using computer vision in agriculture are often out of reach for small businesses. Following previous work in this context, where we proposed an initial weakly supervised solution to reduce the data needed to get state-of-the-art detection and segmentation in precision agriculture applications, here we improve that system and explore the problem of tracking fruits in orchards. We present the case of vineyards of table grapes in southern Lazio (Italy) since grapes are a difficult fruit to segment due to occlusion, color and general illumination conditions. We consider the case when there is some initial labelled data that could work as source data (e.g. wine grape data), but it is considerably different from the target data (e.g. table grape data). To improve detection and segmentation on the target data, we propose to train the segmentation algorithm with a weak bounding box label, while for tracking we leverage 3D Structure from Motion algorithms to generate new labels from already labelled samples. Finally, the two systems are combined in a full semi-supervised approach. Comparisons with SotA supervised solutions show how our methods are able to train new models that achieve high performances with few labelled images and with very simple labelling.

Related papers

• Enhancing Fruit and Vegetable Detection in Unconstrained Environment with a Novel Dataset [4.498047714838568]
  This paper presents an end-to-end pipeline for detecting and localizing fruits and vegetables in real-world scenarios. We have curated a dataset named FRUVEG67 that includes images of 67 classes of fruits and vegetables captured in unconstrained scenarios. For detection, we introduce the Fruit and Vegetable Detection Network (FVDNet), an ensemble version of YOLOv7 featuring three distinct grid configurations.
  arXiv  Detail & Related papers  (2024-09-20T08:46:03Z)
• MetaFruit Meets Foundation Models: Leveraging a Comprehensive Multi-Fruit Dataset for Advancing Agricultural Foundation Models [10.11552909915055]
  We introduce MetaFruit, the largest publicly available multi-class fruit dataset, comprising 4,248 images and 248,015 manually labeled instances. This study proposes an innovative open-set fruit detection system leveraging advanced Vision Foundation Models (VFMs) for fruit detection.
  arXiv  Detail & Related papers  (2024-05-14T00:13:47Z)
• Few-Shot Fruit Segmentation via Transfer Learning [4.616529139444651]
  We develop a few-shot semantic segmentation framework for infield fruits using transfer learning. Motivated by similar success in urban scene parsing, we propose specialized pre-training. We show that models with pre-training learn to distinguish between fruit still on the trees and fruit that have fallen on the ground.
  arXiv  Detail & Related papers  (2024-05-04T04:05:59Z)
• Classification of grapevine varieties using UAV hyperspectral imaging [0.0]
  The classification of different grapevine varieties is a relevant phenotyping task in Precision Viticulture. Unmanned Aerial Vehicles (UAVs) provide a more efficient and less prohibitive approach to collecting hyperspectral data. In this work, a Convolutional Neural Network (CNN) is proposed for classifying seventeen varieties of red and white grape variants.
  arXiv  Detail & Related papers  (2024-01-23T15:35:50Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• Productive Crop Field Detection: A New Dataset and Deep Learning Benchmark Results [1.2233362977312945]
  In precision agriculture, detecting productive crop fields is an essential practice that allows the farmer to evaluate operating performance. Previous studies explore different methods to detect crop fields using advanced machine learning algorithms. We propose a high-quality dataset generated by machine operation combined with Sentinel-2 images.
  arXiv  Detail & Related papers  (2023-05-19T20:30:59Z)
• Knowledge Combination to Learn Rotated Detection Without Rotated Annotation [53.439096583978504]
  Rotated bounding boxes drastically reduce output ambiguity of elongated objects. Despite the effectiveness, rotated detectors are not widely employed. We propose a framework that allows the model to predict precise rotated boxes.
  arXiv  Detail & Related papers  (2023-04-05T03:07:36Z)
• Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point Supervision [63.429704654271475]
  We propose a novel weakly supervised method RWSeg that only requires labeling one object with one point. With these sparse weak labels, we introduce a unified framework with two branches to propagate semantic and instance information. Specifically, we propose a Cross-graph Competing Random Walks (CRW) algorithm that encourages competition among different instance graphs.
  arXiv  Detail & Related papers  (2022-08-10T02:14:39Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Facilitated machine learning for image-based fruit quality assessment in developing countries [68.8204255655161]
  Automated image classification is a common task for supervised machine learning in food science. We propose an alternative method based on pre-trained vision transformers (ViTs) It can be easily implemented with limited resources on a standard device.
  arXiv  Detail & Related papers  (2022-07-10T19:52:20Z)
• CvS: Classification via Segmentation For Small Datasets [52.821178654631254]
  This paper presents CvS, a cost-effective classifier for small datasets that derives the classification labels from predicting the segmentation maps. We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.
  arXiv  Detail & Related papers  (2021-10-29T18:41:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.