Agtech Framework for Cranberry-Ripening Analysis Using Vision Foundation Models

• URL: http://arxiv.org/abs/2412.09739v1
• Date: Thu, 12 Dec 2024 22:03:33 GMT
• Title: Agtech Framework for Cranberry-Ripening Analysis Using Vision Foundation Models
• Authors: Faith Johnson, Ryan Meegan, Jack Lowry, Peter Oudemans, Kristin Dana,
• Abstract summary: We develop a framework for characterizing the ripening process of cranberry crops using aerial and ground imaging. This work is the first of its kind and has future impact for cranberries and for other crops including wine grapes, olives, blueberries, and maize.
• Score: 1.5728609542259502
• License:
• Abstract: Agricultural domains are being transformed by recent advances in AI and computer vision that support quantitative visual evaluation. Using aerial and ground imaging over a time series, we develop a framework for characterizing the ripening process of cranberry crops, a crucial component for precision agriculture tasks such as comparing crop breeds (high-throughput phenotyping) and detecting disease. Using drone imaging, we capture images from 20 waypoints across multiple bogs, and using ground-based imaging (hand-held camera), we image same bog patch using fixed fiducial markers. Both imaging methods are repeated to gather a multi-week time series spanning the entire growing season. Aerial imaging provides multiple samples to compute a distribution of albedo values. Ground imaging enables tracking of individual berries for a detailed view of berry appearance changes. Using vision transformers (ViT) for feature detection after segmentation, we extract a high dimensional feature descriptor of berry appearance. Interpretability of appearance is critical for plant biologists and cranberry growers to support crop breeding decisions (e.g.\ comparison of berry varieties from breeding programs). For interpretability, we create a 2D manifold of cranberry appearance by using a UMAP dimensionality reduction on ViT features. This projection enables quantification of ripening paths and a useful metric of ripening rate. We demonstrate the comparison of four cranberry varieties based on our ripening assessments. This work is the first of its kind and has future impact for cranberries and for other crops including wine grapes, olives, blueberries, and maize. Aerial and ground datasets are made publicly available.

Related papers

• BonnBeetClouds3D: A Dataset Towards Point Cloud-based Organ-level Phenotyping of Sugar Beet Plants under Field Conditions [30.27773980916216]
  Agricultural production is facing severe challenges in the next decades induced by climate change and the need for sustainability. Advancements in field management through non-chemical weeding by robots in combination with monitoring of crops by autonomous unmanned aerial vehicles (UAVs) are helpful to address these challenges. The analysis of plant traits, called phenotyping, is an essential activity in plant breeding, it however involves a great amount of manual labor.
  arXiv  Detail & Related papers  (2023-12-22T14:06:44Z)
• Vision-Based Cranberry Crop Ripening Assessment [1.8434042562191815]
  This work is the first of its kind in quantitative evaluation of ripening using computer vision methods. It has impact beyond cranberry crops including wine grapes, olives, blueberries, and maize.
  arXiv  Detail & Related papers  (2023-08-31T14:58:11Z)
• Semantic Image Segmentation with Deep Learning for Vine Leaf Phenotyping [59.0626764544669]
  In this study, we use Deep Learning methods to semantically segment grapevine leaves images in order to develop an automated object detection system for leaf phenotyping. Our work contributes to plant lifecycle monitoring through which dynamic traits such as growth and development can be captured and quantified.
  arXiv  Detail & Related papers  (2022-10-24T14:37:09Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Agricultural Plant Cataloging and Establishment of a Data Framework from UAV-based Crop Images by Computer Vision [4.0382342610484425]
  We present a hands-on workflow for the automatized temporal and spatial identification and individualization of crop images from UAVs. The presented approach improves analysis and interpretation of UAV data in agriculture significantly.
  arXiv  Detail & Related papers  (2022-01-08T21:14:07Z)
• Potato Crop Stress Identification in Aerial Images using Deep Learning-based Object Detection [60.83360138070649]
  The paper presents an approach for analyzing aerial images of a potato crop using deep neural networks. The main objective is to demonstrate automated spatial recognition of a healthy versus stressed crop at a plant level. Experimental validation demonstrated the ability for distinguishing healthy and stressed plants in field images, achieving an average Dice coefficient of 0.74.
  arXiv  Detail & Related papers  (2021-06-14T21:57:40Z)
• A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagery [56.10033255997329]
  We propose a novel deep learning method based on a Convolutional Neural Network (CNN) It simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops.
  arXiv  Detail & Related papers  (2020-12-31T18:51:17Z)
• Deep Multi-view Image Fusion for Soybean Yield Estimation in Breeding Applications Deep Multi-view Image Fusion for Soybean Yield Estimation in Breeding Applications [7.450586438835518]
  The objective of this study is to develop a machine learning (ML) approach adept at soybean pod counting. We developed a multi-view image-based yield estimation framework utilizing deep learning architectures. Our results demonstrate the promise of ML models in making breeding decisions with significant reduction of time and human effort.
  arXiv  Detail & Related papers  (2020-11-13T20:37:04Z)
• Counting of Grapevine Berries in Images via Semantic Segmentation using Convolutional Neural Networks [5.826324731529213]
  We present an objective framework based on automatic image analysis which works on two different training systems. The framework uses a convolutional neural network to detect single berries in images by performing a semantic segmentation. We achieve an accuracy for the berry detection of 94.0% in the VSP and 85.6% in the SMPH.
  arXiv  Detail & Related papers  (2020-04-29T08:10:19Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)
• Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis [110.30849704592592]
  We present Agriculture-Vision: a large-scale aerial farmland image dataset for semantic segmentation of agricultural patterns. Each image consists of RGB and Near-infrared (NIR) channels with resolution as high as 10 cm per pixel. We annotate nine types of field anomaly patterns that are most important to farmers.
  arXiv  Detail & Related papers  (2020-01-05T20:19:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.