Exploiting Boundary Loss for the Hierarchical Panoptic Segmentation of Plants and Leaves

• URL: http://arxiv.org/abs/2501.00527v1
• Date: Tue, 31 Dec 2024 16:23:58 GMT
• Title: Exploiting Boundary Loss for the Hierarchical Panoptic Segmentation of Plants and Leaves
• Authors: Madeleine Darbyshire, Elizabeth Sklar, Simon Parsons,
• Abstract summary: We propose a hierarchical panoptic segmentation method that simultaneously determines leaf count and locates weeds within an image. Not only does this result in competitive performance, achieving a PQ+ of 81.89 on the standard training set, but we also demonstrate we can improve leaf-counting accuracy with our method.
• Score: 0.3659498819753633
• License:
• Abstract: Precision agriculture leverages data and machine learning so that farmers can monitor their crops and target interventions precisely. This enables the precision application of herbicide only to weeds, or the precision application of fertilizer only to undernourished crops, rather than to the entire field. The approach promises to maximize yields while minimizing resource use and harm to the surrounding environment. To this end, we propose a hierarchical panoptic segmentation method that simultaneously determines leaf count (as an identifier of plant growth)and locates weeds within an image. In particular, our approach aims to improve the segmentation of smaller instances like the leaves and weeds by incorporating focal loss and boundary loss. Not only does this result in competitive performance, achieving a PQ+ of 81.89 on the standard training set, but we also demonstrate we can improve leaf-counting accuracy with our method. The code is available at https://github.com/madeleinedarbyshire/HierarchicalMask2Former.

Related papers

• Hierarchical Mask2Former: Panoptic Segmentation of Crops, Weeds and Leaves [0.41129099372031175]
  We propose a hierarchical panoptic segmentation method to identify indicators of plant growth and locate weeds within an image. We adapt Mask2Former, a state-of-the-art architecture for panoptic segmentation, to predict crop, weed and leaf masks. With our more compact architecture, inference is up to 60% faster and the reduction in PQdag is less than 1%.
  arXiv  Detail & Related papers  (2023-10-10T12:47:31Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• On the Real-Time Semantic Segmentation of Aphid Clusters in the Wild [13.402804225093801]
  Aphid infestations can cause extensive damage to wheat and sorghum fields and spread plant viruses. Farmers often rely on chemical pesticides, which are inefficiently applied over large areas of fields. We propose the use of real-time semantic segmentation models to segment clusters of aphids.
  arXiv  Detail & Related papers  (2023-07-17T19:04:39Z)
• Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain [29.647846446064992]
  Plant phenotyping is a central task in agriculture, as it describes plants' growth stage, development, and other relevant quantities. In this paper, we address the problem of joint semantic, plant instance, and leaf instance segmentation of crop fields from RGB data. We propose a single convolutional neural network that addresses the three tasks simultaneously, exploiting their underlying hierarchical structure.
  arXiv  Detail & Related papers  (2022-10-14T15:01:08Z)
• End-to-end deep learning for directly estimating grape yield from ground-based imagery [53.086864957064876]
  This study demonstrates the application of proximal imaging combined with deep learning for yield estimation in vineyards. Three model architectures were tested: object detection, CNN regression, and transformer models. The study showed the applicability of proximal imaging and deep learning for prediction of grapevine yield on a large scale.
  arXiv  Detail & Related papers  (2022-08-04T01:34:46Z)
• Noisy Boundaries: Lemon or Lemonade for Semi-supervised Instance Segmentation? [59.25833574373718]
  We construct a framework for semi-supervised instance segmentation by assigning pixel-level pseudo labels. Under this framework, we point out that noisy boundaries associated with pseudo labels are double-edged. We propose to exploit and resist them in a unified manner simultaneously.
  arXiv  Detail & Related papers  (2022-03-25T03:06:24Z)
• Potato Crop Stress Identification in Aerial Images using Deep Learning-based Object Detection [60.83360138070649]
  The paper presents an approach for analyzing aerial images of a potato crop using deep neural networks. The main objective is to demonstrate automated spatial recognition of a healthy versus stressed crop at a plant level. Experimental validation demonstrated the ability for distinguishing healthy and stressed plants in field images, achieving an average Dice coefficient of 0.74.
  arXiv  Detail & Related papers  (2021-06-14T21:57:40Z)
• A CNN Approach to Simultaneously Count Plants and Detect Plantation-Rows from UAV Imagery [56.10033255997329]
  We propose a novel deep learning method based on a Convolutional Neural Network (CNN) It simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops.
  arXiv  Detail & Related papers  (2020-12-31T18:51:17Z)
• Weed Density and Distribution Estimation for Precision Agriculture using Semi-Supervised Learning [0.0]
  We propose a deep learning-based semi-supervised approach for robust estimation of weed density and distribution. In this work, the foreground vegetation pixels containing crops and weeds are first identified using a Convolutional Neural Network (CNN) based unsupervised segmentation. The weed infected regions are identified using a fine-tuned CNN, eliminating the need for designing hand-crafted features.
  arXiv  Detail & Related papers  (2020-11-04T09:35:53Z)
• Quantification of groundnut leaf defects using image processing algorithms [0.0]
  The present work attempts to estimate the percentage of affected groundnut leaves area across four regions of Andharapradesh using image processing techniques. The image analysis results across these four regions reveal that around 14 - 28% of leaves area is affected across the groundnut field.
  arXiv  Detail & Related papers  (2020-06-11T15:07:12Z)
• Two-View Fine-grained Classification of Plant Species [66.75915278733197]
  We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
  arXiv  Detail & Related papers  (2020-05-18T21:57:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.