Hierarchical Mask2Former: Panoptic Segmentation of Crops, Weeds and Leaves

• URL: http://arxiv.org/abs/2310.06582v1
• Date: Tue, 10 Oct 2023 12:47:31 GMT
• Title: Hierarchical Mask2Former: Panoptic Segmentation of Crops, Weeds and Leaves
• Authors: Madeleine Darbyshire, Elizabeth Sklar, Simon Parsons
• Abstract summary: We propose a hierarchical panoptic segmentation method to identify indicators of plant growth and locate weeds within an image. We adapt Mask2Former, a state-of-the-art architecture for panoptic segmentation, to predict crop, weed and leaf masks. With our more compact architecture, inference is up to 60% faster and the reduction in PQdag is less than 1%.
• Score: 0.41129099372031175
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Advancements in machine vision that enable detailed inferences to be made from images have the potential to transform many sectors including agriculture. Precision agriculture, where data analysis enables interventions to be precisely targeted, has many possible applications. Precision spraying, for example, can limit the application of herbicide only to weeds, or limit the application of fertiliser only to undernourished crops, instead of spraying the entire field. The approach promises to maximise yields, whilst minimising resource use and harms to the surrounding environment. To this end, we propose a hierarchical panoptic segmentation method to simultaneously identify indicators of plant growth and locate weeds within an image. We adapt Mask2Former, a state-of-the-art architecture for panoptic segmentation, to predict crop, weed and leaf masks. We achieve a PQ{\dag} of 75.99. Additionally, we explore approaches to make the architecture more compact and therefore more suitable for time and compute constrained applications. With our more compact architecture, inference is up to 60% faster and the reduction in PQ{\dag} is less than 1%.

Related papers

• WeedsGalore: A Multispectral and Multitemporal UAV-based Dataset for Crop and Weed Segmentation in Agricultural Maize Fields [0.7421845364041001]
  Weeds are one of the major reasons for crop yield loss but current weeding practices fail to manage weeds in an efficient and targeted manner. We present a novel dataset for semantic and instance segmentation of crops and weeds in agricultural maize fields.
  arXiv  Detail & Related papers  (2025-02-18T18:13:19Z)
• Exploiting Boundary Loss for the Hierarchical Panoptic Segmentation of Plants and Leaves [0.3659498819753633]
  We propose a hierarchical panoptic segmentation method that simultaneously determines leaf count and locates weeds within an image. Not only does this result in competitive performance, achieving a PQ+ of 81.89 on the standard training set, but we also demonstrate we can improve leaf-counting accuracy with our method.
  arXiv  Detail & Related papers  (2024-12-31T16:23:58Z)
• Generating Diverse Agricultural Data for Vision-Based Farming Applications [74.79409721178489]
  This model is capable of simulating distinct growth stages of plants, diverse soil conditions, and randomized field arrangements under varying lighting conditions. Our dataset includes 12,000 images with semantic labels, offering a comprehensive resource for computer vision tasks in precision agriculture.
  arXiv  Detail & Related papers  (2024-03-27T08:42:47Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation [42.39035033967183]
  Service robots need a real-time perception system that understands their surroundings and identifies their targets in the wild. Existing methods, however, often fall short in generalizing to new crops and environmental conditions. We propose a novel approach to enhance domain generalization using knowledge distillation.
  arXiv  Detail & Related papers  (2023-04-03T14:28:29Z)
• Agave crop segmentation and maturity classification with deep learning data-centric strategies using very high-resolution satellite imagery [101.18253437732933]
  We present an Agave tequilana Weber azul crop segmentation and maturity classification using very high resolution satellite imagery. We solve real-world deep learning problems in the very specific context of agave crop segmentation. With the resulting accurate models, agave production forecasting can be made available for large regions.
  arXiv  Detail & Related papers  (2023-03-21T03:15:29Z)
• Semantic Image Segmentation with Deep Learning for Vine Leaf Phenotyping [59.0626764544669]
  In this study, we use Deep Learning methods to semantically segment grapevine leaves images in order to develop an automated object detection system for leaf phenotyping. Our work contributes to plant lifecycle monitoring through which dynamic traits such as growth and development can be captured and quantified.
  arXiv  Detail & Related papers  (2022-10-24T14:37:09Z)
• Deep-CNN based Robotic Multi-Class Under-Canopy Weed Control in Precision Farming [2.6085535710135654]
  Real-time multi-class weed identification enables species-specific treatment of weeds and significantly reduces the amount of herbicide use. Here, we present a baseline for classification performance using five benchmark CNN models. We deploy MobileNetV2 onto our own compact autonomous robot textitSAMBot for real-time weed detection.
  arXiv  Detail & Related papers  (2021-12-28T03:51:55Z)
• Potato Crop Stress Identification in Aerial Images using Deep Learning-based Object Detection [60.83360138070649]
  The paper presents an approach for analyzing aerial images of a potato crop using deep neural networks. The main objective is to demonstrate automated spatial recognition of a healthy versus stressed crop at a plant level. Experimental validation demonstrated the ability for distinguishing healthy and stressed plants in field images, achieving an average Dice coefficient of 0.74.
  arXiv  Detail & Related papers  (2021-06-14T21:57:40Z)
• Weed Density and Distribution Estimation for Precision Agriculture using Semi-Supervised Learning [0.0]
  We propose a deep learning-based semi-supervised approach for robust estimation of weed density and distribution. In this work, the foreground vegetation pixels containing crops and weeds are first identified using a Convolutional Neural Network (CNN) based unsupervised segmentation. The weed infected regions are identified using a fine-tuned CNN, eliminating the need for designing hand-crafted features.
  arXiv  Detail & Related papers  (2020-11-04T09:35:53Z)
• Two-View Fine-grained Classification of Plant Species [66.75915278733197]
  We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
  arXiv  Detail & Related papers  (2020-05-18T21:57:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.