LeafMask: Towards Greater Accuracy on Leaf Segmentation
- URL: http://arxiv.org/abs/2108.03568v1
- Date: Sun, 8 Aug 2021 04:57:18 GMT
- Title: LeafMask: Towards Greater Accuracy on Leaf Segmentation
- Authors: Ruohao Guo, Liao Qu, Dantong Niu, Zhenbo Li, Jun Yue
- Abstract summary: LeafMask is a new end-to-end model to delineate each leaf region and count the number of leaves.
Our proposed model achieves the 90.09% BestDice score, outperforming other state-of-the-art approaches.
- Score: 1.0499611180329804
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Leaf segmentation is the most direct and effective way for high-throughput
plant phenotype data analysis and quantitative researches of complex traits.
Currently, the primary goal of plant phenotyping is to raise the accuracy of
the autonomous phenotypic measurement. In this work, we present the LeafMask
neural network, a new end-to-end model to delineate each leaf region and count
the number of leaves, with two main components: 1) the mask assembly module
merging position-sensitive bases of each predicted box after non-maximum
suppression (NMS) and corresponding coefficients to generate original masks; 2)
the mask refining module elaborating leaf boundaries from the mask assembly
module by the point selection strategy and predictor. In addition, we also
design a novel and flexible multi-scale attention module for the dual
attention-guided mask (DAG-Mask) branch to effectively enhance information
expression and produce more accurate bases. Our main contribution is to
generate the final improved masks by combining the mask assembly module with
the mask refining module under the anchor-free instance segmentation paradigm.
We validate our LeafMask through extensive experiments on Leaf Segmentation
Challenge (LSC) dataset. Our proposed model achieves the 90.09% BestDice score
outperforming other state-of-the-art approaches.
Related papers
- Mask2Anomaly: Mask Transformer for Universal Open-set Segmentation [29.43462426812185]
We propose a paradigm change by shifting from a per-pixel classification to a mask classification.
Our mask-based method, Mask2Anomaly, demonstrates the feasibility of integrating a mask-classification architecture.
By comprehensive qualitative and qualitative evaluation, we show Mask2Anomaly achieves new state-of-the-art results.
arXiv Detail & Related papers (2023-09-08T20:07:18Z) - DFormer: Diffusion-guided Transformer for Universal Image Segmentation [86.73405604947459]
The proposed DFormer views universal image segmentation task as a denoising process using a diffusion model.
At inference, our DFormer directly predicts the masks and corresponding categories from a set of randomly-generated masks.
Our DFormer outperforms the recent diffusion-based panoptic segmentation method Pix2Seq-D with a gain of 3.6% on MS COCO val 2017 set.
arXiv Detail & Related papers (2023-06-06T06:33:32Z) - DynaMask: Dynamic Mask Selection for Instance Segmentation [21.50329070835023]
We develop a Mask Switch Module (MSM) with negligible computational cost to select the most suitable mask resolution for each instance.
The proposed method, namely DynaMask, brings consistent and noticeable performance improvements over other state-of-the-arts at a moderate computation overhead.
arXiv Detail & Related papers (2023-03-14T13:01:25Z) - SODAR: Segmenting Objects by DynamicallyAggregating Neighboring Mask
Representations [90.8752454643737]
Recent state-of-the-art one-stage instance segmentation model SOLO divides the input image into a grid and directly predicts per grid cell object masks with fully-convolutional networks.
We observe SOLO generates similar masks for an object at nearby grid cells, and these neighboring predictions can complement each other as some may better segment certain object part.
Motivated by the observed gap, we develop a novel learning-based aggregation method that improves upon SOLO by leveraging the rich neighboring information.
arXiv Detail & Related papers (2022-02-15T13:53:03Z) - Pseudo-mask Matters inWeakly-supervised Semantic Segmentation [24.73662587701187]
We find some matters related to the pseudo-masks, including high quality pseudo-masks generation from class activation maps (CAMs) and training with noisy pseudo-mask supervision.
We propose the following designs to push the performance to new state-of-art: (i) Coefficient of Variation Smoothing to smooth the CAMs adaptively; (ii) Proportional Pseudo-mask Generation to project the expanded CAMs to pseudo-mask based on a new metric indicating the importance of each class on each location; (iii) Pretended Under-Fitting strategy to suppress the influence of noise in pseudo
arXiv Detail & Related papers (2021-08-30T05:35:28Z) - Image Inpainting by End-to-End Cascaded Refinement with Mask Awareness [66.55719330810547]
Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial.
We propose a novel mask-aware inpainting solution that learns multi-scale features for missing regions in the encoding phase.
Our framework is validated both quantitatively and qualitatively via extensive experiments on three public datasets.
arXiv Detail & Related papers (2021-04-28T13:17:47Z) - Investigating and Simplifying Masking-based Saliency Methods for Model
Interpretability [5.387323728379395]
Saliency maps that identify the most informative regions of an image are valuable for model interpretability.
A common approach to creating saliency maps involves generating input masks that mask out portions of an image.
We show that a masking model can be trained with as few as 10 examples per class and still generate saliency maps with only a 0.7-point increase in localization error.
arXiv Detail & Related papers (2020-10-19T18:00:36Z) - Improving Self-supervised Pre-training via a Fully-Explored Masked
Language Model [57.77981008219654]
Masked Language Model (MLM) framework has been widely adopted for self-supervised language pre-training.
We propose a fully-explored masking strategy, where a text sequence is divided into a certain number of non-overlapping segments.
arXiv Detail & Related papers (2020-10-12T21:28:14Z) - Online Multi-Object Tracking and Segmentation with GMPHD Filter and
Mask-based Affinity Fusion [79.87371506464454]
We propose a fully online multi-object tracking and segmentation (MOTS) method that uses instance segmentation results as an input.
The proposed method is based on the Gaussian mixture probability hypothesis density (GMPHD) filter, a hierarchical data association (HDA), and a mask-based affinity fusion (MAF) model.
In the experiments on the two popular MOTS datasets, the key modules show some improvements.
arXiv Detail & Related papers (2020-08-31T21:06:22Z) - PointINS: Point-based Instance Segmentation [117.38579097923052]
Mask representation in instance segmentation with Point-of-Interest (PoI) features is challenging because learning a high-dimensional mask feature for each instance requires a heavy computing burden.
We propose an instance-aware convolution, which decomposes this mask representation learning task into two tractable modules.
Along with instance-aware convolution, we propose PointINS, a simple and practical instance segmentation approach.
arXiv Detail & Related papers (2020-03-13T08:24:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.