Eff-3DPSeg: 3D organ-level plant shoot segmentation using annotation-efficient point clouds

• URL: http://arxiv.org/abs/2212.10263v1
• Date: Tue, 20 Dec 2022 14:09:37 GMT
• Title: Eff-3DPSeg: 3D organ-level plant shoot segmentation using annotation-efficient point clouds
• Authors: Liyi Luo, Xintong Jiang, Yu Yang, Eugene Roy Antony Samy, Mark Lefsrud, Valerio Hoyos-Villegas, and Shangpeng Sun
• Abstract summary: We propose a novel weakly supervised framework, Eff-3DPSeg, for 3D plant shoot segmentation. High-resolution point clouds of soybean were reconstructed using a low-cost photogrammetry system. A weakly-supervised deep learning method was proposed for plant organ segmentation.
• Score: 1.5882586857953638
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Reliable and automated 3D plant shoot segmentation is a core prerequisite for the extraction of plant phenotypic traits at the organ level. Combining deep learning and point clouds can provide effective ways to address the challenge. However, fully supervised deep learning methods require datasets to be point-wise annotated, which is extremely expensive and time-consuming. In our work, we proposed a novel weakly supervised framework, Eff-3DPSeg, for 3D plant shoot segmentation. First, high-resolution point clouds of soybean were reconstructed using a low-cost photogrammetry system, and the Meshlab-based Plant Annotator was developed for plant point cloud annotation. Second, a weakly-supervised deep learning method was proposed for plant organ segmentation. The method contained: (1) Pretraining a self-supervised network using Viewpoint Bottleneck loss to learn meaningful intrinsic structure representation from the raw point clouds; (2) Fine-tuning the pre-trained model with about only 0.5% points being annotated to implement plant organ segmentation. After, three phenotypic traits (stem diameter, leaf width, and leaf length) were extracted. To test the generality of the proposed method, the public dataset Pheno4D was included in this study. Experimental results showed that the weakly-supervised network obtained similar segmentation performance compared with the fully-supervised setting. Our method achieved 95.1%, 96.6%, 95.8% and 92.2% in the Precision, Recall, F1-score, and mIoU for stem leaf segmentation and 53%, 62.8% and 70.3% in the AP, AP@25, and AP@50 for leaf instance segmentation. This study provides an effective way for characterizing 3D plant architecture, which will become useful for plant breeders to enhance selection processes.

Related papers

• Bayesian Self-Training for Semi-Supervised 3D Segmentation [59.544558398992386]
  3D segmentation is a core problem in computer vision. densely labeling 3D point clouds to employ fully-supervised training remains too labor intensive and expensive. Semi-supervised training provides a more practical alternative, where only a small set of labeled data is given, accompanied by a larger unlabeled set.
  arXiv  Detail & Related papers  (2024-09-12T14:54:31Z)
• Class-Imbalanced Semi-Supervised Learning for Large-Scale Point Cloud Semantic Segmentation via Decoupling Optimization [64.36097398869774]
  Semi-supervised learning (SSL) has been an active research topic for large-scale 3D scene understanding. The existing SSL-based methods suffer from severe training bias due to class imbalance and long-tail distributions of the point cloud data. We introduce a new decoupling optimization framework, which disentangles feature representation learning and classifier in an alternative optimization manner to shift the bias decision boundary effectively.
  arXiv  Detail & Related papers  (2024-01-13T04:16:40Z)
• PST: Plant segmentation transformer for 3D point clouds of rapeseed plants at the podding stage [5.010317705589445]
  deep learning network plant segmentation transformer (PST) PST is composed of: (i) a dynamic voxel feature encoder (DVFE) to aggregate the point features with the raw spatial resolution; (ii) a dual window sets attention blocks to capture contextual information; and (iii) a dense feature propagation module to obtain the final dense point feature map. Results: PST and PST-PointGroup (PG) achieved superior performance in semantic and instance segmentation tasks.
  arXiv  Detail & Related papers  (2022-06-27T06:56:48Z)
• An Effective Leaf Recognition Using Convolutional Neural Networks Based Features [1.137457877869062]
  In this paper, we propose an effective method for the leaf recognition problem. A leaf goes through some pre-processing to extract its refined color image, vein image, xy-projection histogram, handcrafted shape, texture features, and Fourier descriptors. These attributes are then transformed into a better representation by neural network-based encoders before a support vector machine (SVM) model is utilized to classify different leaves.
  arXiv  Detail & Related papers  (2021-08-04T02:02:22Z)
• FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanism [49.89268018642999]
  We propose a fast shape-based network (FS-Net) with efficient category-level feature extraction for 6D pose estimation. The proposed method achieves state-of-the-art performance in both category- and instance-level 6D object pose estimation.
  arXiv  Detail & Related papers  (2021-03-12T03:07:24Z)
• A Deep Learning Approach Based on Graphs to Detect Plantation Lines [16.76043873454695]
  We propose a deep learning approach based on graphs to detect plantation lines in UAV-based RGB imagery. The proposed method was compared against state-of-the-art deep learning methods. It achieved superior performance with a significant margin, returning precision, recall, and F1-score of 98.7%, 91.9%, and 95.1%, respectively.
  arXiv  Detail & Related papers  (2021-02-05T14:56:42Z)
• Stem-leaf segmentation and phenotypic trait extraction of maize shoots from three-dimensional point cloud [8.392251372468412]
  We propose an automatic stem-leaf segmentation method consisting of three main steps: skeleton extraction, coarse segmentation based on the skeleton, fine segmentation based on stem-leaf classification. Six phenotypic parameters can be accurately and automatically measured, including plant height, crown diameter, stem height and diameter, leaf width and length. The proposed algorithm could precisely segment not only the fully expanded leaves, but also the new leaves wrapped together and close together.
  arXiv  Detail & Related papers  (2020-09-07T13:58:09Z)
• Deep Semi-supervised Knowledge Distillation for Overlapping Cervical Cell Instance Segmentation [54.49894381464853]
  We propose to leverage both labeled and unlabeled data for instance segmentation with improved accuracy by knowledge distillation. We propose a novel Mask-guided Mean Teacher framework with Perturbation-sensitive Sample Mining. Experiments show that the proposed method improves the performance significantly compared with the supervised method learned from labeled data only.
  arXiv  Detail & Related papers  (2020-07-21T13:27:09Z)
• Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images [51.893494939675314]
  We propose a novel weakly supervised segmentation framework based on partial points annotation. We show that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-10T15:41:29Z)
• Two-View Fine-grained Classification of Plant Species [66.75915278733197]
  We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
  arXiv  Detail & Related papers  (2020-05-18T21:57:47Z)
• Automated classification of stems and leaves of potted plants based on point cloud data [21.085243796341743]
  A classification method was proposed to classify the leaves and stems of potted plants automatically. The leaf point training samples were automatically extracted by using the three-dimensional convex hull algorithm. The two training sets were used to classify all the points into leaf points and stem points by utilizing the support vector machine (SVM) algorithm.
  arXiv  Detail & Related papers  (2020-02-28T04:15:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.