Unsupervised Pre-Training for 3D Leaf Instance Segmentation
- URL: http://arxiv.org/abs/2401.08720v1
- Date: Tue, 16 Jan 2024 08:11:08 GMT
- Title: Unsupervised Pre-Training for 3D Leaf Instance Segmentation
- Authors: Gianmarco Roggiolani, Federico Magistri, Tiziano Guadagnino, Jens
Behley, Cyrill Stachniss
- Abstract summary: This paper addresses the problem of reducing the labeling effort required to perform leaf instance segmentation on 3D point clouds.
We propose a novel self-supervised task-specific pre-training approach to initialize the backbone of a network for leaf instance segmentation.
We also introduce a novel automatic postprocessing that considers the difficulty of correctly segmenting the points close to the stem.
- Score: 34.122575664767915
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Crops for food, feed, fiber, and fuel are key natural resources for our
society. Monitoring plants and measuring their traits is an important task in
agriculture often referred to as plant phenotyping. Traditionally, this task is
done manually, which is time- and labor-intensive. Robots can automate
phenotyping providing reproducible and high-frequency measurements. Today's
perception systems use deep learning to interpret these measurements, but
require a substantial amount of annotated data to work well. Obtaining such
labels is challenging as it often requires background knowledge on the side of
the labelers. This paper addresses the problem of reducing the labeling effort
required to perform leaf instance segmentation on 3D point clouds, which is a
first step toward phenotyping in 3D. Separating all leaves allows us to count
them and compute relevant traits as their areas, lengths, and widths. We
propose a novel self-supervised task-specific pre-training approach to
initialize the backbone of a network for leaf instance segmentation. We also
introduce a novel automatic postprocessing that considers the difficulty of
correctly segmenting the points close to the stem, where all the leaves petiole
overlap. The experiments presented in this paper suggest that our approach
boosts the performance over all the investigated scenarios. We also evaluate
the embeddings to assess the quality of the fully unsupervised approach and see
a higher performance of our domain-specific postprocessing.
Related papers
- GMT: Guided Mask Transformer for Leaf Instance Segmentation [14.458970589296554]
Leaf instance segmentation is a challenging task, aiming to separate and delineate each leaf in an image of a plant.
We propose Guided Mask (GMT), which contains three key components, namely Guided Positional Transformer (GPE), Guided Embedding Fusion Module (GEFM) and Guided Dynamic Positional Queries (GDPQ)
The proposed GMT consistently outperforms State-of-the-Art models on three public plant datasets.
arXiv Detail & Related papers (2024-06-24T19:52:27Z) - You Only Need One Thing One Click: Self-Training for Weakly Supervised
3D Scene Understanding [107.06117227661204]
We propose One Thing One Click'', meaning that the annotator only needs to label one point per object.
We iteratively conduct the training and label propagation, facilitated by a graph propagation module.
Our model can be compatible to 3D instance segmentation equipped with a point-clustering strategy.
arXiv Detail & Related papers (2023-03-26T13:57:00Z) - On Domain-Specific Pre-Training for Effective Semantic Perception in
Agricultural Robotics [30.966137924072097]
Agricultural robots aim to monitor fields and assess the plants as well as their growth stage in an automatic manner.
Semantic perception mostly relies on deep learning using supervised approaches.
In this paper, we look into the problem of reducing the amount of labels without compromising the final segmentation performance.
arXiv Detail & Related papers (2023-03-22T12:10:44Z) - Eff-3DPSeg: 3D organ-level plant shoot segmentation using
annotation-efficient point clouds [1.5882586857953638]
We propose a novel weakly supervised framework, Eff-3DPSeg, for 3D plant shoot segmentation.
High-resolution point clouds of soybean were reconstructed using a low-cost photogrammetry system.
A weakly-supervised deep learning method was proposed for plant organ segmentation.
arXiv Detail & Related papers (2022-12-20T14:09:37Z) - LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds [62.49198183539889]
We propose a label-efficient semantic segmentation pipeline for outdoor scenes with LiDAR point clouds.
Our method co-designs an efficient labeling process with semi/weakly supervised learning.
Our proposed method is even highly competitive compared to the fully supervised counterpart with 100% labels.
arXiv Detail & Related papers (2022-10-14T19:13:36Z) - Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf
Instance Segmentation in the Agricultural Domain [29.647846446064992]
Plant phenotyping is a central task in agriculture, as it describes plants' growth stage, development, and other relevant quantities.
In this paper, we address the problem of joint semantic, plant instance, and leaf instance segmentation of crop fields from RGB data.
We propose a single convolutional neural network that addresses the three tasks simultaneously, exploiting their underlying hierarchical structure.
arXiv Detail & Related papers (2022-10-14T15:01:08Z) - Collaborative Propagation on Multiple Instance Graphs for 3D Instance
Segmentation with Single-point Supervision [63.429704654271475]
We propose a novel weakly supervised method RWSeg that only requires labeling one object with one point.
With these sparse weak labels, we introduce a unified framework with two branches to propagate semantic and instance information.
Specifically, we propose a Cross-graph Competing Random Walks (CRW) algorithm that encourages competition among different instance graphs.
arXiv Detail & Related papers (2022-08-10T02:14:39Z) - An Effective Leaf Recognition Using Convolutional Neural Networks Based
Features [1.137457877869062]
In this paper, we propose an effective method for the leaf recognition problem.
A leaf goes through some pre-processing to extract its refined color image, vein image, xy-projection histogram, handcrafted shape, texture features, and Fourier descriptors.
These attributes are then transformed into a better representation by neural network-based encoders before a support vector machine (SVM) model is utilized to classify different leaves.
arXiv Detail & Related papers (2021-08-04T02:02:22Z) - One Thing One Click: A Self-Training Approach for Weakly Supervised 3D
Semantic Segmentation [78.36781565047656]
We propose "One Thing One Click," meaning that the annotator only needs to label one point per object.
We iteratively conduct the training and label propagation, facilitated by a graph propagation module.
Our results are also comparable to those of the fully supervised counterparts.
arXiv Detail & Related papers (2021-04-06T02:27:25Z) - Document Modeling with Graph Attention Networks for Multi-grained
Machine Reading Comprehension [127.3341842928421]
Natural Questions is a new challenging machine reading comprehension benchmark.
It has two-grained answers, which are a long answer (typically a paragraph) and a short answer (one or more entities inside the long answer)
Existing methods treat these two sub-tasks individually during training while ignoring their dependencies.
We present a novel multi-grained machine reading comprehension framework that focuses on modeling documents at their hierarchical nature.
arXiv Detail & Related papers (2020-05-12T14:20:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.