OmniPlantSeg: Species Agnostic 3D Point Cloud Organ Segmentation for High-Resolution Plant Phenotyping Across Modalities

• URL: http://arxiv.org/abs/2509.21038v1
• Date: Thu, 25 Sep 2025 11:45:14 GMT
• Title: OmniPlantSeg: Species Agnostic 3D Point Cloud Organ Segmentation for High-Resolution Plant Phenotyping Across Modalities
• Authors: Andreas Gilson, Lukas Meyer, Oliver Scholz, Ute Schmid,
• Abstract summary: It is common to use extensive pre-processing and down-sample the plant point clouds to meet hardware or neural network input size requirements.<n>We propose a simple, yet effective algorithm KDSS for sub-sampling of biological point clouds that is agnostic to sensor data and plant species.
• Score: 4.770378899761483
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate point cloud segmentation for plant organs is crucial for 3D plant phenotyping. Existing solutions are designed problem-specific with a focus on certain plant species or specified sensor-modalities for data acquisition. Furthermore, it is common to use extensive pre-processing and down-sample the plant point clouds to meet hardware or neural network input size requirements. We propose a simple, yet effective algorithm KDSS for sub-sampling of biological point clouds that is agnostic to sensor data and plant species. The main benefit of this approach is that we do not need to down-sample our input data and thus, enable segmentation of the full-resolution point cloud. Combining KD-SS with current state-of-the-art segmentation models shows satisfying results evaluated on different modalities such as photogrammetry, laser triangulation and LiDAR for various plant species. We propose KD-SS as lightweight resolution-retaining alternative to intensive pre-processing and down-sampling methods for plant organ segmentation regardless of used species and sensor modality.

Related papers

• Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap [9.655034225644847]
  Plant phenotyping provides valuable insights into plant environment interactions and genetic evolution.<n>Despite progress in general 3D computer vision domains, the adoption of 3D segmentation for plant phenotyping remains limited by three major challenges.<n>This study bridges the gap between algorithmic advances and practical deployment.
  arXiv  Detail & Related papers  (2025-09-08T04:21:27Z)
• Adaptive Point-Prompt Tuning: Fine-Tuning Heterogeneous Foundation Models for 3D Point Cloud Analysis [51.37795317716487]
  We propose the Adaptive Point-Prompt Tuning (APPT) method, which fine-tunes pre-trained models with a modest number of parameters.<n>We convert raw point clouds into point embeddings by aggregating local geometry to capture spatial features followed by linear layers.<n>To calibrate self-attention across source domains of any modality to 3D, we introduce a prompt generator that shares weights with the point embedding module.
  arXiv  Detail & Related papers  (2025-08-30T06:02:21Z)
• PlantSegNeRF: A few-shot, cross-dataset method for plant 3D instance point cloud reconstruction via joint-channel NeRF with multi-view image instance matching [6.041945288896862]
  We propose a novel approach called plant segmentation neural radiance fields (PlantSegNeRF) to generate high-precision instance point clouds.<n>PlantSegNeRF performed 2D instance segmentation on the multi-view images to generate instance masks for each organ with a corresponding ID.<n>It achieved average improvements of 11.7%, 38.2%, 32.2% and 25.3% in mPrec, mRec, mCov, mWCov, respectively.
  arXiv  Detail & Related papers  (2025-07-01T01:59:59Z)
• Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimation [66.3814684757376]
  This work presents Zero123-6D, the first work to demonstrate the utility of Diffusion Model-based novel-view-synthesizers in enhancing RGB 6D pose estimation at category-level. The outlined method shows reduction in data requirements, removal of the necessity of depth information in zero-shot category-level 6D pose estimation task, and increased performance, quantitatively demonstrated through experiments on the CO3D dataset.
  arXiv  Detail & Related papers  (2024-03-21T10:38:18Z)
• PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Clouds [99.60575439926963]
  We propose a principled framework, PointHPS, for accurate 3D HPS from point clouds captured in real-world settings. PointHPS iteratively refines point features through a cascaded architecture. Extensive experiments demonstrate that PointHPS, with its powerful point feature extraction and processing scheme, outperforms State-of-the-Art methods.
  arXiv  Detail & Related papers  (2023-08-28T11:10:14Z)
• Eff-3DPSeg: 3D organ-level plant shoot segmentation using annotation-efficient point clouds [1.5882586857953638]
  We propose a novel weakly supervised framework, Eff-3DPSeg, for 3D plant shoot segmentation. High-resolution point clouds of soybean were reconstructed using a low-cost photogrammetry system. A weakly-supervised deep learning method was proposed for plant organ segmentation.
  arXiv  Detail & Related papers  (2022-12-20T14:09:37Z)
• AGO-Net: Association-Guided 3D Point Cloud Object Detection Network [86.10213302724085]
  We propose a novel 3D detection framework that associates intact features for objects via domain adaptation. We achieve new state-of-the-art performance on the KITTI 3D detection benchmark in both accuracy and speed.
  arXiv  Detail & Related papers  (2022-08-24T16:54:38Z)
• PST: Plant segmentation transformer for 3D point clouds of rapeseed plants at the podding stage [5.010317705589445]
  deep learning network plant segmentation transformer (PST) PST is composed of: (i) a dynamic voxel feature encoder (DVFE) to aggregate the point features with the raw spatial resolution; (ii) a dual window sets attention blocks to capture contextual information; and (iii) a dense feature propagation module to obtain the final dense point feature map. Results: PST and PST-PointGroup (PG) achieved superior performance in semantic and instance segmentation tasks.
  arXiv  Detail & Related papers  (2022-06-27T06:56:48Z)
• PointIso: Point Cloud Based Deep Learning Model for Detecting Arbitrary-Precision Peptide Features in LC-MS Map through Attention Based Segmentation [5.495506445661776]
  PointIso is a point cloud based, arbitrary-precision deep learning network to address the problem of peptide feature detection. It achieves 98% detection of high quality MS/MS identifications in a benchmark dataset.
  arXiv  Detail & Related papers  (2020-09-15T17:34:14Z)
• InfoFocus: 3D Object Detection for Autonomous Driving with Dynamic Information Modeling [65.47126868838836]
  We propose a novel 3D object detection framework with dynamic information modeling. Coarse predictions are generated in the first stage via a voxel-based region proposal network. Experiments are conducted on the large-scale nuScenes 3D detection benchmark.
  arXiv  Detail & Related papers  (2020-07-16T18:27:08Z)
• Two-View Fine-grained Classification of Plant Species [66.75915278733197]
  We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
  arXiv  Detail & Related papers  (2020-05-18T21:57:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.