Learning to Infer Parameterized Representations of Plants from 3D Scans

• URL: http://arxiv.org/abs/2505.22337v1
• Date: Wed, 28 May 2025 13:23:48 GMT
• Title: Learning to Infer Parameterized Representations of Plants from 3D Scans
• Authors: Samara Ghrer, Christophe Godin, Stefanie Wuhrer,
• Abstract summary: We train a neural network with virtual plants generated using an L-systems-based procedural model.<n>After training, the network allows to infer a parametric tree-like representation based on an input 3D point cloud.<n>We evaluate our approach on Chenopodium Album plants, using experiments on synthetic plants to show that our unified framework allows for different tasks.
• Score: 2.6774002558989705
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reconstructing faithfully the 3D architecture of plants from unstructured observations is a challenging task. Plants frequently contain numerous organs, organized in branching systems in more or less complex spatial networks, leading to specific computational issues due to self-occlusion or spatial proximity between organs. Existing works either consider inverse modeling where the aim is to recover the procedural rules that allow to simulate virtual plants, or focus on specific tasks such as segmentation or skeletonization. We propose a unified approach that, given a 3D scan of a plant, allows to infer a parameterized representation of the plant. This representation describes the plant's branching structure, contains parametric information for each plant organ, and can therefore be used directly in a variety of tasks. In this data-driven approach, we train a recursive neural network with virtual plants generated using an L-systems-based procedural model. After training, the network allows to infer a parametric tree-like representation based on an input 3D point cloud. Our method is applicable to any plant that can be represented as binary axial tree. We evaluate our approach on Chenopodium Album plants, using experiments on synthetic plants to show that our unified framework allows for different tasks including reconstruction, segmentation and skeletonization, while achieving results on-par with state-of-the-art for each task.

Related papers

• FlexPara: Flexible Neural Surface Parameterization [71.65203972602673]
  This paper introduces FlexPara, an unsupervised neural optimization framework to achieve both global and multi-chart surface parameterizations.<n>We ingeniously design and combine a series of geometrically-interpretable sub-networks, with specific functionalities, to construct a bi-directional cycle mapping framework for global parameterization.<n>Experiments demonstrate the universality, superiority, and inspiring potential of our neural surface parameterization paradigm.
  arXiv  Detail & Related papers  (2025-04-27T12:30:08Z)
• CropCraft: Inverse Procedural Modeling for 3D Reconstruction of Crop Plants [16.558411700996746]
  We present a novel method for 3D reconstruction of agricultural crops based on optimizing a model of plant morphology via inverse procedural modeling. We validate our method on a dataset of real images of agricultural fields, and demonstrate that the reconstructions can be used for a variety of monitoring and simulation applications.
  arXiv  Detail & Related papers  (2024-11-14T18:58:02Z)
• Large Spatial Model: End-to-end Unposed Images to Semantic 3D [79.94479633598102]
  Large Spatial Model (LSM) processes unposed RGB images directly into semantic radiance fields. LSM simultaneously estimates geometry, appearance, and semantics in a single feed-forward operation. It can generate versatile label maps by interacting with language at novel viewpoints.
  arXiv  Detail & Related papers  (2024-10-24T17:54:42Z)
• Pairwise-Constrained Implicit Functions for 3D Human Heart Modelling [60.56741715207466]
  We introduce a pairwise-constrained SDF approach that models the heart as a set of interdependent SDFs.<n>Our method significantly improves inner structure accuracy over single-SDF, UDF-based, voxel-based, and segmentation-based reconstructions.
  arXiv  Detail & Related papers  (2023-07-16T10:07:15Z)
• CherryPicker: Semantic Skeletonization and Topological Reconstruction of Cherry Trees [3.8697834534260447]
  We present CherryPicker, an automatic pipeline that reconstructs photo-metric point clouds of trees. Our system combines several state-of-the-art algorithms to enable automatic processing for further usage in 3D-plant phenotyping applications.
  arXiv  Detail & Related papers  (2023-04-10T16:54:05Z)
• Using t-distributed stochastic neighbor embedding for visualization and segmentation of 3D point clouds of plants [0.0]
  t-SNE is proposed to embed 3D point clouds of plants into 2D space for plant characterization. The perplexity parameter of t-SNE allows 2D rendering of plant structures at various organizational levels.
  arXiv  Detail & Related papers  (2023-02-07T12:55:15Z)
• Hierarchical Approach for Joint Semantic, Plant Instance, and Leaf Instance Segmentation in the Agricultural Domain [29.647846446064992]
  Plant phenotyping is a central task in agriculture, as it describes plants' growth stage, development, and other relevant quantities. In this paper, we address the problem of joint semantic, plant instance, and leaf instance segmentation of crop fields from RGB data. We propose a single convolutional neural network that addresses the three tasks simultaneously, exploiting their underlying hierarchical structure.
  arXiv  Detail & Related papers  (2022-10-14T15:01:08Z)
• Statistical shape representations for temporal registration of plant components in 3D [5.349852254138086]
  We demonstrate how using shape features improves temporal organ matching. This is essential for robotic crop monitoring, which enables whole-of-lifecycle phenotyping.
  arXiv  Detail & Related papers  (2022-09-23T11:11:10Z)
• A unified 3D framework for Organs at Risk Localization and Segmentation for Radiation Therapy Planning [56.52933974838905]
  Current medical workflow requires manual delineation of organs-at-risk (OAR) In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation. Our proposed framework fully enables the exploitation of 3D context information inherent in medical imaging.
  arXiv  Detail & Related papers  (2022-03-01T17:08:41Z)
• Scene Synthesis via Uncertainty-Driven Attribute Synchronization [52.31834816911887]
  This paper introduces a novel neural scene synthesis approach that can capture diverse feature patterns of 3D scenes. Our method combines the strength of both neural network-based and conventional scene synthesis approaches.
  arXiv  Detail & Related papers  (2021-08-30T19:45:07Z)
• Object-Centric Multi-View Aggregation [86.94544275235454]
  We present an approach for aggregating a sparse set of views of an object in order to compute a semi-implicit 3D representation in the form of a volumetric feature grid. Key to our approach is an object-centric canonical 3D coordinate system into which views can be lifted, without explicit camera pose estimation. We show that computing a symmetry-aware mapping from pixels to the canonical coordinate system allows us to better propagate information to unseen regions.
  arXiv  Detail & Related papers  (2020-07-20T17:38:31Z)
• From Planes to Corners: Multi-Purpose Primitive Detection in Unorganized 3D Point Clouds [59.98665358527686]
  We propose a new method for segmentation-free joint estimation of orthogonal planes. Such unified scene exploration allows for multitudes of applications such as semantic plane detection or local and global scan alignment. Our experiments demonstrate the validity of our approach in numerous scenarios from wall detection to 6D tracking.
  arXiv  Detail & Related papers  (2020-01-21T06:51:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.