PlantPose: Universal Plant Skeleton Estimation via Tree-constrained Graph Generation
- URL: http://arxiv.org/abs/2605.17773v1
- Date: Mon, 18 May 2026 02:46:36 GMT
- Title: PlantPose: Universal Plant Skeleton Estimation via Tree-constrained Graph Generation
- Abstract summary: We introduce PlantPose, a universal plant skeleton estimator via tree-constrained graph generation.<n>PlantPose combines learning-based graph generation with traditional graph algorithms to enforce tree constraints during the training loop.<n>Our approach demonstrates robust and accurate plant skeleton estimation across multiple domains.
- Score: 16.241282394201225
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurate estimation of plant skeletal structures (e.g., branching structures) from images is essential for smart agriculture and plant science. Unlike human skeletons with fixed topology, plant skeleton estimation presents a unique challenge, i.e., estimating arbitrary tree graphs from images. To address this problem, we introduce PlantPose, a universal plant skeleton estimator via tree-constrained graph generation. PlantPose combines learning-based graph generation with traditional graph algorithms to enforce tree constraints during the training loop. To enhance the model's generalization capability, we curate a large and diverse dataset comprising real-world and synthetic plant images, along with simplified representations (e.g., sketches and abstract drawings). This dataset enables the generalized model to adapt to diverse input styles and categories of plant images while preserving topological consistency. Our approach demonstrates robust and accurate plant skeleton estimation across multiple domains, including previously unseen out-of-domain scenarios. Further analyses highlight the method's strengths and limitations in handling complex, heterogeneous data distributions. All implementations and datasets are available at https://github.com/huntorochi/PlantPose/.
Related papers
- Zero-shot Hierarchical Plant Segmentation via Foundation Segmentation Models and Text-to-image Attention [19.2882360692347]
Foundation segmentation models achieve reasonable leaf instance extraction from top-view crop images without training.<n>We introduce ZeroPlantSeg, a zero-shot segmentation for rosette-shaped plant individuals from top-view images.
arXiv Detail & Related papers (2025-09-11T02:53:58Z) - Learning to Infer Parameterized Representations of Plants from 3D Scans [2.6774002558989705]
We train a neural network with virtual plants generated using an L-systems-based procedural model.<n>After training, the network allows to infer a parametric tree-like representation based on an input 3D point cloud.<n>We evaluate our approach on Chenopodium Album plants, using experiments on synthetic plants to show that our unified framework allows for different tasks.
arXiv Detail & Related papers (2025-05-28T13:23:48Z) - From GNNs to Trees: Multi-Granular Interpretability for Graph Neural Networks [29.032055397116217]
Interpretable Graph Neural Networks (GNNs) aim to reveal the underlying reasoning behind model predictions.<n>Existing subgraph-based interpretable methods suffer from an overemphasis on local structure.<n>We introduce a novel Tree-like Interpretable Framework (TIF) for graph classification.
arXiv Detail & Related papers (2025-05-01T07:22:51Z) - A Graph-Based Framework for Interpretable Whole Slide Image Analysis [86.37618055724441]
We develop a framework that transforms whole-slide images into biologically-informed graph representations.<n>Our approach builds graph nodes from tissue regions that respect natural structures, not arbitrary grids.<n>We demonstrate strong performance on challenging cancer staging and survival prediction tasks.
arXiv Detail & Related papers (2025-03-14T20:15:04Z) - TreeFormer: Single-view Plant Skeleton Estimation via Tree-constrained Graph Generation [13.507708659476064]
We present TreeFormer, a plant skeleton estimator via tree-constrained graph generation.
Our approach combines learning-based graph generation with traditional graph algorithms to impose the constraints during the training loop.
Experiments show that our method accurately estimates target plant skeletal structures for multiple domains.
arXiv Detail & Related papers (2024-11-25T06:43:20Z) - Improving embedding of graphs with missing data by soft manifolds [51.425411400683565]
The reliability of graph embeddings depends on how much the geometry of the continuous space matches the graph structure.
We introduce a new class of manifold, named soft manifold, that can solve this situation.
Using soft manifold for graph embedding, we can provide continuous spaces to pursue any task in data analysis over complex datasets.
arXiv Detail & Related papers (2023-11-29T12:48:33Z) - Improving Data Efficiency for Plant Cover Prediction with Label
Interpolation and Monte-Carlo Cropping [7.993547048820065]
The plant community composition is an essential indicator of environmental changes and is usually analyzed in ecological field studies.
We introduce an approach to interpolate the sparse labels in the collected vegetation plot time series down to the intermediate dense and unlabeled images.
We also introduce a new method we call Monte-Carlo Cropping to deal with high-resolution images efficiently.
arXiv Detail & Related papers (2023-07-17T15:17:39Z) - GraphGLOW: Universal and Generalizable Structure Learning for Graph
Neural Networks [72.01829954658889]
This paper introduces the mathematical definition of this novel problem setting.
We devise a general framework that coordinates a single graph-shared structure learner and multiple graph-specific GNNs.
The well-trained structure learner can directly produce adaptive structures for unseen target graphs without any fine-tuning.
arXiv Detail & Related papers (2023-06-20T03:33:22Z) - TranSG: Transformer-Based Skeleton Graph Prototype Contrastive Learning
with Structure-Trajectory Prompted Reconstruction for Person
Re-Identification [63.903237777588316]
Person re-identification (re-ID) via 3D skeleton data is an emerging topic with prominent advantages.
Existing methods usually design skeleton descriptors with raw body joints or perform skeleton sequence representation learning.
We propose a generic Transformer-based Skeleton Graph prototype contrastive learning (TranSG) approach with structure-trajectory prompted reconstruction.
arXiv Detail & Related papers (2023-03-13T02:27:45Z) - GrannGAN: Graph annotation generative adversarial networks [72.66289932625742]
We consider the problem of modelling high-dimensional distributions and generating new examples of data with complex relational feature structure coherent with a graph skeleton.
The model we propose tackles the problem of generating the data features constrained by the specific graph structure of each data point by splitting the task into two phases.
In the first it models the distribution of features associated with the nodes of the given graph, in the second it complements the edge features conditionally on the node features.
arXiv Detail & Related papers (2022-12-01T11:49:07Z) - Two-View Fine-grained Classification of Plant Species [66.75915278733197]
We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species.
A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
arXiv Detail & Related papers (2020-05-18T21:57:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.