Multimodal Plant Root Phenotyping with Integration of 3D Skeleton Extraction and Language Analysis

• URL: http://arxiv.org/abs/2608.03109v1
• Date: Tue, 04 Aug 2026 04:30:04 GMT
• Title: Multimodal Plant Root Phenotyping with Integration of 3D Skeleton Extraction and Language Analysis
• Abstract summary: Plant root phenotyping is fundamental to understanding below-ground structures, optimizing crop management, and improving agricultural sustainability.<n>This paper presents a multimodal robotic AI framework that integrates 3D skeleton extraction with language-guided reasoning for interpretable and data-efficient root analysis.
• Score: 23.808424925425243
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Plant root phenotyping is fundamental to understanding below-ground structures, optimizing crop management, and improving agricultural sustainability. This paper presents a multimodal robotic AI framework that integrates 3D skeleton extraction with language-guided reasoning for interpretable and data-efficient root analysis. We develop an unsupervised skeleton extraction network based on Weighted Laplacian Contraction (W-LBC) to generate high-fidelity structural representations from dense point clouds captured by robotic 3D sensing platforms. Quantitative morphological descriptors, including root count, length, branching angle, and density, are computed from the reconstructed skeleton graph to capture geometric and topological characteristics. Building on these features, we introduce an Evidence-First language modeling framework that fine-tunes GPT as an interactive analytical chatbot using automatically generated instruction--response pairs. Each training sample provides measurable evidence before natural-language reasoning, enabling the model to ground interpretation in quantitative morphology. Through supervised fine-tuning, GPT associates numerical structure with semantic meaning, producing biologically consistent explanations of growth patterns and adaptive traits. Experiments show that the structure-guided framework achieves robust, interpretable reasoning across 12 plant species with diverse root architectures. By integrating unsupervised 3D geometric perception with large-scale language understanding, our approach bridges quantitative analysis and semantic interpretation, establishing a unified paradigm for explainable robotic plant root phenotyping.

Related papers

• A Persistent Homology Design Space for 3D Point Cloud Deep Learning [5.810033007426438]
  Persistent Homology (PH) offers stable, multi-scale descriptors of intrinsic shape structure.<n>Despite strong theoretical guarantees and increasing empirical adoption, its integration into deep learning for point clouds remains largely ad hoc and architecturally peripheral.<n>In this work, we introduce a unified design space for Persistent-Homology driven learning in 3D point clouds.
  arXiv  Detail & Related papers  (2026-04-05T22:38:37Z)
• CAPSUL: A Comprehensive Human Protein Benchmark for Subcellular Localization [50.559485139565076]
  We introduce a new benchmark called $mathbfCAPSUL$, a dataset that integrates diverse 3D structural representations with fine-grained subcellular localization annotations.<n>We evaluate this benchmark using a variety of state-of-the-art sequence-based and structure-based models, showcasing the importance of involving structural features in this task.<n> Lastly, we showcase the powerful interpretability of structure-based methods through a case study on the Golgi apparatus.
  arXiv  Detail & Related papers  (2026-03-19T07:33:04Z)
• SGR3 Model: Scene Graph Retrieval-Reasoning Model in 3D [51.32219731589742]
  3D scene graphs provide a structured representation of object entities and their relationships.<n>Existing approaches for 3D scene graph generation typically combine scene reconstruction with graph neural networks (GNNs)<n>In this work, we introduce a Scene Graph Retrieval-Reasoning Model in 3D (SGR3 Model)
  arXiv  Detail & Related papers  (2026-03-04T21:19:54Z)
• Multi-Agent Procedural Graph Extraction with Structural and Logical Refinement [66.51979814832332]
  model formulates procedural graph extraction as a multi-round reasoning process with dedicated structural and logical refinement.<n>Experiments demonstrate that model achieves substantial improvements in both structural correctness and logical consistency over strong baselines.
  arXiv  Detail & Related papers  (2026-01-27T04:00:48Z)
• FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applications [13.923496304391044]
  We present FloraForge, an LLM-assisted framework that enables domain experts to generate biologically accurate, fully parametric 3D plant models.<n>Our framework leverages LLM-enabled co-design to refine Python scripts that generate parameterized plant as hierarchical B-spline surface representations.<n>We demonstrate the framework on maize, soybean, and mung bean, fitting procedural models to empirical point cloud data.
  arXiv  Detail & Related papers  (2025-12-11T23:28:25Z)
• Image-based Morphological Characterization of Filamentous Biological Structures with Non-constant Curvature Shape Feature [2.099922236065961]
  We propose an image-based method by which it is possible to analyze shape changes over time in tendrils when mechano-stimulated in different portions of their body.<n>We employ a geometric approach using a 3D Piece-Wise Clothoid-based model to reconstruct the configuration taken by a tendril after mechanical rubbing.<n>Our analysis reveals higher responsiveness in the apical segment of tendrils, which might correspond to higher sensitivity and tissue flexibility in that region of the organs.
  arXiv  Detail & Related papers  (2025-11-09T04:54:16Z)
• Hierarchical Neural Semantic Representation for 3D Semantic Correspondence [72.8101601086805]
  We design the hierarchical neural semantic representation (HNSR), which consists of a global semantic feature to capture high-level structure and multi-resolution local geometric features.<n>Second, we design a progressive global-to-local matching strategy, which establishes coarse semantic correspondence using the global semantic feature.<n>Third, our framework is training-free and broadly compatible with various pre-trained 3D generative backbones, demonstrating strong generalization across diverse shape categories.
  arXiv  Detail & Related papers  (2025-09-22T07:23:07Z)
• Learning to Infer Parameterized Representations of Plants from 3D Scans [2.6774002558989705]
  We train a neural network with virtual plants generated using an L-systems-based procedural model.<n>After training, the network allows to infer a parametric tree-like representation based on an input 3D point cloud.<n>We evaluate our approach on Chenopodium Album plants, using experiments on synthetic plants to show that our unified framework allows for different tasks.
  arXiv  Detail & Related papers  (2025-05-28T13:23:48Z)
• Large Spatial Model: End-to-end Unposed Images to Semantic 3D [79.94479633598102]
  Large Spatial Model (LSM) processes unposed RGB images directly into semantic radiance fields. LSM simultaneously estimates geometry, appearance, and semantics in a single feed-forward operation. It can generate versatile label maps by interacting with language at novel viewpoints.
  arXiv  Detail & Related papers  (2024-10-24T17:54:42Z)
• Explaining Text Similarity in Transformer Models [52.571158418102584]
  Recent advances in explainable AI have made it possible to mitigate limitations by leveraging improved explanations for Transformers. We use BiLRP, an extension developed for computing second-order explanations in bilinear similarity models, to investigate which feature interactions drive similarity in NLP models. Our findings contribute to a deeper understanding of different semantic similarity tasks and models, highlighting how novel explainable AI methods enable in-depth analyses and corpus-level insights.
  arXiv  Detail & Related papers  (2024-05-10T17:11:31Z)
• Elastic Shape Analysis of Tree-like 3D Objects using Extended SRVF Representation [18.728209940066055]
  We develop a framework for representing, comparing, and computing geodesic deformations between the shapes of such tree-like 3D objects. A hierarchical organization of subtrees characterizes these objects. We then define a new metric that quantifies the bending, stretching, and branch sliding needed to deform one tree-shaped object into the other.
  arXiv  Detail & Related papers  (2021-10-17T00:59:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.