Statistical shape representations for temporal registration of plant components in 3D

• URL: http://arxiv.org/abs/2209.11526v2
• Date: Tue, 6 Jun 2023 20:17:36 GMT
• Title: Statistical shape representations for temporal registration of plant components in 3D
• Authors: Karoline Heiwolt, Cengiz \"Oztireli, Grzegorz Cielniak
• Abstract summary: We demonstrate how using shape features improves temporal organ matching. This is essential for robotic crop monitoring, which enables whole-of-lifecycle phenotyping.
• Score: 5.349852254138086
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Plants are dynamic organisms and understanding temporal variations in vegetation is an essential problem for robots in the wild. However, associating repeated 3D scans of plants across time is challenging. A key step in this process is re-identifying and tracking the same individual plant components over time. Previously, this has been achieved by comparing their global spatial or topological location. In this work, we demonstrate how using shape features improves temporal organ matching. We present a landmark-free shape compression algorithm, which allows for the extraction of 3D shape features of leaves, characterises leaf shape and curvature efficiently in few parameters, and makes the association of individual leaves in feature space possible. The approach combines 3D contour extraction and further compression using Principal Component Analysis (PCA) to produce a shape space encoding, which is entirely learned from data and retains information about edge contours and 3D curvature. Our evaluation on temporal scan sequences of tomato plants shows, that incorporating shape features improves temporal leaf-matching. A combination of shape, location, and rotation information proves most informative for recognition of leaves over time and yields a true positive rate of 75%, a 15% improvement on sate-of-the-art methods. This is essential for robotic crop monitoring, which enables whole-of-lifecycle phenotyping.

Related papers

• DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow [44.72037991063735]
  DetailGen3D is a generative approach specifically designed to enhance generated 3D shapes. Our key insight is to model the coarse-to-fine transformation directly through data-dependent flows in latent space. We introduce a token matching strategy that ensures accurate spatial correspondence during refinement.
  arXiv  Detail & Related papers  (2024-11-25T17:08:17Z)
• Living Scenes: Multi-object Relocalization and Reconstruction in Changing 3D Environments [20.890476387720483]
  MoRE is a novel approach for multi-object relocalization and reconstruction in evolving environments. We view these environments as "living scenes" and consider the problem of transforming scans taken at different points in time into a 3D reconstruction of the object instances.
  arXiv  Detail & Related papers  (2023-12-14T17:09:57Z)
• Neural Semantic Surface Maps [52.61017226479506]
  We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another. Our approach can generate semantic surface-to-surface maps, eliminating manual annotations or any 3D training data requirement.
  arXiv  Detail & Related papers  (2023-09-09T16:21:56Z)
• 3D Mitochondria Instance Segmentation with Spatio-Temporal Transformers [101.44668514239959]
  We propose a hybrid encoder-decoder framework that efficiently computes spatial and temporal attentions in parallel. We also introduce a semantic clutter-background adversarial loss during training that aids in the region of mitochondria instances from the background.
  arXiv  Detail & Related papers  (2023-03-21T17:58:49Z)
• Deep Active Latent Surfaces for Medical Geometries [51.82897666576424]
  Shape priors have long been known to be effective when reconstructing 3D shapes from noisy or incomplete data. In this paper, we advocate a hybrid approach representing shapes in terms of 3D meshes with a separate latent vector at each vertex. For inference, the latent vectors are updated independently while imposing spatial regularization constraints. We show that this gives us both flexibility and generalization capabilities, which we demonstrate on several medical image processing tasks.
  arXiv  Detail & Related papers  (2022-06-21T10:33:32Z)
• Scene Synthesis via Uncertainty-Driven Attribute Synchronization [52.31834816911887]
  This paper introduces a novel neural scene synthesis approach that can capture diverse feature patterns of 3D scenes. Our method combines the strength of both neural network-based and conventional scene synthesis approaches.
  arXiv  Detail & Related papers  (2021-08-30T19:45:07Z)
• Multi-Temporal Convolutions for Human Action Recognition in Videos [83.43682368129072]
  We present a novel temporal-temporal convolution block that is capable of extracting at multiple resolutions. The proposed blocks are lightweight and can be integrated into any 3D-CNN architecture.
  arXiv  Detail & Related papers  (2020-11-08T10:40:26Z)
• Deep Generative Modelling of Human Reach-and-Place Action [15.38392014421915]
  We suggest a deep generative model for human reach-and-place action conditioned on a start and end position. We have captured a dataset of 600 such human 3D actions, to sample the 2x3-D space of 3D source and targets. Our evaluation includes several ablations, analysis of generative diversity and applications.
  arXiv  Detail & Related papers  (2020-10-05T21:36:20Z)
• Learning Local Neighboring Structure for Robust 3D Shape Representation [143.15904669246697]
  Representation learning for 3D meshes is important in many computer vision and graphics applications. We propose a local structure-aware anisotropic convolutional operation (LSA-Conv) Our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-04-21T13:40:03Z)
• A new geodesic-based feature for characterization of 3D shapes: application to soft tissue organ temporal deformations [0.0]
  We show a direct application on a study of organ temporal deformations. We characterize the behavior of a bladder during a forced respiratory motion with a reduced number of 3D surface points. We demonstrate the robustness of our feature on both synthetic 3D shapes and realistic dynamic MRI data.
  arXiv  Detail & Related papers  (2020-03-18T16:56:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.