PointsToWood: A deep learning framework for complete canopy leaf-wood segmentation of TLS data across diverse European forests

• URL: http://arxiv.org/abs/2503.04420v1
• Date: Thu, 06 Mar 2025 13:23:03 GMT
• Title: PointsToWood: A deep learning framework for complete canopy leaf-wood segmentation of TLS data across diverse European forests
• Authors: Harry J. F. Owen, Matthew J. A. Allen, Stuart W. D. Grieve, Phill Wilkes, Emily R. Lines,
• Abstract summary: We show a new framework that uses a deep learning architecture newly developed from PointNet and point clouds for processing 3D point clouds.<n>We evaluate its performance across open datasets from boreal, temperate, Mediterranean and tropical regions.<n>Results show consistent outperformance against the most widely used PointNet based approach for leaf/wood segmentation.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Point clouds from Terrestrial Laser Scanning (TLS) are an increasingly popular source of data for studying plant structure and function but typically require extensive manual processing to extract ecologically important information. One key task is the accurate semantic segmentation of different plant material within point clouds, particularly wood and leaves, which is required to understand plant productivity, architecture and physiology. Existing automated semantic segmentation methods are primarily developed for single ecosystem types, and whilst they show good accuracy for biomass assessment from the trunk and large branches, often perform less well within the crown. In this study, we demonstrate a new framework that uses a deep learning architecture newly developed from PointNet and pointNEXT for processing 3D point clouds to provide a reliable semantic segmentation of wood and leaf in TLS point clouds from the tree base to branch tips, trained on data from diverse mature European forests. Our model uses meticulously labelled data combined with voxel-based sampling, neighbourhood rescaling, and a novel gated reflectance integration module embedded throughout the feature extraction layers. We evaluate its performance across open datasets from boreal, temperate, Mediterranean and tropical regions, encompassing diverse ecosystem types and sensor characteristics. Our results show consistent outperformance against the most widely used PointNet based approach for leaf/wood segmentation on our high-density TLS dataset collected across diverse mixed forest plots across all major biomes in Europe. We also find consistently strong performance tested on others open data from China, Eastern Cameroon, Germany and Finland, collected using both time-of-flight and phase-shift sensors, showcasing the transferability of our model to a wide range of ecosystems and sensors.

Related papers

• Structural and Statistical Texture Knowledge Distillation and Learning for Segmentation [70.15341084443236]
  We re-emphasize the low-level texture information in deep networks for semantic segmentation and related knowledge distillation tasks. We propose a novel Structural and Statistical Texture Knowledge Distillation (SSTKD) framework for semantic segmentation. Specifically, Contourlet Decomposition Module (CDM) is introduced to decompose the low-level features. Texture Intensity Equalization Module (TIEM) is designed to extract and enhance the statistical texture knowledge.
  arXiv  Detail & Related papers  (2025-03-11T04:49:25Z)
• Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point clouds [1.6633665061166945]
  This study proposes a fully unsupervised deep learning method for leaf-wood separation of high-density laser scanning point clouds.<n>GrowSP-ForMS achieved a mean accuracy of 84.3% and a mean intersection over union (mIoU) of 69.6% on our MS test set.
  arXiv  Detail & Related papers  (2025-02-10T07:58:49Z)
• Multi-modal classification of forest biodiversity potential from 2D orthophotos and 3D airborne laser scanning point clouds [47.679877727066206]
  This study investigates whether deep learning-based fusion of close-range sensing data from 2D orthophotos and 3D airborne laser scanning (ALS) point clouds can enhance biodiversity assessment.<n>We introduce the BioVista dataset, comprising 44.378 paired samples of orthophotos and ALS point clouds from temperate forests in Denmark.<n>Using deep neural networks (ResNet for orthophotos and PointResNet for ALS point clouds), we investigate each data modality's ability to assess forest biodiversity potential, achieving mean accuracies of 69.4% and 72.8%, respectively.
  arXiv  Detail & Related papers  (2025-01-03T09:42:25Z)
• SegmentAnyTree: A sensor and platform agnostic deep learning model for tree segmentation using laser scanning data [15.438892555484616]
  This research advances individual tree crown (ITC) segmentation in lidar data, using a deep learning model applicable to various laser scanning types. It addresses the challenge of transferability across different data characteristics in 3D forest scene analysis. The model, based on PointGroup architecture, is a 3D CNN with separate heads for semantic and instance segmentation.
  arXiv  Detail & Related papers  (2024-01-28T19:47:17Z)
• Automated forest inventory: analysis of high-density airborne LiDAR point clouds with 3D deep learning [16.071397465972893]
  ForAINet is able to perform a segmentation across diverse forest types and geographic regions. System has been tested on FOR-Instance, a dataset of point clouds that have been acquired in five different countries using surveying drones.
  arXiv  Detail & Related papers  (2023-12-22T21:54:35Z)
• FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoring [23.192593517094714]
  We present the first unified Forest Monitoring Benchmark (FoMo-Bench)<n>FoMo-Bench consists of 15 diverse datasets encompassing satellite, aerial, and inventory data.<n>To enhance task and geographic diversity in FoMo-Bench, we introduce TalloS, a global dataset combining satellite imagery with ground-based annotations for tree species classification.
  arXiv  Detail & Related papers  (2023-12-15T09:49:21Z)
• PointHPS: Cascaded 3D Human Pose and Shape Estimation from Point Clouds [99.60575439926963]
  We propose a principled framework, PointHPS, for accurate 3D HPS from point clouds captured in real-world settings. PointHPS iteratively refines point features through a cascaded architecture. Extensive experiments demonstrate that PointHPS, with its powerful point feature extraction and processing scheme, outperforms State-of-the-Art methods.
  arXiv  Detail & Related papers  (2023-08-28T11:10:14Z)
• Classification of Single Tree Decay Stages from Combined Airborne LiDAR Data and CIR Imagery [1.4589991363650008]
  This study, for the first time, automatically categorizing individual trees (Norway spruce) into five decay stages. Three different Machine Learning methods - 3D point cloud-based deep learning (KPConv), Convolutional Neural Network (CNN), and Random Forest (RF) All models achieved promising results, reaching overall accuracy (OA) of up to 88.8%, 88.4% and 85.9% for KPConv, CNN and RF, respectively.
  arXiv  Detail & Related papers  (2023-01-04T22:20:16Z)
• Neuroevolution-based Classifiers for Deforestation Detection in Tropical Forests [62.997667081978825]
  Millions of hectares of tropical forests are lost every year due to deforestation or degradation. Monitoring and deforestation detection programs are in use, in addition to public policies for the prevention and punishment of criminals. This paper proposes the use of pattern classifiers based on neuroevolution technique (NEAT) in tropical forest deforestation detection tasks.
  arXiv  Detail & Related papers  (2022-08-23T16:04:12Z)
• Multi-Layer Modeling of Dense Vegetation from Aerial LiDAR Scans [4.129847064263057]
  We release WildForest3D, which consists of 29 study plots and over 2000 individual trees across 47 000m2 with dense 3D annotation. We propose a 3D deep network architecture predicting for the first time both 3D point-wise labels and high-resolution occupancy meshes simultaneously.
  arXiv  Detail & Related papers  (2022-04-25T12:47:05Z)
• Learning Statistical Texture for Semantic Segmentation [53.7443670431132]
  We propose a novel Statistical Texture Learning Network (STLNet) for semantic segmentation. For the first time, STLNet analyzes the distribution of low level information and efficiently utilizes them for the task. Based on QCO, two modules are introduced: (1) Texture Enhance Module (TEM), to capture texture-related information and enhance the texture details; (2) Pyramid Texture Feature Extraction Module (PTFEM), to effectively extract the statistical texture features from multiple scales.
  arXiv  Detail & Related papers  (2021-03-06T15:05:35Z)
• Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene [76.4183572058063]
  We present a richly-annotated 3D point cloud dataset for multiple outdoor scene understanding tasks. The dataset has been point-wisely annotated with both hierarchical and instance-based labels. We formulate a hierarchical learning problem for 3D point cloud segmentation and propose a measurement evaluating consistency across various hierarchies.
  arXiv  Detail & Related papers  (2020-08-11T19:10:32Z)
• Two-View Fine-grained Classification of Plant Species [66.75915278733197]
  We propose a novel method based on a two-view leaf image representation and a hierarchical classification strategy for fine-grained recognition of plant species. A deep metric based on Siamese convolutional neural networks is used to reduce the dependence on a large number of training samples and make the method scalable to new plant species.
  arXiv  Detail & Related papers  (2020-05-18T21:57:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.