FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillation
- URL: http://arxiv.org/abs/2604.01766v1
- Date: Thu, 02 Apr 2026 08:33:55 GMT
- Title: FSKD: Monocular Forest Structure Inference via LiDAR-to-RGBI Knowledge Distillation
- Abstract summary: airborne LiDAR remains costly and infrequent despite being the reference for forest structure metrics like Canopy Height Model (CHM), Plant Area Index (PAI), and Foliage Height Diversity (FHD)<n>We propose FSKD: a LiDAR-to-RGB-Infrared (RGBI) knowledge distillation framework in which a multi-modal teacher fuses RGBI imagery with LiDAR-derived planar metrics and vertical profiles via cross-attention.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Very High Resolution (VHR) forest structure data at individual-tree scale is essential for carbon, biodiversity, and ecosystem monitoring. Still, airborne LiDAR remains costly and infrequent despite being the reference for forest structure metrics like Canopy Height Model (CHM), Plant Area Index (PAI), and Foliage Height Diversity (FHD). We propose FSKD: a LiDAR-to-RGB-Infrared (RGBI) knowledge distillation (KD) framework in which a multi-modal teacher fuses RGBI imagery with LiDAR-derived planar metrics and vertical profiles via cross-attention, and an RGBI-only SegFormer student learns to reproduce these outputs. Trained on 384 $km^2$ of forests in Saxony, Germany (20 cm ground sampling distance (GSD)) and evaluated on eight geographically distinct test tiles, the student achieves state-of-the-art (SOTA) zero-shot CHM performance (MedAE 4.17 m, $R^2$=0.51, IoU 0.87), outperforming HRCHM/DAC baselines by 29--46% in MAE (5.81 m vs. 8.14--10.84 m) with stronger correlation coefficients (0.713 vs. 0.166--0.652). Ablations show that multi-modal fusion improves performance by 10--26% over RGBI-only training, and that asymmetric distillation with appropriate model capacity is critical. The method jointly predicts CHM, PAI, and FHD, a multi-metric capability not provided by current monocular CHM estimators, although PAI/FHD transfer remains region-dependent and benefits from local calibration. The framework also remains effective under temporal mismatch (winter LiDAR, summer RGBI), removing strict co-acquisition constraints and enabling scalable 20 cm operational monitoring for workflows such as Digital Twin Germany and national Digital Orthophoto programs.
Related papers
- AgroVisNet: A lightweight Convolutional Network and the BD-PlantDX Expert-Validated Benchmark for Radish, Potato and Pointed Gourd Disease Classification [0.3686530147760243]
We propose AgroVisNet, a compact convolutional network trained from scratch, together with BD-PlantDX.<n>On BD-PlantDX the model attains 99.52% test accuracy and 99.52% weighted F1, exceeding all six ImageNet-pretrained lightweight backbones evaluated.<n>Exported for deployment, the model quantises to a 0.46 MB full-integer network at a 0.22 percentage-point accuracy cost and classifies an image in 8.40 ms on a single CPU.
arXiv Detail & Related papers (2026-09-09T17:12:17Z) - Transferable Above-Ground Biomass (AGB) Estimation Model from Multi-Sensor Data with Sparse Field Calibration [0.0]
This paper presents an operational framework centered on a single globally trained convolutional neural network (CNN)<n>The framework applies a small number of local field plots to fit a scale-and-bias correction that aligns the global prediction with ground truth in each region.<n>On held-out validation the global GEDI-based model achieved R2 approximately 0.78 and RMSE approximately 22 Mg/ha.
arXiv Detail & Related papers (2026-08-12T04:36:26Z) - Self-Supervised Tree-level Biomass Estimation in Urban Environments From Airborne LiDAR and Optical Observations [0.23301643766310368]
We present a crown-level above-ground biomass (AGB) framework for an 810km$2$ landscape in Ontario, Canada.<n>A dual-stream cross-attention network trained on rule-based pseudo-labels produced semantic marks for buildings, needleleaf trees, and deciduous trees.<n> estimates yielded total AGB stocks of 1.73Tg in 2018 and 1.81Tg in 2023 (811--850GgC), local densities up to $sim140$Mgha$-1$ along the Niagara Escarpment, and a
arXiv Detail & Related papers (2026-06-24T15:02:39Z) - CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation [50.353919095724315]
Few-step distillation for video diffusion models has attracted significant attention, driven by the urgent demand for efficient deployment in real-world scenarios.<n>We propose Copula-aware DMD (CoDMD), a lightweight relational regularizer that reuses score estimates already produced by the frozen teacher and the online fake model to construct pairwise relation matrices.<n>On the Wan-2.1-T2V model series at 1.3B & 14B scales, CoDMD distills 50-step teachers into 4-step students, achieving an approximate 25$times$ speed-up while attaining VBench scores of 84.46 & 84.87,
arXiv Detail & Related papers (2026-06-20T10:33:14Z) - Paired-CSLiDAR: Height-Stratified Registration for Cross-Source Aerial-Ground LiDAR Pose Refinement [46.13526676100776]
We introduce Paired-CSLiDAR, a cross-source aerial-ground LiDAR benchmark for single-scan pose refinement.<n>The benchmark contains 12,683 ground-aerial pairs across 6 evaluation sites.<n>We propose Residual-Guided Stratified Registration (RGSR), a training-free, geometry-only refinement pipeline.
arXiv Detail & Related papers (2026-05-01T13:14:20Z) - AgriPath: A Systematic Exploration of Architectural Trade-offs for Crop Disease Classification [45.52399819498234]
This work presents a systematic empirical comparison of three model paradigms for fine-grained crop disease classification.<n>We introduce AgriPath-LF16, a benchmark containing 111k images spanning 16 crops and 41 diseases.<n>CNNs achieve the highest accuracy on lab imagery but degrade under domain shift.<n> Contrastive VLMs provide a robust and parameter-efficient alternative with competitive cross-domain performance.
arXiv Detail & Related papers (2026-03-08T17:28:01Z) - Forest canopy height estimation from satellite RGB imagery using large-scale airborne LiDAR-derived training data and monocular depth estimation [2.3321503459324915]
Large-scale, high-resolution forest canopy height mapping plays a crucial role in understanding regional and global carbon and water cycles.<n>Near-surface LiDAR platforms offer much finer measurements of forest canopy structure.<n>State-of-the-art monocular depth estimation model, Depth Anything V2, was trained using 16,000 km2 of canopy height models.
arXiv Detail & Related papers (2026-02-06T08:53:32Z) - FORMSpoT: A Decade of Tree-Level, Country-Scale Forest Monitoring [40.631100826517375]
We introduce FORMSpoT (Forest Mapping with SPOT Time series), a decade-long (2014-2024) nationwide mapping of forest canopy height at 1.5 m resolution.<n>To enable robust change detection across heterogeneous acquisitions, we developed a dedicated post-processing pipeline.<n>In mountainous forests, where disturbances are small and spatially fragmented, FORMSpoT-$$ achieves an F1-score of 0.44, representing an order of magnitude higher than existing benchmarks.
arXiv Detail & Related papers (2025-12-18T19:35:09Z) - BOOD: Boundary-based Out-Of-Distribution Data Generation [47.47757472521503]
This paper proposes a novel framework called Boundary-based Out-Of-Distribution data generation (BOOD)<n>BOOD synthesizes high-quality OOD features and generates human-compatible outlier images using diffusion models.
arXiv Detail & Related papers (2025-08-01T06:34:27Z) - Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point clouds [1.6633665061166945]
This study proposes a fully unsupervised deep learning method for leaf-wood separation of high-density laser scanning point clouds.<n>GrowSP-ForMS achieved a mean accuracy of 84.3% and a mean intersection over union (mIoU) of 69.6% on our MS test set.
arXiv Detail & Related papers (2025-02-10T07:58:49Z) - Multimodal classification of forest biodiversity potential from 2D orthophotos and 3D airborne laser scanning point clouds [47.679877727066206]
Assessment of forest biodiversity is crucial for ecosystem management and conservation.<n>Deep learning-based fusion of close-range sensing data from 2D orthophotos and 3D airborne laser scanning (ALS) point clouds can reliable assess the biodiversity potential of forests.<n>BioVista dataset comprises 44 378 paired samples of orthophotos and ALS point clouds from temperate forests in Denmark.
arXiv Detail & Related papers (2025-01-03T09:42:25Z) - SMILE-UHURA Challenge -- Small Vessel Segmentation at Mesoscopic Scale from Ultra-High Resolution 7T Magnetic Resonance Angiograms [60.35639972035727]
The lack of publicly available annotated datasets has impeded the development of robust, machine learning-driven segmentation algorithms.
The SMILE-UHURA challenge addresses the gap in publicly available annotated datasets by providing an annotated dataset of Time-of-Flight angiography acquired with 7T MRI.
Dice scores reached up to 0.838 $pm$ 0.066 and 0.716 $pm$ 0.125 on the respective datasets, with an average performance of up to 0.804 $pm$ 0.15.
arXiv Detail & Related papers (2024-11-14T17:06:00Z) - Unified Deep Learning Model for Global Prediction of Aboveground Biomass, Canopy Height and Cover from High-Resolution, Multi-Sensor Satellite Imagery [0.196629787330046]
We present a new methodology which uses multi-sensor, multi-spectral imagery of 10 meters and a deep learning based model which unifies the prediction of above ground biomass density (AGBD), canopy height (CH), canopy cover (CC)<n>The model is trained on millions of globally sampled GEDI-L2/L4 measurements. We validate the capability of our model by deploying it over the entire globe for the year 2023 as well as annually from 2016 to 2023 over selected areas.
arXiv Detail & Related papers (2024-08-20T23:15:41Z) - Information fusion approach for biomass estimation in a plateau
mountainous forest using a synergistic system comprising UAS-based digital
camera and LiDAR [9.944631732226657]
The objective of this study was to quantify the aboveground biomass (AGB) of a plateau mountainous forest reserve.
We utilized digital aerial photogrammetry (DAP), which has the unique advantages of speed, high spatial resolution, and low cost.
Based on the CHM and spectral attributes obtained from multispectral images, we estimated and mapped the AGB of the region of interest with considerable cost efficiency.
arXiv Detail & Related papers (2022-04-14T04:04:59Z) - Country-wide Retrieval of Forest Structure From Optical and SAR
Satellite Imagery With Bayesian Deep Learning [74.94436509364554]
We propose a Bayesian deep learning approach to densely estimate forest structure variables at country-scale with 10-meter resolution.
Our method jointly transforms Sentinel-2 optical images and Sentinel-1 synthetic aperture radar images into maps of five different forest structure variables.
We train and test our model on reference data from 41 airborne laser scanning missions across Norway.
arXiv Detail & Related papers (2021-11-25T16:21:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.