NeRF-Accelerated Ecological Monitoring in Mixed-Evergreen Redwood Forest

• URL: http://arxiv.org/abs/2410.07418v2
• Date: Fri, 11 Oct 2024 03:33:58 GMT
• Title: NeRF-Accelerated Ecological Monitoring in Mixed-Evergreen Redwood Forest
• Authors: Adam Korycki, Cory Yeaton, Gregory S. Gilbert, Colleen Josephson, Steve McGuire,
• Abstract summary: We present a comparison of MLS and NeRF forest reconstructions for the purpose of trunk diameter estimation in a mixed-evergreen Redwood forest. We propose an improved DBH-estimation method using convex-hull modeling.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Forest mapping provides critical observational data needed to understand the dynamics of forest environments. Notably, tree diameter at breast height (DBH) is a metric used to estimate forest biomass and carbon dioxide sequestration. Manual methods of forest mapping are labor intensive and time consuming, a bottleneck for large-scale mapping efforts. Automated mapping relies on acquiring dense forest reconstructions, typically in the form of point clouds. Terrestrial laser scanning (TLS) and mobile laser scanning (MLS) generate point clouds using expensive LiDAR sensing, and have been used successfully to estimate tree diameter. Neural radiance fields (NeRFs) are an emergent technology enabling photorealistic, vision-based reconstruction by training a neural network on a sparse set of input views. In this paper, we present a comparison of MLS and NeRF forest reconstructions for the purpose of trunk diameter estimation in a mixed-evergreen Redwood forest. In addition, we propose an improved DBH-estimation method using convex-hull modeling. Using this approach, we achieved 1.68 cm RMSE, which consistently outperformed standard cylinder modeling approaches. Our code contributions and forest datasets are freely available at https://github.com/harelab-ucsc/RedwoodNeRF.

Related papers

• Comparative Analysis of Novel View Synthesis and Photogrammetry for 3D Forest Stand Reconstruction and extraction of individual tree parameters [2.153174198957389]
  Photogrammetry is commonly used for reconstructing forest scenes but faces challenges like low efficiency and poor quality. NeRF, while better for canopy regions, may produce errors in ground areas with limited views. 3DGS method generates sparser point clouds, particularly in trunk areas, affecting diameter at breast height (DBH) accuracy.
  arXiv  Detail & Related papers  (2024-10-08T07:53:21Z)
• Forecasting with Hyper-Trees [50.72190208487953]
  Hyper-Trees are designed to learn the parameters of time series models. By relating the parameters of a target time series model to features, Hyper-Trees also address the issue of parameter non-stationarity. In this novel approach, the trees first generate informative representations from the input features, which a shallow network then maps to the target model parameters.
  arXiv  Detail & Related papers  (2024-05-13T15:22:15Z)
• Vision Transformers, a new approach for high-resolution and large-scale mapping of canopy heights [50.52704854147297]
  We present a new vision transformer (ViT) model optimized with a classification (discrete) and a continuous loss function. This model achieves better accuracy than previously used convolutional based approaches (ConvNets) optimized with only a continuous loss function.
  arXiv  Detail & Related papers  (2023-04-22T22:39:03Z)
• Very high resolution canopy height maps from RGB imagery using self-supervised vision transformer and convolutional decoder trained on Aerial Lidar [14.07306593230776]
  This paper presents the first high-resolution canopy height map concurrently produced for multiple sub-national jurisdictions. The maps are generated by the extraction of features from a self-supervised model trained on Maxar imagery from 2017 to 2020. We also introduce a post-processing step using a convolutional network trained on GEDI observations.
  arXiv  Detail & Related papers  (2023-04-14T15:52:57Z)
• A Novel Semisupervised Contrastive Regression Framework for Forest Inventory Mapping with Multisensor Satellite Data [5.652290685410878]
  We develop a novel semisupervised regression framework for wall-to-wall mapping of continuous forest variables. The framework is demonstrated over a boreal forest site using Copernicus Sentinel-1 and Sentinel-2 imagery. Achieved prediction accuracies are strongly better compared to using vanilla UNet or traditional regression models.
  arXiv  Detail & Related papers  (2022-12-01T03:26:02Z)
• CLONeR: Camera-Lidar Fusion for Occupancy Grid-aided Neural Representations [77.90883737693325]
  This paper proposes CLONeR, which significantly improves upon NeRF by allowing it to model large outdoor driving scenes observed from sparse input sensor views. This is achieved by decoupling occupancy and color learning within the NeRF framework into separate Multi-Layer Perceptrons (MLPs) trained using LiDAR and camera data, respectively. In addition, this paper proposes a novel method to build differentiable 3D Occupancy Grid Maps (OGM) alongside the NeRF model, and leverage this occupancy grid for improved sampling of points along a ray for rendering in metric space.
  arXiv  Detail & Related papers  (2022-09-02T17:44:50Z)
• Neuroevolution-based Classifiers for Deforestation Detection in Tropical Forests [62.997667081978825]
  Millions of hectares of tropical forests are lost every year due to deforestation or degradation. Monitoring and deforestation detection programs are in use, in addition to public policies for the prevention and punishment of criminals. This paper proposes the use of pattern classifiers based on neuroevolution technique (NEAT) in tropical forest deforestation detection tasks.
  arXiv  Detail & Related papers  (2022-08-23T16:04:12Z)
• Information fusion approach for biomass estimation in a plateau mountainous forest using a synergistic system comprising UAS-based digital camera and LiDAR [9.944631732226657]
  The objective of this study was to quantify the aboveground biomass (AGB) of a plateau mountainous forest reserve. We utilized digital aerial photogrammetry (DAP), which has the unique advantages of speed, high spatial resolution, and low cost. Based on the CHM and spectral attributes obtained from multispectral images, we estimated and mapped the AGB of the region of interest with considerable cost efficiency.
  arXiv  Detail & Related papers  (2022-04-14T04:04:59Z)
• Deep Learning Based 3D Point Cloud Regression for Estimating Forest Biomass [15.956463815168034]
  Knowledge of forest biomass stocks and their development is important for implementing effective climate change mitigation measures. Remote sensing using airborne LiDAR can be used to measure vegetation biomass at large scale. We present deep learning systems for predicting wood volume, above-ground biomass (AGB), and subsequently carbon directly from 3D LiDAR point cloud data.
  arXiv  Detail & Related papers  (2021-12-21T16:26:13Z)
• Country-wide Retrieval of Forest Structure From Optical and SAR Satellite Imagery With Bayesian Deep Learning [74.94436509364554]
  We propose a Bayesian deep learning approach to densely estimate forest structure variables at country-scale with 10-meter resolution. Our method jointly transforms Sentinel-2 optical images and Sentinel-1 synthetic aperture radar images into maps of five different forest structure variables. We train and test our model on reference data from 41 airborne laser scanning missions across Norway.
  arXiv  Detail & Related papers  (2021-11-25T16:21:28Z)
• Growing Deep Forests Efficiently with Soft Routing and Learned Connectivity [79.83903179393164]
  This paper further extends the deep forest idea in several important aspects. We employ a probabilistic tree whose nodes make probabilistic routing decisions, a.k.a., soft routing, rather than hard binary decisions. Experiments on the MNIST dataset demonstrate that our empowered deep forests can achieve better or comparable performance than [1],[3].
  arXiv  Detail & Related papers  (2020-12-29T18:05:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.