Classifying geospatial objects from multiview aerial imagery using semantic meshes

• URL: http://arxiv.org/abs/2405.09544v1
• Date: Wed, 15 May 2024 17:56:49 GMT
• Title: Classifying geospatial objects from multiview aerial imagery using semantic meshes
• Authors: David Russell, Ben Weinstein, David Wettergreen, Derek Young,
• Abstract summary: We propose a new method to predict tree species based on aerial images of forests in the U.S. We show that our proposed multiview method improves classification accuracy from 53% to 75% relative to an orthoorthoaic baseline on a challenging cross-site tree classification task.
• Score: 2.116528763953217
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Aerial imagery is increasingly used in Earth science and natural resource management as a complement to labor-intensive ground-based surveys. Aerial systems can collect overlapping images that provide multiple views of each location from different perspectives. However, most prediction approaches (e.g. for tree species classification) use a single, synthesized top-down "orthomosaic" image as input that contains little to no information about the vertical aspects of objects and may include processing artifacts. We propose an alternate approach that generates predictions directly on the raw images and accurately maps these predictions into geospatial coordinates using semantic meshes. This method$\unicode{x2013}$released as a user-friendly open-source toolkit$\unicode{x2013}$enables analysts to use the highest quality data for predictions, capture information about the sides of objects, and leverage multiple viewpoints of each location for added robustness. We demonstrate the value of this approach on a new benchmark dataset of four forest sites in the western U.S. that consists of drone images, photogrammetry results, predicted tree locations, and species classification data derived from manual surveys. We show that our proposed multiview method improves classification accuracy from 53% to 75% relative to an orthomosaic baseline on a challenging cross-site tree species classification task.

Related papers

• Tree Species Classification using Machine Learning and 3D Tomographic SAR -- a case study in Northern Europe [0.0]
  Tree species classification plays an important role in nature conservation, forest inventories, forest management, and the protection of endangered species. In this study, we employed TomoSense, a 3D tomographic dataset, which utilizes a stack of single-look complex (SLC) images.
  arXiv  Detail & Related papers  (2024-11-19T22:25:26Z)
• OAM-TCD: A globally diverse dataset of high-resolution tree cover maps [8.336960607169175]
  We present a novel open-access dataset for individual tree crown delineation (TCD) in high-resolution aerial imagery sourced from OpenMap (OAM) Our dataset, OAM-TCD, comprises 5072 2048x2048px images at 10 cm/px resolution with associated human-labeled instance masks for over 280k individual and 56k groups of trees. Using our dataset, we train reference instance and semantic segmentation models that compare favorably to existing state-of-the-art models.
  arXiv  Detail & Related papers  (2024-07-16T14:11:29Z)
• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• Lidar-based Norwegian tree species detection using deep learning [0.36651088217486427]
  We present a deep learning based tree species classification model utilizing only lidar data. The model is trained with focal loss over partial weak labels. Our model achieves a macro-averaged F1 score of 0.70 on an independent validation.
  arXiv  Detail & Related papers  (2023-11-10T14:01:05Z)
• Spatial Implicit Neural Representations for Global-Scale Species Mapping [72.92028508757281]
  Given a set of locations where a species has been observed, the goal is to build a model to predict whether the species is present or absent at any location. Traditional methods struggle to take advantage of emerging large-scale crowdsourced datasets. We use Spatial Implicit Neural Representations (SINRs) to jointly estimate the geographical range of 47k species simultaneously.
  arXiv  Detail & Related papers  (2023-06-05T03:36:01Z)
• Scrape, Cut, Paste and Learn: Automated Dataset Generation Applied to Parcel Logistics [58.720142291102135]
  We present a fully automated pipeline to generate a synthetic dataset for instance segmentation in four steps. We first scrape images for the objects of interest from popular image search engines. We compare three different methods for image selection: Object-agnostic pre-processing, manual image selection and CNN-based image selection.
  arXiv  Detail & Related papers  (2022-10-18T12:49:04Z)
• Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image [91.29546868637911]
  This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization. Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
  arXiv  Detail & Related papers  (2022-04-10T19:16:58Z)
• Embedding Earth: Self-supervised contrastive pre-training for dense land cover classification [61.44538721707377]
  We present Embedding Earth a self-supervised contrastive pre-training method for leveraging the large availability of satellite imagery. We observe significant improvements up to 25% absolute mIoU when pre-trained with our proposed method. We find that learnt features can generalize between disparate regions opening up the possibility of using the proposed pre-training scheme.
  arXiv  Detail & Related papers  (2022-03-11T16:14:14Z)
• A hierarchical deep learning framework for the consistent classification of land use objects in geospatial databases [8.703408520845645]
  In this paper, a hierarchical deep learning framework is proposed to verify the land use information. A new CNN-based method is proposed aiming to predict land use in multiple levels hierarchically and simultaneously. Experiments show that the CNN relying on JO outperforms previous results, achieving an overall accuracy up to 92.5%.
  arXiv  Detail & Related papers  (2021-04-14T17:16:35Z)
• AiRound and CV-BrCT: Novel Multi-View Datasets for Scene Classification [2.931113769364182]
  We present two new publicly available datasets named thedatasetand CV-BrCT. The first one contains triplets of images from the same geographic coordinate with different perspectives of view extracted from various places around the world. The second dataset contains pairs of aerial and street-level images extracted from southeast Brazil.
  arXiv  Detail & Related papers  (2020-08-03T18:55:46Z)
• High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification [84.43394420267794]
  We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment. Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
  arXiv  Detail & Related papers  (2020-03-18T12:18:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.