Unsupervised Change Detection for Space Habitats Using 3D Point Clouds

• URL: http://arxiv.org/abs/2312.02396v3
• Date: Mon, 5 Aug 2024 16:49:51 GMT
• Title: Unsupervised Change Detection for Space Habitats Using 3D Point Clouds
• Authors: Jamie Santos, Holly Dinkel, Julia Di, Paulo V. K. Borges, Marina Moreira, Oleg Alexandrov, Brian Coltin, Trey Smith,
• Abstract summary: This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab.
• Score: 4.642898625014145
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. Autonomous robotic systems will help maintain future deep-space habitats, such as the Gateway space station, which will be uncrewed for extended periods. Existing scene analysis software used on the International Space Station (ISS) relies on manually-labeled images for detecting changes. In contrast, the algorithm presented in this work uses raw, unlabeled point clouds as inputs. The algorithm first applies modified Expectation-Maximization Gaussian Mixture Model (GMM) clustering to two input point clouds. It then performs change detection by comparing the GMMs using the Earth Mover's Distance. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab comprising single frame depth images taken directly by Astrobee and full-scene reconstructed maps built with RGB-D and pose data from Astrobee. The runtimes of the approach are also analyzed in depth. The source code is publicly released to promote further development.

Related papers

• Multi-Agent 3D Map Reconstruction and Change Detection in Microgravity with Free-Flying Robots [4.42851967323783]
  This work presents a framework for multi-agent cooperative mapping and change detection to enable robotic maintenance of space outposts. One agent is used to reconstruct a 3D model of the environment from sequences of images and corresponding depth information. Another agent is used to periodically scan the environment for inconsistencies against the 3D model.
  arXiv  Detail & Related papers  (2023-11-05T03:53:42Z)
• Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting [58.45661235893729]
  One promising self-supervised task is 3D point cloud forecasting from unannotated LiDAR sequences. We show that this task requires algorithms to implicitly capture (1) sensor extrinsics (i.e., the egomotion of the autonomous vehicle), (2) sensor intrinsics (i.e., the sampling pattern specific to the particular LiDAR sensor), and (3) the shape and motion of other objects in the scene. We render point cloud data from 4D occupancy predictions given sensor extrinsics and intrinsics, allowing one to train and test occupancy algorithms with unannotated LiDAR sequences.
  arXiv  Detail & Related papers  (2023-02-25T18:12:37Z)
• FRAME: Fast and Robust Autonomous 3D point cloud Map-merging for Egocentric multi-robot exploration [2.433860819518925]
  This article presents a 3D point cloud map-merging framework for egocentric heterogeneous multi-robot exploration. The novel proposed solution utilizes state-of-the-art place recognition learned descriptors, that through the framework's main pipeline, offer a fast and robust region overlap estimation. The efficacy of the proposed framework is experimentally evaluated based on multiple field multi-robot exploration missions in underground environments.
  arXiv  Detail & Related papers  (2023-01-22T21:59:38Z)
• SSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from Point Cloud [125.9472454212909]
  We present a novel Semi-Supervised Domain Adaptation method for 3D object detection (SSDA3D) SSDA3D includes an Inter-domain Adaptation stage and an Intra-domain Generalization stage. Experiments show that, with only 10% labeled target data, our SSDA3D can surpass the fully-supervised oracle model with 100% target label.
  arXiv  Detail & Related papers  (2022-12-06T09:32:44Z)
• Construction of Object Boundaries for the Autopilotof a Surface Robot from Satellite Imagesusing Computer Vision Methods [101.18253437732933]
  A method for detecting water objects on satellite maps is proposed. An algorithm for calculating the GPS coordinates of the contours is created. The proposed algorithm allows saving the result in a format suitable for the surface robot autopilot module.
  arXiv  Detail & Related papers  (2022-12-05T12:07:40Z)
• Satellite Image Time Series Analysis for Big Earth Observation Data [50.591267188664666]
  This paper describes sits, an open-source R package for satellite image time series analysis using machine learning. We show that this approach produces high accuracy for land use and land cover maps through a case study in the Cerrado biome.
  arXiv  Detail & Related papers  (2022-04-24T15:23:25Z)
• City-scale Scene Change Detection using Point Clouds [71.73273007900717]
  We propose a method for detecting structural changes in a city using images captured from mounted cameras over two different times. A direct comparison of the two point clouds for change detection is not ideal due to inaccurate geo-location information. To circumvent this problem, we propose a deep learning-based non-rigid registration on the point clouds. Experiments show that our method is able to detect scene changes effectively, even in the presence of viewpoint and illumination differences.
  arXiv  Detail & Related papers  (2021-03-26T08:04:13Z)
• Towards an Automatic System for Extracting Planar Orientations from Software Generated Point Clouds [1.0705399532413615]
  In geology, a key activity is the characterisation of geological structures using Planar Orientation measurements. Various computing techniques and technologies, such as Lidar, have been utilised in order to automate this process. Here is presented a methodology of data acquisition and a Machine Learning-based software system: GeoStructure, developed to automate the measurement of orientation measurements.
  arXiv  Detail & Related papers  (2020-12-22T01:35:47Z)
• Tiny-YOLO object detection supplemented with geometrical data [0.0]
  We propose a method of improving detection precision (mAP) with the help of the prior knowledge about the scene geometry. We focus our attention on autonomous robots, so given the robot's dimensions and the inclination angles of the camera, it is possible to predict the spatial scale for each pixel of the input frame.
  arXiv  Detail & Related papers  (2020-08-05T14:45:19Z)
• DR-SPAAM: A Spatial-Attention and Auto-regressive Model for Person Detection in 2D Range Data [81.06749792332641]
  We propose a person detection network which uses an alternative strategy to combine scans obtained at different times. DR-SPAAM keeps the intermediate features from the backbone network as a template and recurrently updates the template when a new scan becomes available. On the DROW dataset, our method outperforms the existing state-of-the-art, while being approximately four times faster.
  arXiv  Detail & Related papers  (2020-04-29T11:01:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.