LiSnowNet: Real-time Snow Removal for LiDAR Point Cloud
- URL: http://arxiv.org/abs/2211.10023v1
- Date: Fri, 18 Nov 2022 04:19:05 GMT
- Title: LiSnowNet: Real-time Snow Removal for LiDAR Point Cloud
- Authors: Ming-Yuan Yu, Ram Vasudevan, Matthew Johnson-Roberson
- Abstract summary: We introduce an unsupervised de-noising algorithm, LiSnowNet, running 52$times$ faster than the state-of-the-art methods.
Unlike previous methods, the proposed algorithm is based on a deep convolutional neural network and can be easily deployed to hardware accelerators.
- Score: 28.738804719418088
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: LiDARs have been widely adopted to modern self-driving vehicles, providing 3D
information of the scene and surrounding objects. However, adverser weather
conditions still pose significant challenges to LiDARs since point clouds
captured during snowfall can easily be corrupted. The resulting noisy point
clouds degrade downstream tasks such as mapping. Existing works in de-noising
point clouds corrupted by snow are based on nearest-neighbor search, and thus
do not scale well with modern LiDARs which usually capture $100k$ or more
points at 10Hz. In this paper, we introduce an unsupervised de-noising
algorithm, LiSnowNet, running 52$\times$ faster than the state-of-the-art
methods while achieving superior performance in de-noising. Unlike previous
methods, the proposed algorithm is based on a deep convolutional neural network
and can be easily deployed to hardware accelerators such as GPUs. In addition,
we demonstrate how to use the proposed method for mapping even with corrupted
point clouds.
Related papers
- Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping [54.38209327518066]
Learning signed distance functions from point clouds is an important task in 3D computer vision.
We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision.
Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations.
arXiv Detail & Related papers (2024-07-04T03:35:02Z) - Fast graph-based denoising for point cloud color information [29.126056066012264]
In some applications, e.g., for live streaming using a 3D point cloud, real-time point cloud denoising methods are required to enhance the visual quality.
This paper proposes a fast graph-based denoising (FGBD) for a large-scale point cloud.
In our experiments, we succeeded in reducing the processing time dramatically while maintaining accuracy relative to conventional denoising methods.
arXiv Detail & Related papers (2024-01-18T04:51:41Z) - UltraLiDAR: Learning Compact Representations for LiDAR Completion and
Generation [51.443788294845845]
We present UltraLiDAR, a data-driven framework for scene-level LiDAR completion, LiDAR generation, and LiDAR manipulation.
We show that by aligning the representation of a sparse point cloud to that of a dense point cloud, we can densify the sparse point clouds.
By learning a prior over the discrete codebook, we can generate diverse, realistic LiDAR point clouds for self-driving.
arXiv Detail & Related papers (2023-11-02T17:57:03Z) - Echoes Beyond Points: Unleashing the Power of Raw Radar Data in
Multi-modality Fusion [74.84019379368807]
We propose a novel method named EchoFusion to skip the existing radar signal processing pipeline.
Specifically, we first generate the Bird's Eye View (BEV) queries and then take corresponding spectrum features from radar to fuse with other sensors.
arXiv Detail & Related papers (2023-07-31T09:53:50Z) - Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise
to Noise Mapping [52.25114448281418]
Learning signed distance functions (SDFs) from 3D point clouds is an important task in 3D computer vision.
We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision for training.
Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy point cloud observations.
arXiv Detail & Related papers (2023-06-02T09:52:04Z) - Semantic Segmentation of Radar Detections using Convolutions on Point
Clouds [59.45414406974091]
We introduce a deep-learning based method to convolve radar detections into point clouds.
We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds.
Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
arXiv Detail & Related papers (2023-05-22T07:09:35Z) - 4DenoiseNet: Adverse Weather Denoising from Adjacent Point Clouds [1.8563342761346613]
This letter presents a novel point cloud adverse weather denoising deep learning algorithm (4DenoiseNet)
Our algorithm takes advantage of the time dimension unlike deep learning adverse weather denoising methods in the literature.
Results are achieved on our novel Snowy KITTI dataset, which has over 40000 adverse weather annotated point clouds.
arXiv Detail & Related papers (2022-09-15T08:05:42Z) - LiDAR Snowfall Simulation for Robust 3D Object Detection [116.10039516404743]
We propose a physically based method to simulate the effect of snowfall on real clear-weather LiDAR point clouds.
Our method samples snow particles in 2D space for each LiDAR line and uses the induced geometry to modify the measurement for each LiDAR beam.
We use our simulation to generate partially synthetic snowy LiDAR data and leverage these data for training 3D object detection models that are robust to snowfall.
arXiv Detail & Related papers (2022-03-28T21:48:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.