HybridFusion: LiDAR and Vision Cross-Source Point Cloud Fusion
- URL: http://arxiv.org/abs/2304.04508v1
- Date: Mon, 10 Apr 2023 10:54:54 GMT
- Title: HybridFusion: LiDAR and Vision Cross-Source Point Cloud Fusion
- Authors: Yu Wang, Shuhui Bu, Lin Chen, Yifei Dong, Kun Li, Xuefeng Cao, Ke Li
- Abstract summary: We propose a cross-source point cloud fusion algorithm called HybridFusion.
It can register cross-source dense point clouds from different viewing angle in outdoor large scenes.
The proposed approach is evaluated comprehensively through qualitative and quantitative experiments.
- Score: 15.94976936555104
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recently, cross-source point cloud registration from different sensors has
become a significant research focus. However, traditional methods confront
challenges due to the varying density and structure of cross-source point
clouds. In order to solve these problems, we propose a cross-source point cloud
fusion algorithm called HybridFusion. It can register cross-source dense point
clouds from different viewing angle in outdoor large scenes. The entire
registration process is a coarse-to-fine procedure. First, the point cloud is
divided into small patches, and a matching patch set is selected based on
global descriptors and spatial distribution, which constitutes the coarse
matching process. To achieve fine matching, 2D registration is performed by
extracting 2D boundary points from patches, followed by 3D adjustment. Finally,
the results of multiple patch pose estimates are clustered and fused to
determine the final pose. The proposed approach is evaluated comprehensively
through qualitative and quantitative experiments. In order to compare the
robustness of cross-source point cloud registration, the proposed method and
generalized iterative closest point method are compared. Furthermore, a metric
for describing the degree of point cloud filling is proposed. The experimental
results demonstrate that our approach achieves state-of-the-art performance in
cross-source point cloud registration.
Related papers
- Multiway Point Cloud Mosaicking with Diffusion and Global Optimization [74.3802812773891]
We introduce a novel framework for multiway point cloud mosaicking (named Wednesday)
At the core of our approach is ODIN, a learned pairwise registration algorithm that identifies overlaps and refines attention scores.
Tested on four diverse, large-scale datasets, our method state-of-the-art pairwise and rotation registration results by a large margin on all benchmarks.
arXiv Detail & Related papers (2024-03-30T17:29:13Z) - PIVOT-Net: Heterogeneous Point-Voxel-Tree-based Framework for Point
Cloud Compression [8.778300313732027]
We propose a heterogeneous point cloud compression (PCC) framework.
We unify typical point cloud representations -- point-based, voxel-based, and tree-based representations -- and their associated backbones.
We augment the framework with a proposed context-aware upsampling for decoding and an enhanced voxel transformer for feature aggregation.
arXiv Detail & Related papers (2024-02-11T16:57:08Z) - Learning Continuous Implicit Field with Local Distance Indicator for
Arbitrary-Scale Point Cloud Upsampling [55.05706827963042]
Point cloud upsampling aims to generate dense and uniformly distributed point sets from a sparse point cloud.
Previous methods typically split a sparse point cloud into several local patches, upsample patch points, and merge all upsampled patches.
We propose a novel approach that learns an unsigned distance field guided by local priors for point cloud upsampling.
arXiv Detail & Related papers (2023-12-23T01:52:14Z) - Point Cloud Pre-training with Diffusion Models [62.12279263217138]
We propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif)
PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection.
arXiv Detail & Related papers (2023-11-25T08:10:05Z) - Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit
Neural Representation [79.60988242843437]
We propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously.
Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods.
arXiv Detail & Related papers (2022-04-18T07:18:25Z) - GenReg: Deep Generative Method for Fast Point Cloud Registration [18.66568286698704]
We propose a new data-driven registration algorithm by investigating deep generative neural networks to point cloud registration.
The experiments on both ModelNet40 and 7Scene datasets demonstrate that the proposed algorithm achieves state-of-the-art accuracy and efficiency.
arXiv Detail & Related papers (2021-11-23T10:52:09Z) - PCAM: Product of Cross-Attention Matrices for Rigid Registration of
Point Clouds [79.99653758293277]
PCAM is a neural network whose key element is a pointwise product of cross-attention matrices.
We show that PCAM achieves state-of-the-art results among methods which, like us, solve steps (a) and (b) jointly via deepnets.
arXiv Detail & Related papers (2021-10-04T09:23:27Z) - DeepCLR: Correspondence-Less Architecture for Deep End-to-End Point
Cloud Registration [12.471564670462344]
This work addresses the problem of point cloud registration using deep neural networks.
We propose an approach to predict the alignment between two point clouds with overlapping data content, but displaced origins.
Our approach achieves state-of-the-art accuracy and the lowest run-time of the compared methods.
arXiv Detail & Related papers (2020-07-22T08:20:57Z) - Point Set Voting for Partial Point Cloud Analysis [26.31029112502835]
techniques for point cloud classification and segmentation have in recent years achieved incredible performance driven in part by leveraging large synthetic datasets.
This paper proposes a general model for partial point clouds analysis wherein the latent feature encoding a complete point clouds is inferred by applying a local point set voting strategy.
arXiv Detail & Related papers (2020-07-09T03:37:31Z) - Learning multiview 3D point cloud registration [74.39499501822682]
We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm.
Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
arXiv Detail & Related papers (2020-01-15T03:42:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.