Face recognition on point cloud with cgan-top for denoising
- URL: http://arxiv.org/abs/2506.06864v1
- Date: Sat, 07 Jun 2025 17:09:31 GMT
- Title: Face recognition on point cloud with cgan-top for denoising
- Authors: Junyu Liu, Jianfeng Ren, Sunhong Liang, Xudong Jiang,
- Abstract summary: An end-to-end 3D face recognition on a noisy point cloud is proposed.<n> Conditional Generative Adrial Network on Three Orthogonal Planes (cGAN-TOP) is designed to remove the noise in the point cloud.<n>A Linked Dynamic Graph Convolutional Neural Network (LDGCNN) is then adapted to recognize faces from the processed point cloud.
- Score: 28.209519473639627
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Face recognition using 3D point clouds is gaining growing interest, while raw point clouds often contain a significant amount of noise due to imperfect sensors. In this paper, an end-to-end 3D face recognition on a noisy point cloud is proposed, which synergistically integrates the denoising and recognition modules. Specifically, a Conditional Generative Adversarial Network on Three Orthogonal Planes (cGAN-TOP) is designed to effectively remove the noise in the point cloud, and recover the underlying features for subsequent recognition. A Linked Dynamic Graph Convolutional Neural Network (LDGCNN) is then adapted to recognize faces from the processed point cloud, which hierarchically links both the local point features and neighboring features of multiple scales. The proposed method is validated on the Bosphorus dataset. It significantly improves the recognition accuracy under all noise settings, with a maximum gain of 14.81%.
Related papers
- Enhancing Robustness to Noise Corruption for Point Cloud Recognition via Spatial Sorting and Set-Mixing Aggregation Module [17.588975042641007]
We propose Set-Mixer, a noise-robust aggregation module to mitigate the influence of individual noise points.
Experiments conducted on ModelNet40-C indicate that Set-Mixer significantly enhances the model performance on noisy point clouds.
arXiv Detail & Related papers (2024-07-15T15:21:34Z) - Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping [54.38209327518066]
Learning signed distance functions from point clouds is an important task in 3D computer vision.
We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision.
Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations.
arXiv Detail & Related papers (2024-07-04T03:35:02Z) - SphereNet: Learning a Noise-Robust and General Descriptor for Point
Cloud Registration [5.641476052216014]
We introduce SphereNet to learn a noise-robust and unseen-general descriptor for point cloud registration.
A new benchmark 3DMatch-noise with strong noise is introduced to evaluate our methods.
It sets a new state-of-the-art performance for the 3DMatch and 3DLoMatch benchmarks with 93.5% and 75.6% registration recall.
arXiv Detail & Related papers (2023-07-18T15:37:35Z) - Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise
to Noise Mapping [52.25114448281418]
Learning signed distance functions (SDFs) from 3D point clouds is an important task in 3D computer vision.
We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision for training.
Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy point cloud observations.
arXiv Detail & Related papers (2023-06-02T09:52:04Z) - StarNet: Style-Aware 3D Point Cloud Generation [82.30389817015877]
StarNet is able to reconstruct and generate high-fidelity and even 3D point clouds using a mapping network.
Our framework achieves comparable state-of-the-art performance on various metrics in the point cloud reconstruction and generation tasks.
arXiv Detail & Related papers (2023-03-28T08:21:44Z) - PD-Flow: A Point Cloud Denoising Framework with Normalizing Flows [20.382995180671205]
Point cloud denoising aims to restore clean point clouds from raw observations corrupted by noise and outliers.
We present a novel deep learning-based denoising model, that incorporates normalizing flows and noise disentanglement techniques.
arXiv Detail & Related papers (2022-03-11T14:17:58Z) - Shape-invariant 3D Adversarial Point Clouds [111.72163188681807]
Adversary and invisibility are two fundamental but conflict characters of adversarial perturbations.
Previous adversarial attacks on 3D point cloud recognition have often been criticized for their noticeable point outliers.
We propose a novel Point-Cloud Sensitivity Map to boost both the efficiency and imperceptibility of point perturbations.
arXiv Detail & Related papers (2022-03-08T12:21:35Z) - PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point
Cloud Upsampling [56.463507980857216]
We propose a generative adversarial network for point cloud upsampling.
It can make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions.
arXiv Detail & Related papers (2022-03-02T07:47:46Z) - Differentiable Manifold Reconstruction for Point Cloud Denoising [23.33652755967715]
3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments.
We propose to learn the underlying manifold of a noisy point cloud from differentiably subsampled points.
We show that our method significantly outperforms state-of-the-art denoising methods under both synthetic noise and real world noise.
arXiv Detail & Related papers (2020-07-27T13:31:41Z) - Learning Graph-Convolutional Representations for Point Cloud Denoising [31.557988478764997]
We propose a deep neural network that can deal with the permutation-invariance problem encountered by learning-based point cloud processing methods.
The network is fully-convolutional and can build complex hierarchies of features by dynamically constructing neighborhood graphs.
It is especially robust both at high noise levels and in presence of structured noise such as the one encountered in real LiDAR scans.
arXiv Detail & Related papers (2020-07-06T08:11:28Z) - Non-Local Part-Aware Point Cloud Denoising [55.50360085086123]
This paper presents a novel non-local part-aware deep neural network to denoise point clouds.
We design the non-local learning unit (NLU) customized with a graph attention module to adaptively capture non-local semantically-related features.
To enhance the denoising performance, we cascade a series of NLUs to progressively distill the noise features from the noisy inputs.
arXiv Detail & Related papers (2020-03-14T13:51:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.