Deep Phase Correlation for End-to-End Heterogeneous Sensor Measurements Matching

• URL: http://arxiv.org/abs/2008.09474v4
• Date: Mon, 2 Nov 2020 11:00:11 GMT
• Title: Deep Phase Correlation for End-to-End Heterogeneous Sensor Measurements Matching
• Authors: Zexi Chen, Xuecheng Xu, Yue Wang, Rong Xiong
• Abstract summary: We present an end-to-end deep phase correlation network (DPCN) to match heterogeneous sensor measurements. The primary component is a differentiable correlation-based estimator that back-propagates the pose error to learnable feature extractors. With the interpretable modeling, the network is light-weighted and promising for better generalization.
• Score: 12.93459392278491
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The crucial step for localization is to match the current observation to the map. When the two sensor modalities are significantly different, matching becomes challenging. In this paper, we present an end-to-end deep phase correlation network (DPCN) to match heterogeneous sensor measurements. In DPCN, the primary component is a differentiable correlation-based estimator that back-propagates the pose error to learnable feature extractors, which addresses the problem that there are no direct common features for supervision. Also, it eliminates the exhaustive evaluation in some previous methods, improving efficiency. With the interpretable modeling, the network is light-weighted and promising for better generalization. We evaluate the system on both the simulation data and Aero-Ground Dataset which consists of heterogeneous sensor images and aerial images acquired by satellites or aerial robots. The results show that our method is able to match the heterogeneous sensor measurements, outperforming the comparative traditional phase correlation and other learning-based methods. Code is available at https://github.com/jessychen1016/DPCN .

Related papers

• Multi-channel Time Series Decomposition Network For Generalizable Sensor-Based Activity Recognition [2.024925013349319]
  This paper proposes a new method, Multi-channel Time Series Decomposition Network (MTSDNet) It decomposes the original signal into a combination of multiple components and trigonometric functions by the trainable parameterized temporal decomposition. It shows the advantages in predicting accuracy and stability of our method compared with other competing strategies.
  arXiv  Detail & Related papers  (2024-03-28T12:54:06Z)
• Graph-Aware Contrasting for Multivariate Time-Series Classification [50.84488941336865]
  Existing contrastive learning methods mainly focus on achieving temporal consistency with temporal augmentation and contrasting techniques. We propose Graph-Aware Contrasting for spatial consistency across MTS data. Our proposed method achieves state-of-the-art performance on various MTS classification tasks.
  arXiv  Detail & Related papers  (2023-09-11T02:35:22Z)
• Domain Adaptive Synapse Detection with Weak Point Annotations [63.97144211520869]
  We present AdaSyn, a framework for domain adaptive synapse detection with weak point annotations. In the WASPSYN challenge at I SBI 2023, our method ranks the 1st place.
  arXiv  Detail & Related papers  (2023-08-31T05:05:53Z)
• Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
  Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs) The performance of existing RS-CD methods is attributed to training on large annotated datasets. This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
  arXiv  Detail & Related papers  (2023-03-16T17:52:45Z)
• HAGCN : Network Decentralization Attention Based Heterogeneity-Aware Spatiotemporal Graph Convolution Network for Traffic Signal Forecasting [0.0]
  We study the heterogeneous characteristics inherent in traffic signal data to learn hidden relationships between sensors in various ways. We propose a network decentralization attention-aware graph convolution network (HAGCN) method that aggregates the hidden states of adjacent nodes.
  arXiv  Detail & Related papers  (2022-09-05T13:45:52Z)
• DPCN++: Differentiable Phase Correlation Network for Versatile Pose Registration [18.60311260250232]
  We present a differentiable phase correlation solver that is globally convergent and correspondence-free. We evaluate DCPN++ on a wide range of registration tasks taking different input modalities, including 2D bird's-eye view images, 3D object and scene measurements, and medical images.
  arXiv  Detail & Related papers  (2022-06-12T10:00:34Z)
• On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector [0.27074235008521236]
  In this paper, we focus on the second type caused by a varying sensitivity of the sensor to the incoming wavefront direction. The visible ranges, in image and data domains, are related by the wavefront direction mapping. We optimally combine fast approximate operators with tailored deep neural network architectures into efficient learned reconstruction methods.
  arXiv  Detail & Related papers  (2022-04-21T09:57:01Z)
• The KFIoU Loss for Rotated Object Detection [115.334070064346]
  In this paper, we argue that one effective alternative is to devise an approximate loss who can achieve trend-level alignment with SkewIoU loss. Specifically, we model the objects as Gaussian distribution and adopt Kalman filter to inherently mimic the mechanism of SkewIoU. The resulting new loss called KFIoU is easier to implement and works better compared with exact SkewIoU.
  arXiv  Detail & Related papers  (2022-01-29T10:54:57Z)
• Towards Improved Human Action Recognition Using Convolutional Neural Networks and Multimodal Fusion of Depth and Inertial Sensor Data [1.52292571922932]
  This paper attempts at improving the accuracy of Human Action Recognition (HAR) by fusion of depth and inertial sensor data. We transform the depth data into Sequential Front view Images(SFI) and fine-tune the pre-trained AlexNet on these images. Inertial data is converted into Signal Images (SI) and another convolutional neural network (CNN) is trained on these images.
  arXiv  Detail & Related papers  (2020-08-22T03:41:34Z)
• Deep Soft Procrustes for Markerless Volumetric Sensor Alignment [81.13055566952221]
  In this work, we improve markerless data-driven correspondence estimation to achieve more robust multi-sensor spatial alignment. We incorporate geometric constraints in an end-to-end manner into a typical segmentation based model and bridge the intermediate dense classification task with the targeted pose estimation one. Our model is experimentally shown to achieve similar results with marker-based methods and outperform the markerless ones, while also being robust to the pose variations of the calibration structure.
  arXiv  Detail & Related papers  (2020-03-23T10:51:32Z)
• Augmented Parallel-Pyramid Net for Attention Guided Pose-Estimation [90.28365183660438]
  This paper proposes an augmented parallel-pyramid net with attention partial module and differentiable auto-data augmentation. We define a new pose search space where the sequences of data augmentations are formulated as a trainable and operational CNN component. Notably, our method achieves the top-1 accuracy on the challenging COCO keypoint benchmark and the state-of-the-art results on the MPII datasets.
  arXiv  Detail & Related papers  (2020-03-17T03:52:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.