CubeLearn: End-to-end Learning for Human Motion Recognition from Raw mmWave Radar Signals

• URL: http://arxiv.org/abs/2111.03976v1
• Date: Sun, 7 Nov 2021 00:45:51 GMT
• Title: CubeLearn: End-to-end Learning for Human Motion Recognition from Raw mmWave Radar Signals
• Authors: Peijun Zhao, Chris Xiaoxuan Lu, Bing Wang, Niki Trigoni and Andrew Markham
• Abstract summary: mmWave FMCW radar has attracted huge amount of research interest for human-centered applications in recent years. Most existing pipelines are built upon conventional DFT pre-processing and deep neural network hybrid methods. We propose a learnable pre-processing module, named CubeLearn, to directly extract features from raw radar signal.
• Score: 40.53874877651099
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: mmWave FMCW radar has attracted huge amount of research interest for human-centered applications in recent years, such as human gesture/activity recognition. Most existing pipelines are built upon conventional Discrete Fourier Transform (DFT) pre-processing and deep neural network classifier hybrid methods, with a majority of previous works focusing on designing the downstream classifier to improve overall accuracy. In this work, we take a step back and look at the pre-processing module. To avoid the drawbacks of conventional DFT pre-processing, we propose a learnable pre-processing module, named CubeLearn, to directly extract features from raw radar signal and build an end-to-end deep neural network for mmWave FMCW radar motion recognition applications. Extensive experiments show that our CubeLearn module consistently improves the classification accuracies of different pipelines, especially benefiting those previously weaker models. We provide ablation studies on initialization methods and structure of the proposed module, as well as an evaluation of the running time on PC and edge devices. This work also serves as a comparison of different approaches towards data cube slicing. Through our task agnostic design, we propose a first step towards a generic end-to-end solution for radar recognition problems.

Related papers

• Stepping Forward on the Last Mile [8.756033984943178]
  We propose a series of algorithm enhancements that further reduce the memory footprint, and the accuracy gap compared to backpropagation. Our results demonstrate that on the last mile of model customization on edge devices, training with fixed-point forward gradients is a feasible and practical approach.
  arXiv  Detail & Related papers  (2024-11-06T16:33:21Z)
• Emergence in non-neural models: grokking modular arithmetic via average gradient outer product [16.911836722312152]
  We show that grokking is not specific to neural networks nor to gradient descent-based optimization. We show that this phenomenon occurs when learning modular arithmetic with Recursive Feature Machines. Our results demonstrate that emergence can result purely from learning task-relevant features.
  arXiv  Detail & Related papers  (2024-07-29T17:28:58Z)
• Towards Explainable Machine Learning: The Effectiveness of Reservoir Computing in Wireless Receive Processing [21.843365090029987]
  We investigate the specific task of channel equalization by applying a popular learning-based technique known as Reservoir Computing (RC) RC has shown superior performance compared to conventional methods and other learning-based approaches. We also show the improvement in receive processing/symbol detection performance with this optimized through simulations.
  arXiv  Detail & Related papers  (2023-10-08T00:44:35Z)
• Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization [87.21285093582446]
  Diffusion Generative Flow Samplers (DGFS) is a sampling-based framework where the learning process can be tractably broken down into short partial trajectory segments. Our method takes inspiration from the theory developed for generative flow networks (GFlowNets)
  arXiv  Detail & Related papers  (2023-10-04T09:39:05Z)
• Transform Once: Efficient Operator Learning in Frequency Domain [69.74509540521397]
  We study deep neural networks designed to harness the structure in frequency domain for efficient learning of long-range correlations in space or time. This work introduces a blueprint for frequency domain learning through a single transform: transform once (T1)
  arXiv  Detail & Related papers  (2022-11-26T01:56:05Z)
• Neural Architectural Nonlinear Pre-Processing for mmWave Radar-based Human Gesture Perception [10.826849062116748]
  This paper utilizes two deep learning models, U-Net and EfficientNet, to detect hand gestures and remove noise in a millimeter-wave (mmWave) radar image. A novel pre-processing approach to denoise images before entering the first deep learning model stage increases the accuracy of classification.
  arXiv  Detail & Related papers  (2022-11-07T12:42:13Z)
• Neural Maximum A Posteriori Estimation on Unpaired Data for Motion Deblurring [87.97330195531029]
  We propose a Neural Maximum A Posteriori (NeurMAP) estimation framework for training neural networks to recover blind motion information and sharp content from unpaired data. The proposed NeurMAP is an approach to existing deblurring neural networks, and is the first framework that enables training image deblurring networks on unpaired datasets.
  arXiv  Detail & Related papers  (2022-04-26T08:09:47Z)
• Deep Learning Radio Frequency Signal Classification with Hybrid Images [0.0]
  We focus on the different pre-processing steps that can be used on the input training data, and test the results on a fixed Deep Learning architecture. We propose a hybrid image that takes advantage of both time and frequency domain information, and tackles the classification as a Computer Vision problem.
  arXiv  Detail & Related papers  (2021-05-19T11:12:09Z)
• LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers [104.01415343139901]
  We propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements. LoRD-Net has a task-based architecture dedicated to recovering the underlying signal of interest. We evaluate the proposed receiver architecture for one-bit signal recovery in wireless communications.
  arXiv  Detail & Related papers  (2021-02-05T04:26:05Z)
• Deep Shells: Unsupervised Shape Correspondence with Optimal Transport [52.646396621449]
  We propose a novel unsupervised learning approach to 3D shape correspondence. We show that the proposed method significantly improves over the state-of-the-art on multiple datasets.
  arXiv  Detail & Related papers  (2020-10-28T22:24:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.