mmGAT: Pose Estimation by Graph Attention with Mutual Features from mmWave Radar Point Cloud

• URL: http://arxiv.org/abs/2603.08551v1
• Date: Mon, 09 Mar 2026 16:15:45 GMT
• Title: mmGAT: Pose Estimation by Graph Attention with Mutual Features from mmWave Radar Point Cloud
• Abstract summary: This paper exploits the capabilities of millimeter-wave (mmWave) radar technology for human pose estimation.<n>We present a unique feature extraction technique that exploits the full potential of the GNN processing method for pose estimation.<n>Our approach achieves a noteworthy reduction of pose estimation mean per joint position error (MPJPE) by 35.6% and PA-MPJPE by 14.1% from the current state of the art benchmark within this domain.
• Score: 3.300544441511928
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pose estimation and human action recognition (HAR) are pivotal technologies spanning various domains. While the image-based pose estimation and HAR are widely admired for their superior performance, they lack in privacy protection and suboptimal performance in low-light and dark environments. This paper exploits the capabilities of millimeter-wave (mmWave) radar technology for human pose estimation by processing radar data with Graph Neural Network (GNN) architecture, coupled with the attention mechanism. Our goal is to capture the finer details of the radar point cloud to improve the pose estimation performance. To this end, we present a unique feature extraction technique that exploits the full potential of the GNN processing method for pose estimation. Our model mmGAT demonstrates remarkable performance on two publicly available benchmark mmWave datasets and establishes new state of the art results in most scenarios in terms of human pose estimation. Our approach achieves a noteworthy reduction of pose estimation mean per joint position error (MPJPE) by 35.6% and PA-MPJPE by 14.1% from the current state of the art benchmark within this domain.

Related papers

• MAEPose: Self-Supervised Spatiotemporal Learning for Human Pose Estimation on mmWave Video [12.636232510548062]
  We present MAEPose, a masked auto-encoding-based human pose estimation approach that operates directly on mmWave videos.<n>We evaluate MAEPose across three datasets based on leave-one-person-cross-out-validation with rigorous statistical testing.
  arXiv  Detail & Related papers  (2026-04-30T21:23:03Z)
• PCFEx: Point Cloud Feature Extraction for Graph Neural Networks [3.300544441511928]
  Graph neural networks (GNNs) have gained significant attention for their effectiveness across various domains.<n>This study focuses on applying GNN to process 3D point cloud data for human pose estimation (HPE) and human activity recognition (HAR)
  arXiv  Detail & Related papers  (2026-03-09T16:09:02Z)
• Exploring Spatial-Temporal Representation via Star Graph for mmWave Radar-based Human Activity Recognition [24.55019884151024]
  We propose a graph representation with a discrete graph neural network (DDGNN) to explore the spatial-temporal representation of human movement-related features.<n>Our system achieved an overall classification accuracy of 94.27%, which gets the near-optimal performance with a vision-based skeleton data accuracy of 97.25%.
  arXiv  Detail & Related papers  (2025-12-12T20:13:06Z)
• TacoDepth: Towards Efficient Radar-Camera Depth Estimation with One-stage Fusion [54.46664104437454]
  We propose TacoDepth, an efficient and accurate Radar-Camera depth estimation model with one-stage fusion.<n>Specifically, the graph-based Radar structure extractor and the pyramid-based Radar fusion module are designed.<n>Compared with the previous state-of-the-art approach, TacoDepth improves depth accuracy and processing speed by 12.8% and 91.8%.
  arXiv  Detail & Related papers  (2025-04-16T05:25:04Z)
• ProbRadarM3F: mmWave Radar based Human Skeletal Pose Estimation with Probability Map Guided Multi-Format Feature Fusion [10.269536505085524]
  This paper introduces a probability map guided multi-format feature fusion model, ProbRadarM3F.<n>ProbRadarM3F fuses the traditional heatmap features and the positional features, then effectively achieves the estimation of 14 keypoints of the human body.
  arXiv  Detail & Related papers  (2024-05-08T15:54:57Z)
• Rethinking pose estimation in crowds: overcoming the detection information-bottleneck and ambiguity [46.10812760258666]
  Frequent interactions between individuals are a fundamental challenge for pose estimation algorithms. We propose a novel pipeline called bottom-up conditioned top-down pose estimation. We demonstrate the performance and efficiency of our approach on animal and human pose estimation benchmarks.
  arXiv  Detail & Related papers  (2023-06-13T16:14:40Z)
• HuPR: A Benchmark for Human Pose Estimation Using Millimeter Wave Radar [30.51398364813315]
  This paper introduces a novel human pose estimation benchmark, Human Pose with Millimeter Wave Radar (HuPR) This dataset is created using cross-calibrated mmWave radar sensors and a monocular RGB camera for cross-modality training of radar-based human pose estimation.
  arXiv  Detail & Related papers  (2022-10-22T22:28:40Z)
• DeepRM: Deep Recurrent Matching for 6D Pose Refinement [77.34726150561087]
  DeepRM is a novel recurrent network architecture for 6D pose refinement. The architecture incorporates LSTM units to propagate information through each refinement step. DeepRM achieves state-of-the-art performance on two widely accepted challenging datasets.
  arXiv  Detail & Related papers  (2022-05-28T16:18:08Z)
• Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction [63.62263239934777]
  We conduct an indepth study on various pose representations with a focus on their effects on the motion prediction task. We propose a novel RNN architecture termed AHMR (Attentive Hierarchical Motion Recurrent network) for motion prediction. Our approach outperforms the state-of-the-art methods in short-term prediction and achieves much enhanced long-term prediction proficiency.
  arXiv  Detail & Related papers  (2021-12-30T10:45:22Z)
• ZARTS: On Zero-order Optimization for Neural Architecture Search [94.41017048659664]
  Differentiable architecture search (DARTS) has been a popular one-shot paradigm for NAS due to its high efficiency. This work turns to zero-order optimization and proposes a novel NAS scheme, called ZARTS, to search without enforcing the above approximation. In particular, results on 12 benchmarks verify the outstanding robustness of ZARTS, where the performance of DARTS collapses due to its known instability issue.
  arXiv  Detail & Related papers  (2021-10-10T09:35:15Z)
• Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking [98.91894395941766]
  We propose a novel online approach to learning the pose dynamics, which are independent of pose detections in current fame. Specifically, we derive this prediction of dynamics through a graph neural network(GNN) that explicitly accounts for both spatial-temporal and visual information. Experiments on PoseTrack 2017 and PoseTrack 2018 datasets demonstrate that the proposed method achieves results superior to the state of the art on both human pose estimation and tracking tasks.
  arXiv  Detail & Related papers  (2021-06-07T16:36:50Z)
• Wave Propagation of Visual Stimuli in Focus of Attention [77.4747032928547]
  Fast reactions to changes in the surrounding visual environment require efficient attention mechanisms to reallocate computational resources to most relevant locations in the visual field. We present a biologically-plausible model of focus of attention that exhibits effectiveness and efficiency exhibited by foveated animals.
  arXiv  Detail & Related papers  (2020-06-19T09:33:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.