PressureMesh: 3D Human Mesh Estimation from Multi-Device Pressure Images
- URL: http://arxiv.org/abs/2608.09550v1
- Date: Mon, 10 Aug 2026 12:48:37 GMT
- Title: PressureMesh: 3D Human Mesh Estimation from Multi-Device Pressure Images
- Abstract summary: We propose MDP-Net, an end-to-end network capable of directly estimating human meshes from temporal pressure data across multiple devices.<n>We introduce a multimodal fusion mechanism inspired by the Mixture of Experts (MoE) framework to achieve effective complementarity and enhancement of cross-device pressure information.<n> Experimental results demonstrate that MDP-Net achieves a joint position error of 12.6 cm on the MDP dataset.
- Score: 2.376974762124456
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Human pose monitoring is crucial in fields such as rehabilitation assessment and human-computer interaction. Due to its privacy-preserving nature, pressure-based human pose monitoring has become a primary approach for unobtrusive sensing. However, existing methods are generally limited to a single device, which restricts the effective monitoring range. To address this limitation, we propose MDP-Net, an end-to-end network capable of directly estimating human meshes from temporal pressure data across multiple devices. We introduce a multimodal fusion mechanism inspired by the Mixture of Experts (MoE) framework to achieve effective complementarity and enhancement of cross-device pressure information. To support the training and evaluation of MDP-Net, we constructed MDP, a high-quality multi-device temporal pressure dataset that includes various pose labels such as 2D/3D joints and human meshes. Experimental results demonstrate that MDP-Net achieves a joint position error of 12.6 cm on the MDP dataset. These results prove that fusing multi-device pressure information is an effective and promising new solution for daily human pose monitoring.
Related papers
- Beyond Pure Sampling: Hybrid Optimization Mechanisms for Non-Convex Model Predictive Control [16.21889938470088]
It is shown that ME-DDP-based methods consistently outperforms DDP-based methods in low-dimensional systems where the cost is relatively simple and local information is sufficiently representative.<n>The results show that in low-dimensional systems where the cost are relatively simple and local information is sufficiently representative, our framework consistently outperforms DDP-based methods.
arXiv Detail & Related papers (2026-05-30T14:09:14Z) - PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery [4.608996068062792]
We present textbfPressTrack-HMR, a top-down pipeline that recovers multi-person global human meshes solely from pressure signals.<n>Our method excels in multi-person HMR using pressure data, with 89.2 $mm$ MPJPE and 112.6 $mm$ WA-MPJPE$_100$.
arXiv Detail & Related papers (2025-11-12T09:33:44Z) - MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism [0.7373617024876725]
Human pose estimation based on Channel State Information (CSI) has emerged as a promising approach for non-intrusive and precise human activity monitoring.<n>This paper presents MultiFormer, a wireless sensing system that accurately estimates human pose through CSI.
arXiv Detail & Related papers (2025-05-28T16:36:02Z) - PI-HMR: Towards Robust In-bed Temporal Human Shape Reconstruction with Contact Pressure Sensing [0.2890929553637981]
Pressure-sensing bedsheets offer a promising solution for real-time motion reconstruction.<n>We introduce SMPLify-IB, an optimization method that overcomes the depth ambiguity issue in top-view scenarios.<n>We present PI-HMR, a temporal-based human shape estimator to regress meshes from pressure sequences.
arXiv Detail & Related papers (2025-02-27T12:42:44Z) - DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion [57.83515140886807]
We introduce the task of Deficiency-Aware 3D Pose Estimation.<n>DeProPose is a flexible method that simplifies the network architecture to reduce training complexity.<n>We have developed a novel 3D human pose estimation dataset.
arXiv Detail & Related papers (2025-02-23T03:22:54Z) - Coordinate Transformer: Achieving Single-stage Multi-person Mesh
Recovery from Videos [91.44553585470688]
Multi-person 3D mesh recovery from videos is a critical first step towards automatic perception of group behavior in virtual reality, physical therapy and beyond.
We propose the Coordinate transFormer (CoordFormer) that directly models multi-person spatial-temporal relations and simultaneously performs multi-mesh recovery in an end-to-end manner.
Experiments on the 3DPW dataset demonstrate that CoordFormer significantly improves the state-of-the-art, outperforming the previously best results by 4.2%, 8.8% and 4.7% according to the MPJPE, PAMPJPE, and PVE metrics, respectively.
arXiv Detail & Related papers (2023-08-20T18:23:07Z) - Direct Dense Pose Estimation [138.56533828316833]
Dense human pose estimation is the problem of learning dense correspondences between RGB images and the surfaces of human bodies.
Prior dense pose estimation methods are all based on Mask R-CNN framework and operate in a top-down manner of first attempting to identify a bounding box for each person.
We propose a novel alternative method for solving the dense pose estimation problem, called Direct Dense Pose (DDP)
arXiv Detail & Related papers (2022-04-04T06:14:38Z) - On Triangulation as a Form of Self-Supervision for 3D Human Pose
Estimation [57.766049538913926]
Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant.
Much of the recent attention has shifted towards semi and (or) weakly supervised learning.
We propose to impose multi-view geometrical constraints by means of a differentiable triangulation and to use it as form of self-supervision during training when no labels are available.
arXiv Detail & Related papers (2022-03-29T19:11:54Z) - Direct Multi-view Multi-person 3D Pose Estimation [138.48139701871213]
We present Multi-view Pose transformer (MvP) for estimating multi-person 3D poses from multi-view images.
MvP directly regresses the multi-person 3D poses in a clean and efficient way, without relying on intermediate tasks.
We show experimentally that our MvP model outperforms the state-of-the-art methods on several benchmarks while being much more efficient.
arXiv Detail & Related papers (2021-11-07T13:09:20Z) - TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
TRiPOD is a novel method for predicting body dynamics based on graph attentional networks.
To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame.
Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
arXiv Detail & Related papers (2021-04-08T20:01:00Z) - Multi-View Matching (MVM): Facilitating Multi-Person 3D Pose Estimation
Learning with Action-Frozen People Video [38.63662549684785]
MVM method generates reliable 3D human poses from a large-scale video dataset.
We train a neural network that takes a single image as the input for multi-person 3D pose estimation.
arXiv Detail & Related papers (2020-04-11T01:09:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.