PoseShield: Neural Collision Fields for Human Self-Collision Resolution
- URL: http://arxiv.org/abs/2606.29686v2
- Date: Wed, 01 Jul 2026 04:17:59 GMT
- Title: PoseShield: Neural Collision Fields for Human Self-Collision Resolution
- Abstract summary: Self-collision remains a persistent challenge in SMPL-based human pose estimation and motion generation.<n>We propose PoseShield, a neural collision constraint defined directly in SMPL pose space.<n>Our method achieves a 95.8% success rate and outperforms state-of-the-art baselines.
- Score: 44.26354057690119
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Self-collision remains a persistent challenge in SMPL-based human pose estimation and motion generation. Under extreme articulations or stochastic motion synthesis, generated meshes frequently exhibit self-penetrations, leading to physically implausible results. We propose PoseShield, a neural collision constraint defined directly in SMPL pose space. We formulate collision correction as a constrained optimization problem and connect the learned constraint with the Eikonal equation. Enforcing Eikonal regularization ensures non-vanishing gradients near the collision boundary, improving numerical stability and robustness of the optimization process. Unlike prior methods that operate in the mesh space or rely on heuristic penalties, our approach operates directly in the low-dimensional space of human poses and is theoretically grounded. The same learned constraint extends to human motion sequences, providing a generator-agnostic post-hoc collision corrector without retraining the underlying motion model. Experiments on a newly constructed SMPL pose benchmark show that our method achieves a 95.8% success rate and outperforms state-of-the-art baselines.
Related papers
- STEP: Score-Based Temporal Energy for Human Pose Video Anomaly Detection [13.87765205634944]
Skeleton-based Video Anomaly Detection (VAD) offers a robust, privacy-preserving solution for identifying abnormal behaviors.<n>Recent methods train Energy-Based Models (EBMs) via Denoising Score Matching (DSM)<n>However, directly injecting noise, required for training, into raw joint coordinates creates physically impossible poses.<n>We introduce STEP, a simple framework that utilizes Principal Component Analysis (PCA) to project pose sequences into a compact, whitened PC-space.
arXiv Detail & Related papers (2026-08-20T13:02:19Z) - A Task-Space Receding Horizon Controller for Fast Collision Avoidance [0.08594140167290099]
Real-time collision avoidance for robotic manipulators requires fast reactions to unexpected obstacle motion.<n>Full model predictive control can provide this foresight, but its online cost may grow quickly with horizon length, model fidelity, and the number of active geometric constraints.<n>We present a task-space receding-horizon controller that uses a short contact-consistent rollout to generate a terminal kinematic reference.
arXiv Detail & Related papers (2026-07-17T08:13:12Z) - DeSeG: Decoupling Semantic Intent and Geometric Constraints for Physically Plausible Human-Scene Interaction [50.06148080975928]
We propose DeSeG, a hierarchical framework that explicitly decouples semantic intent from geometric constraints.<n>DeSeG achieves state-of-the-art performance, reducing mean scene penetration by 47% and improving semantic alignment by 29% over the SOTA baselines.
arXiv Detail & Related papers (2026-07-07T03:21:08Z) - Real-Time and Accurate Collision-Free Teleoperation via Differentiable Constraint-Based Trajectory Planning [1.4699455652461726]
A common strategy to mitigate this issue is to enhance the operator's input using optimal-control-based trajectory planning.<n>We adapt a recent formulation of differentiable collision-avoidance constraints, based on duality in convex optimization, to the teleoperation setting.<n>Results show that our approach achieves lower computation times while enabling more accurate obstacle modeling.
arXiv Detail & Related papers (2026-06-07T16:39:56Z) - Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation [81.44955493339835]
DeGO is a deformable Gaussian occupancy framework that unifies decoupled Gaussian deformation with factorized 4D foundation-model distillation.<n> Experiments on the Occ3D-NuScenes benchmark demonstrate that our method achieves state-of-the-art performance under weak supervision.
arXiv Detail & Related papers (2026-05-27T15:09:55Z) - Rollback-Free Stable Brick Structures Generation [51.856925926010184]
Existing approaches rely on external physical simulators during inference to perform rejection sampling and brick-by-brick rollbacks.<n>We propose a reinforcement learning paradigm that shifts physical validity enforcement from test-time correction to training-time policy optimization.<n> Experimental results demonstrate that our approach achieves state-of-the-art generation quality while accelerating inference speed by orders of magnitude.
arXiv Detail & Related papers (2026-05-07T21:06:44Z) - Stability-Driven Motion Generation for Object-Guided Human-Human Co-Manipulation [16.622175523077917]
Co-manipulation requires multiple humans to synchronize their motions with a shared object.<n>Most existing motion generation approaches fail to account for payload-induced dynamics.<n>We propose a flow-matching framework that ensures the generated co-manipulation motions align with the intended goals.
arXiv Detail & Related papers (2026-04-22T08:31:40Z) - MIRROR: Visual Motion Imitation via Real-time Retargeting and Teleoperation with Parallel Differential Inverse Kinematics [20.41490560492412]
Real-time humanoid teleoperation requires responsive inverse kinematics (IK) that are both responsive and constraint-safe under redundancy and self-collision constraints.<n>We propose a GPU-parallelized, continuation-based differential IK that improves escape from such constraint-induced local minima while preserving real-time performance, promoting safety and stability.<n>The method is paired with a visual skeletal pose estimation pipeline that enables robust, real-time upper-body teleoperation on the THEMIS humanoid robot hardware in real-world tasks.
arXiv Detail & Related papers (2026-03-25T06:49:58Z) - HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions [69.43316445143408]
We present HSImul3R, a unified framework for simulation-ready 3D reconstruction of human-scene interactions.<n>Existing methods suffer from a perception-simulation gap, leading to instability in physics engines and failure in embodied AI applications.
arXiv Detail & Related papers (2026-03-16T17:58:33Z) - Warm-Starting Collision-Free Model Predictive Control With Object-Centric Diffusion [38.363402738466334]
We show that combining diffusion-based warm-starting conditioned with a latent object-centric representation of the scene yields reliable and efficient motion generation under strict time limits.<n>Our approach conditions a diffusion transformer on the system state, task, and surroundings, using an object-centric slot attention mechanism.<n>The sampled trajectories are refined by an optimal control problem that enforces rigid-body dynamics and signed-distance collision constraints.
arXiv Detail & Related papers (2026-01-06T10:02:54Z) - ReMoSPLAT: Reactive Mobile Manipulation Control on a Gaussian Splat [3.983697124458495]
Reactive control can gracefully coordinate the motion of the base and the arm of a mobile manipulator.<n>We present ReMoSPLAT, a reactive controller based on a quadratic program formulation for mobile manipulation.
arXiv Detail & Related papers (2025-12-10T13:52:08Z) - Towards Continual Learning Desiderata via HSIC-Bottleneck
Orthogonalization and Equiangular Embedding [55.107555305760954]
We propose a conceptually simple yet effective method that attributes forgetting to layer-wise parameter overwriting and the resulting decision boundary distortion.
Our method achieves competitive accuracy performance, even with absolute superiority of zero exemplar buffer and 1.02x the base model.
arXiv Detail & Related papers (2024-01-17T09:01:29Z) - MotionHint: Self-Supervised Monocular Visual Odometry with Motion
Constraints [70.76761166614511]
We present a novel self-supervised algorithm named MotionHint for monocular visual odometry (VO)
Our MotionHint algorithm can be easily applied to existing open-sourced state-of-the-art SSM-VO systems.
arXiv Detail & Related papers (2021-09-14T15:35:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.