Human Pose-Constrained UV Map Estimation

• URL: http://arxiv.org/abs/2501.08815v1
• Date: Wed, 15 Jan 2025 14:12:55 GMT
• Title: Human Pose-Constrained UV Map Estimation
• Abstract summary: UV map estimation is used in computer vision for detailed analysis of human posture or activity.<n>We propose Pose-Constrained Continuous Surface Embeddings (PC-CSE), which integrates estimated 2D human pose into the pixel-to-vertex assignment process.
• Score: 21.917582794820095
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: UV map estimation is used in computer vision for detailed analysis of human posture or activity. Previous methods assign pixels to body model vertices by comparing pixel descriptors independently, without enforcing global coherence or plausibility in the UV map. We propose Pose-Constrained Continuous Surface Embeddings (PC-CSE), which integrates estimated 2D human pose into the pixel-to-vertex assignment process. The pose provides global anatomical constraints, ensuring that UV maps remain coherent while preserving local precision. Evaluation on DensePose COCO demonstrates consistent improvement, regardless of the chosen 2D human pose model. Whole-body poses offer better constraints by incorporating additional details about the hands and feet. Conditioning UV maps with human pose reduces invalid mappings and enhances anatomical plausibility. In addition, we highlight inconsistencies in the ground-truth annotations.

Related papers

• Revisiting Avatar-As-Image: High-Fidelity Registration is All You Need [25.222133417690852]
  AvaImg outperforms all baselines in body fitting, shape estimation, and surface registration across six datasets.<n>For validation of AvaImg's Avatar-as-Image representation we auto-encode our UV maps via the frozen FLUX VAE.
  arXiv  Detail & Related papers  (2026-09-10T15:40:39Z)
• Geometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation [2.574393697080417]
  In this work, we reformulate occlusion-aware augmentation as a geometry-conditioned generative modeling task.<n>Unlike image-guided methods, Pose-LDM synthesizes blanket-covered images directly from skeletal keypoints.<n>Results demonstrate that geometry-conditioned diffusion provides an effective and supervision-efficient pathway toward inbed pose estimation.
  arXiv  Detail & Related papers  (2026-04-26T10:40:49Z)
• Bringing Your Portrait to 3D Presence [46.11577347349078]
  We present a unified framework for reconstructing animatable 3D human avatars from a single portrait across head, half-body, and full-body inputs.<n>Our method tackles three bottlenecks: pose- and framing-sensitive feature representations, limited scalable data, and unreliable proxy-mesh estimation.
  arXiv  Detail & Related papers  (2025-11-27T15:42:07Z)
• Benchmarking 3D Human Pose Estimation Models under Occlusions [6.858859328420893]
  Human Pose Estimation (HPE) involves detecting and localizing keypoints on the human body from visual data.<n>This paper presents a benchmark on the robustness of 3D HPE models under realistic occlusion conditions.<n>We evaluate nine state-of-the-art 2D-to-3D HPE models, spanning convolutional, transformer-based, graph-based, and diffusion-based architectures.
  arXiv  Detail & Related papers  (2025-04-14T16:00:25Z)
• Occlusion-Aware 3D Motion Interpretation for Abnormal Behavior Detection [10.782354892545651]
  We present OAD2D, which discriminates against motion abnormalities based on reconstructing 3D coordinates of mesh vertices and human joints from monocular videos. We reformulate the abnormal posture estimation by coupling it with Motion to Text (M2T) model in which, the VQVAE is employed to quantize motion features. Our approach demonstrates the robustness of abnormal behavior detection against severe and self-occlusions, as it reconstructs human motion trajectories in global coordinates.
  arXiv  Detail & Related papers  (2024-07-23T18:41:16Z)
• UVMap-ID: A Controllable and Personalized UV Map Generative Model [67.71022515856653]
  We introduce UVMap-ID, a controllable and personalized UV Map generative model. Unlike traditional large-scale training methods in 2D, we propose to fine-tune a pre-trained text-to-image diffusion model. Both quantitative and qualitative analyses demonstrate the effectiveness of our method in controllable and personalized UV Map generation.
  arXiv  Detail & Related papers  (2024-04-22T20:30:45Z)
• ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation [71.2556016049579]
  ManiPose is a manifold-constrained multi-hypothesis model for human-pose 2D-to-3D lifting.<n>By constraining the outputs to lie on the human pose manifold, ManiPose guarantees the consistency of all hypothetical poses.<n>We showcase the performance of ManiPose on real-world datasets, where it outperforms state-of-the-art models in pose consistency.
  arXiv  Detail & Related papers  (2023-12-11T13:50:10Z)
• Zolly: Zoom Focal Length Correctly for Perspective-Distorted Human Mesh Reconstruction [66.10717041384625]
  Zolly is the first 3DHMR method focusing on perspective-distorted images. We propose a new camera model and a novel 2D representation, termed distortion image, which describes the 2D dense distortion scale of the human body. We extend two real-world datasets tailored for this task, all containing perspective-distorted human images.
  arXiv  Detail & Related papers  (2023-03-24T04:22:41Z)
• Learning Visibility for Robust Dense Human Body Estimation [78.37389398573882]
  Estimating 3D human pose and shape from 2D images is a crucial yet challenging task. We learn dense human body estimation that is robust to partial observations. We obtain pseudo ground-truths of visibility labels from dense UV correspondences and train a neural network to predict visibility along with 3D coordinates.
  arXiv  Detail & Related papers  (2022-08-23T00:01:05Z)
• Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation [63.199549837604444]
  3D human pose estimation approaches leverage different forms of strong (2D/3D pose) or weak (multi-view or depth) paired supervision. We cast 3D pose learning as a self-supervised adaptation problem that aims to transfer the task knowledge from a labeled source domain to a completely unpaired target. We evaluate different self-adaptation settings and demonstrate state-of-the-art 3D human pose estimation performance on standard benchmarks.
  arXiv  Detail & Related papers  (2022-04-05T03:52:57Z)
• Aligning Silhouette Topology for Self-Adaptive 3D Human Pose Recovery [70.66865453410958]
  Articulation-centric 2D/3D pose supervision forms the core training objective in most existing 3D human pose estimation techniques. We propose a novel framework that relies only on silhouette supervision to adapt a source-trained model-based regressor. We develop a series of convolution-friendly spatial transformations in order to disentangle a topological-skeleton representation from the raw silhouette.
  arXiv  Detail & Related papers  (2022-04-04T06:58:15Z)
• Facial UV Map Completion for Pose-invariant Face Recognition: A Novel Adversarial Approach based on Coupled Attention Residual UNets [3.999563862575646]
  We propose a novel generative model called Attention ResCUNet-GAN to improve the UV map completion. We show that the proposed method yields superior performance compared to other existing methods.
  arXiv  Detail & Related papers  (2020-11-02T11:46:42Z)
• Simultaneously-Collected Multimodal Lying Pose Dataset: Towards In-Bed Human Pose Monitoring under Adverse Vision Conditions [15.12849597272402]
  In-bed human pose estimation has significant values in many healthcare applications. In this paper, we introduce our Simultaneously-collected multimodal Lying Pose dataset. We show that state-of-the-art 2D pose estimation models can be trained effectively with SLP data with promising performance as high as 95% at PCKh@0.5 on a single modality.
  arXiv  Detail & Related papers  (2020-08-20T02:20:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.