Contact-Aware Retargeting of Skinned Motion

• URL: http://arxiv.org/abs/2109.07431v1
• Date: Wed, 15 Sep 2021 17:05:02 GMT
• Title: Contact-Aware Retargeting of Skinned Motion
• Authors: Ruben Villegas, Duygu Ceylan, Aaron Hertzmann, Jimei Yang, Jun Saito
• Abstract summary: This paper introduces a motion estimation method that preserves self-contacts and prevents interpenetration. The method identifies self-contacts and ground contacts in the input motion, and optimize the motion to apply to the output skeleton. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works.
• Score: 49.71236739408685
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper introduces a motion retargeting method that preserves self-contacts and prevents interpenetration. Self-contacts, such as when hands touch each other or the torso or the head, are important attributes of human body language and dynamics, yet existing methods do not model or preserve these contacts. Likewise, interpenetration, such as a hand passing into the torso, are a typical artifact of motion estimation methods. The input to our method is a human motion sequence and a target skeleton and character geometry. The method identifies self-contacts and ground contacts in the input motion, and optimizes the motion to apply to the output skeleton, while preserving these contacts and reducing interpenetration. We introduce a novel geometry-conditioned recurrent network with an encoder-space optimization strategy that achieves efficient retargeting while satisfying contact constraints. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works. We also show our method generalizes to motion estimated from human videos where we improve over previous works that produce noticeable interpenetration.

Related papers

• Skinned Motion Retargeting with Dense Geometric Interaction Perception [19.788066070569734]
  Existing approaches often overlook body correction stage after skeletal motion. This results in conflicts between geometry interaction and geometry correction, leading to jittery motion. We introduce MeshRetration, which directly models the dense interactions in motion.
  arXiv  Detail & Related papers  (2024-10-28T13:04:44Z)
• Pose Priors from Language Models [74.61186408764559]
  We present a zero-shot pose optimization method that enforces accurate physical contact constraints. Our method produces surprisingly compelling pose reconstructions of people in close contact. Unlike previous approaches, our method provides a unified framework for resolving self-contact and person-to-person contact.
  arXiv  Detail & Related papers  (2024-05-06T17:59:36Z)
• Two-Person Interaction Augmentation with Skeleton Priors [16.65884142618145]
  We propose a new deep learning method for two-body skeletal interaction motion augmentation. Our system can learn effectively from a relatively small amount of data and generalize to drastically different skeleton sizes.
  arXiv  Detail & Related papers  (2024-04-08T13:11:57Z)
• Physically Plausible Full-Body Hand-Object Interaction Synthesis [32.83908152822006]
  We propose a physics-based method for synthesizing dexterous hand-object interactions in a full-body setting. Existing methods often focus on isolated segments of the interaction process and rely on data-driven techniques that may result in artifacts.
  arXiv  Detail & Related papers  (2023-09-14T17:55:18Z)
• NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis [21.650091018774972]
  We create a neural interaction field attached to a specific object, which outputs the distance to the valid interaction manifold given a human pose as input. This interaction field guides the sampling of an object-conditioned human motion diffusion model. We synthesize realistic motions for sitting and lifting with several objects, outperforming alternative approaches in terms of motion quality and successful action completion.
  arXiv  Detail & Related papers  (2023-07-14T17:59:38Z)
• PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments [69.03289331433874]
  We present PACE, a novel method for modifying motion-captured virtual agents to interact with and move throughout dense, cluttered 3D scenes. Our approach changes a given motion sequence of a virtual agent as needed to adjust to the obstacles and objects in the environment. We compare our method with prior motion generating techniques and highlight the benefits of our method with a perceptual study and physical plausibility metrics.
  arXiv  Detail & Related papers  (2023-03-24T19:49:08Z)
• Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations [61.659439423703155]
  TOHO: Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations. Our method generates continuous motions that are parameterized only by the temporal coordinate. This work takes a step further toward general human-scene interaction simulation.
  arXiv  Detail & Related papers  (2023-03-23T09:31:56Z)
• Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos [49.52070710518688]
  We introduce a method to reconstruct the 3D motion of a person interacting with an object from a single RGB video. Our method estimates the 3D poses of the person together with the object pose, the contact positions and the contact forces on the human body.
  arXiv  Detail & Related papers  (2021-11-02T13:40:18Z)
• Pose And Joint-Aware Action Recognition [87.4780883700755]
  We present a new model for joint-based action recognition, which first extracts motion features from each joint separately through a shared motion encoder. Our joint selector module re-weights the joint information to select the most discriminative joints for the task. We show large improvements over the current state-of-the-art joint-based approaches on JHMDB, HMDB, Charades, AVA action recognition datasets.
  arXiv  Detail & Related papers  (2020-10-16T04:43:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.