CLOAF: CoLlisiOn-Aware Human Flow

• URL: http://arxiv.org/abs/2403.09050v1
• Date: Thu, 14 Mar 2024 02:38:09 GMT
• Title: CLOAF: CoLlisiOn-Aware Human Flow
• Authors: Andrey Davydov, Martin Engilberge, Mathieu Salzmann, Pascal Fua,
• Abstract summary: CLOAF exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate body self-intersections. Being differentiable, CLOAF can be used to fine-tune pose and shape estimation baselines to improve their overall performance.
• Score: 90.21089550719488
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Even the best current algorithms for estimating body 3D shape and pose yield results that include body self-intersections. In this paper, we present CLOAF, which exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate such self-intersections while still imposing body shape constraints. We show that, unlike earlier approaches to addressing this issue, ours completely eliminates the self-intersections without compromising the accuracy of the reconstructions. Being differentiable, CLOAF can be used to fine-tune pose and shape estimation baselines to improve their overall performance and eliminate self-intersections in their predictions. Furthermore, we demonstrate how our CLOAF strategy can be applied to practically any motion field induced by the user. CLOAF also makes it possible to edit motion to interact with the environment without worrying about potential collision or loss of body-shape prior.

Related papers

• ARC-Flow : Articulated, Resolution-Agnostic, Correspondence-Free Matching and Interpolation of 3D Shapes Under Flow Fields [4.706075725469252]
  This work presents a unified framework for the unsupervised prediction of physically plausibles between two 3D articulated shapes. Interpolation is modelled as a diffeomorphic transformation using a smooth, time-varying flow field governed by Neural Ordinary Differential Equations (ODEs) Correspondence is recovered using an efficient Varifold formulation, that is effective on high-fidelity surfaces with differing parameterisations.
  arXiv  Detail & Related papers  (2025-03-04T13:28:05Z)
• Occlusion-aware Non-Rigid Point Cloud Registration via Unsupervised Neural Deformation Correntropy [25.660967523504855]
  Occlusion-Aware Registration (OAR) is an unsupervised method for non-rigidly aligning point clouds. We present a theoretical analysis and establish the relationship between the maximum correntropy criterion and the commonly used Chamfer distance. Our method achieves superior or competitive performance compared to existing approaches.
  arXiv  Detail & Related papers  (2025-02-15T07:27:15Z)
• Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption [64.07607726562841]
  Existing multi-person human reconstruction approaches mainly focus on recovering accurate poses or avoiding penetration. In this work, we tackle the task of reconstructing closely interactive humans from a monocular video. We propose to leverage knowledge from proxemic behavior and physics to compensate the lack of visual information.
  arXiv  Detail & Related papers  (2024-04-17T11:55:45Z)
• Implicit Modeling of Non-rigid Objects with Cross-Category Signals [28.956412015920936]
  MODIF is a multi-object deep implicit function that jointly learns the deformation fields and instance-specific latent codes for multiple objects at once. We show that MODIF can proficiently learn the shape representation of each organ and their relations to others, to the point that shapes missing from unseen instances can be consistently recovered.
  arXiv  Detail & Related papers  (2023-12-15T22:34:17Z)
• NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation [53.25973084799954]
  We present NIKI (Neural Inverse Kinematics with Invertible Neural Network), which models bi-directional errors. NIKI can learn from both the forward and inverse processes with invertible networks.
  arXiv  Detail & Related papers  (2023-05-15T12:13:24Z)
• Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views [32.940614931864154]
  We propose a scene-conditioned diffusion method to model the body pose distribution. The method generates bodies in plausible human-scene interactions. It achieves superior accuracy for visible joints and diversity for invisible body parts.
  arXiv  Detail & Related papers  (2023-04-12T17:58:57Z)
• VGFlow: Visibility guided Flow Network for Human Reposing [36.94334399493267]
  We propose VGFlow to generate perceptually accurate images of humans. Our model uses a visibility-guided flow module to disentangle the flow into visible and invisible parts. VGFlow achieves state-of-the-art results as observed on different image quality metrics.
  arXiv  Detail & Related papers  (2022-11-13T12:41:07Z)
• A Repulsive Force Unit for Garment Collision Handling in Neural Networks [61.34646212450137]
  We propose a novel collision handling neural network layer called Repulsive Force Unit (ReFU) Based on the signed distance function (SDF) of the underlying body, ReFU predicts the per-vertex offsets that push any interpenetrating to a collision-free configuration while preserving the fine geometric details. Our experiments show that ReFU significantly reduces the number of collisions between the body and the garment and better preserves geometric details compared to prior methods.
  arXiv  Detail & Related papers  (2022-07-28T03:46:16Z)
• RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization [46.144194562841435]
  We propose a framework based on a recurrent neural network (RNN) for object pose refinement. The problem is formulated as a non-linear least squares problem based on the estimated correspondence field. The correspondence field estimation and pose refinement are conducted alternatively in each iteration to recover accurate object poses.
  arXiv  Detail & Related papers  (2022-03-24T06:24:55Z)
• LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies [78.17425779503047]
  We propose a novel neural implicit representation for the human body. It is fully differentiable and optimizable with disentangled shape and pose latent spaces. Our model can be trained and fine-tuned directly on non-watertight raw data with well-designed losses.
  arXiv  Detail & Related papers  (2021-11-30T04:10:57Z)
• SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes [117.76767853430243]
  We introduce SNARF, which combines the advantages of linear blend skinning for polygonal meshes with neural implicit surfaces. We propose a forward skinning model that finds all canonical correspondences of any deformed point using iterative root finding. Compared to state-of-the-art neural implicit representations, our approach generalizes better to unseen poses while preserving accuracy.
  arXiv  Detail & Related papers  (2021-04-08T17:54:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.