PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF

• URL: http://arxiv.org/abs/2311.13099v2
• Date: Wed, 27 Mar 2024 23:49:07 GMT
• Title: PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF
• Authors: Yutao Feng, Yintong Shang, Xuan Li, Tianjia Shao, Chenfanfu Jiang, Yin Yang,
• Abstract summary: We show that physics-based simulations can be seamlessly integrated with NeRF to generate high-quality elastodynamics of real-world objects. A quadratic generalized moving least square (Q-GMLS) is employed to capture nonlinear dynamics and large deformation on the implicit model. We adaptively place the least-square kernels according to the NeRF density field to significantly reduce the complexity of the nonlinear simulation.
• Score: 29.6350855891474
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We show that physics-based simulations can be seamlessly integrated with NeRF to generate high-quality elastodynamics of real-world objects. Unlike existing methods, we discretize nonlinear hyperelasticity in a meshless way, obviating the necessity for intermediate auxiliary shape proxies like a tetrahedral mesh or voxel grid. A quadratic generalized moving least square (Q-GMLS) is employed to capture nonlinear dynamics and large deformation on the implicit model. Such meshless integration enables versatile simulations of complex and codimensional shapes. We adaptively place the least-square kernels according to the NeRF density field to significantly reduce the complexity of the nonlinear simulation. As a result, physically realistic animations can be conveniently synthesized using our method for a wide range of hyperelastic materials at an interactive rate. For more information, please visit our project page at https://fytalon.github.io/pienerf/.

Related papers

• Neurally Integrated Finite Elements for Differentiable Elasticity on Evolving Domains [19.755626638375904]
  elastic simulator for domains defined as evolving implicit functions, which is efficient, robust, and differentiable with respect to shape and material. Key technical innovation is to train a small neural network to fit quadrature points for robust numerical integration on implicit grid cells. We demonstrate the efficacy of our approach on forward simulation of implicits, direct simulation of 3D shapes during editing, and novel physics-based shape and topology optimizations in conjunction with differentiable rendering.
  arXiv  Detail & Related papers  (2024-10-12T07:49:23Z)
• Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation [18.45850302604534]
  We present a data-, mesh-, and grid-free solution for elastic simulation for any object in any geometric representation. For each object, we fit a small implicit neural network encoding varying weights that act as a reduced deformation basis. Our experiments demonstrate the versatility, accuracy, and speed of this approach on data including signed distance functions, point clouds, neural primitives, tomography scans, radiance fields, Gaussian splats, surface meshes, and volume meshes.
  arXiv  Detail & Related papers  (2024-06-09T18:57:23Z)
• ElastoGen: 4D Generative Elastodynamics [59.20029207991106]
  ElastoGen is a knowledge-driven AI model that generates physically accurate 4D elastodynamics. Because of its alignment with actual physical procedures, ElastoGen efficiently generates accurate dynamics for a wide range of hyperelastic materials.
  arXiv  Detail & Related papers  (2024-05-23T21:09:36Z)
• Transolver: A Fast Transformer Solver for PDEs on General Geometries [66.82060415622871]
  We present Transolver, which learns intrinsic physical states hidden behind discretized geometries. By calculating attention to physics-aware tokens encoded from slices, Transovler can effectively capture intricate physical correlations. Transolver achieves consistent state-of-the-art with 22% relative gain across six standard benchmarks and also excels in large-scale industrial simulations.
  arXiv  Detail & Related papers  (2024-02-04T06:37:38Z)
• Dynamic Mesh-Aware Radiance Fields [75.59025151369308]
  This paper designs a two-way coupling between mesh and NeRF during rendering and simulation. We show that a hybrid system approach outperforms alternatives in visual realism for mesh insertion.
  arXiv  Detail & Related papers  (2023-09-08T20:18:18Z)
• NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theory [70.10550467873499]
  We propose NeuralClothSim, a new quasistatic cloth simulator using thin shells. Our memory-efficient solver operates on a new continuous coordinate-based surface representation called neural deformation fields.
  arXiv  Detail & Related papers  (2023-08-24T17:59:54Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• Learning rigid dynamics with face interaction graph networks [11.029321427540829]
  We introduce the Face Interaction Graph Network (FIGNet) which computes interactions between mesh faces, rather than nodes. FIGNet is around 4x more accurate in simulating complex shape interactions, while also 8x more computationally efficient on sparse, rigid meshes. It can learn frictional dynamics directly from real-world data, and can be more accurate than analytical solvers given modest amounts of training data.
  arXiv  Detail & Related papers  (2022-12-07T11:22:42Z)
• Learning Physical Dynamics with Subequivariant Graph Neural Networks [99.41677381754678]
  Graph Neural Networks (GNNs) have become a prevailing tool for learning physical dynamics. Physical laws abide by symmetry, which is a vital inductive bias accounting for model generalization. Our model achieves on average over 3% enhancement in contact prediction accuracy across 8 scenarios on Physion and 2X lower rollout MSE on RigidFall.
  arXiv  Detail & Related papers  (2022-10-13T10:00:30Z)
• Automatically Polyconvex Strain Energy Functions using Neural Ordinary Differential Equations [0.0]
  Deep neural networks are able to learn complex material without the constraints of form approximations. N-ODE material model is able to capture synthetic data generated from closedform material models. framework can be used to model a large class of materials.
  arXiv  Detail & Related papers  (2021-10-03T13:11:43Z)
• High-order Differentiable Autoencoder for Nonlinear Model Reduction [29.296661974901976]
  This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. We integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable solids.
  arXiv  Detail & Related papers  (2021-02-19T02:30:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.