Transformer with Implicit Edges for Particle-based Physics Simulation

• URL: http://arxiv.org/abs/2207.10860v1
• Date: Fri, 22 Jul 2022 03:45:29 GMT
• Title: Transformer with Implicit Edges for Particle-based Physics Simulation
• Authors: Yidi Shao, Chen Change Loy, Bo Dai
• Abstract summary: Transformer with Implicit Edges (TIE) captures the rich semantics of particle interactions in an edge-free manner. We evaluate our model on diverse domains of varying complexity and materials.
• Score: 135.77656965678196
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Particle-based systems provide a flexible and unified way to simulate physics systems with complex dynamics. Most existing data-driven simulators for particle-based systems adopt graph neural networks (GNNs) as their network backbones, as particles and their interactions can be naturally represented by graph nodes and graph edges. However, while particle-based systems usually contain hundreds even thousands of particles, the explicit modeling of particle interactions as graph edges inevitably leads to a significant computational overhead, due to the increased number of particle interactions. Consequently, in this paper we propose a novel Transformer-based method, dubbed as Transformer with Implicit Edges (TIE), to capture the rich semantics of particle interactions in an edge-free manner. The core idea of TIE is to decentralize the computation involving pair-wise particle interactions into per-particle updates. This is achieved by adjusting the self-attention module to resemble the update formula of graph edges in GNN. To improve the generalization ability of TIE, we further amend TIE with learnable material-specific abstract particles to disentangle global material-wise semantics from local particle-wise semantics. We evaluate our model on diverse domains of varying complexity and materials. Compared with existing GNN-based methods, without bells and whistles, TIE achieves superior performance and generalization across all these domains. Codes and models are available at https://github.com/ftbabi/TIE_ECCV2022.git.

Related papers

• Towards Complex Dynamic Physics System Simulation with Graph Neural ODEs [75.7104463046767]
  This paper proposes a novel learning based simulation model that characterizes the varying spatial and temporal dependencies in particle systems. We empirically evaluate GNSTODE's simulation performance on two real-world particle systems, Gravity and Coulomb.
  arXiv  Detail & Related papers  (2023-05-21T03:51:03Z)
• Graph Neural Network-based surrogate model for granular flows [2.153852088624324]
  Granular flow dynamics is crucial for assessing various geotechnical risks, including landslides and debris flows. Traditional continuum and discrete numerical methods are limited by their computational cost in simulating large-scale systems. We develop a graph neural network-based simulator (GNS) that takes the current state of granular flow and predicts the next state using explicit integration by learning the local interaction laws.
  arXiv  Detail & Related papers  (2023-05-09T07:28:12Z)
• Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers [124.29621071934693]
  We present a novel neural network architecture that combines the spatial learning enabled by convolutions with the contextual learning enabled by attention. TransformerCVN simultaneously classifies each event and reconstructs every individual particle's identity. This architecture enables us to perform several interpretability studies which provide insights into the network's predictions.
  arXiv  Detail & Related papers  (2023-03-10T20:36:23Z)
• PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification [64.61198351207752]
  Existing approaches to system identification (estimating the physical parameters of an object) from videos assume known object geometries. In this work, we aim to identify parameters characterizing a physical system from a set of multi-view videos without any assumption on object geometry or topology. We propose "Physics Augmented Continuum Neural Radiance Fields" (PAC-NeRF), to estimate both the unknown geometry and physical parameters of highly dynamic objects from multi-view videos.
  arXiv  Detail & Related papers  (2023-03-09T18:59:50Z)
• GNS: A generalizable Graph Neural Network-based simulator for particulate and fluid modeling [2.132096006921048]
  We develop a PyTorch-based Graph Network Simulator (GNS) that learns physics and predicts the flow behavior of particulate and fluid systems. GNS discretizes the domain with nodes representing a collection of material points and the links connecting the nodes representing the local interaction between particles or clusters of particles.
  arXiv  Detail & Related papers  (2022-11-18T13:28:03Z)
• Fast Simulation of Particulate Suspensions Enabled by Graph Neural Network [21.266813711114153]
  We introduce a new framework, hydrodynamic interaction graph neural network (HIGNN), for inferring and predicting the particles' dynamics in Stokes suspensions. It overcomes the limitations of traditional approaches in computational efficiency, accuracy, and/or transferability. We demonstrate the accuracy, efficiency, and transferability of the proposed HIGNN framework in a variety of systems.
  arXiv  Detail & Related papers  (2022-06-17T14:05:53Z)
• Learning Physics-Consistent Particle Interactions [3.9686511558236055]
  We propose an algorithm that adapts the Graph Networks framework, which contains an edge part to learn the pairwise interaction and a node part to model the dynamics at particle level. We test the proposed methodology on multiple datasets and demonstrate that it achieves considerably better performance in inferring correctly the pairwise interactions.
  arXiv  Detail & Related papers  (2022-02-01T09:59:53Z)
• Scalable Graph Networks for Particle Simulations [1.933681537640272]
  We introduce an approach that transforms a fully-connected interaction graph into a hierarchical one. Using our approach, we are able to train models on much larger particle counts, even on a single GPU. Our approach retains high accuracy and efficiency even on large-scale gravitational N-body simulations.
  arXiv  Detail & Related papers  (2020-10-14T10:54:54Z)
• Multipole Graph Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
  One of the main challenges in using deep learning-based methods for simulating physical systems is formulating physics-based data. We propose a novel multi-level graph neural network framework that captures interaction at all ranges with only linear complexity. Experiments confirm our multi-graph network learns discretization-invariant solution operators to PDEs and can be evaluated in linear time.
  arXiv  Detail & Related papers  (2020-06-16T21:56:22Z)
• Learning to Simulate Complex Physics with Graph Networks [68.43901833812448]
  We present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains. Our framework---which we term "Graph Network-based Simulators" (GNS)--represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time.
  arXiv  Detail & Related papers  (2020-02-21T16:44:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.