MetaSym: A Symplectic Meta-learning Framework for Physical Intelligence

• URL: http://arxiv.org/abs/2502.16667v1
• Date: Sun, 23 Feb 2025 17:52:07 GMT
• Title: MetaSym: A Symplectic Meta-learning Framework for Physical Intelligence
• Authors: Pranav Vaidhyanathan, Aristotelis Papatheodorou, Mark T. Mitchison, Natalia Ares, Ioannis Havoutis,
• Abstract summary: We introduce a novel deep learning architecture, MetaSym.<n>In particular, MetaSym combines a strong symplectic inductive bias obtained from a symplectic encoder and an autoregressive decoder with meta-attention.<n>Our results demonstrate superior performance in modeling dynamics under few-shot adaptation, outperforming state-of-the-art baselines with far larger models.
• Score: 8.047222674695288
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Scalable and generalizable physics-aware deep learning has long been considered a significant challenge with various applications across diverse domains ranging from robotics to molecular dynamics. Central to almost all physical systems are symplectic forms, the geometric backbone that underpins fundamental invariants like energy and momentum. In this work, we introduce a novel deep learning architecture, MetaSym. In particular, MetaSym combines a strong symplectic inductive bias obtained from a symplectic encoder and an autoregressive decoder with meta-attention. This principled design ensures that core physical invariants remain intact while allowing flexible, data-efficient adaptation to system heterogeneities. We benchmark MetaSym on highly varied datasets such as a high-dimensional spring mesh system (Otness et al., 2021), an open quantum system with dissipation and measurement backaction, and robotics-inspired quadrotor dynamics. Our results demonstrate superior performance in modeling dynamics under few-shot adaptation, outperforming state-of-the-art baselines with far larger models.

Related papers

• GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects [55.02281855589641]
  GausSim is a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels. We leverage continuum mechanics and treat each kernel as a Center of Mass System (CMS) that represents continuous piece of matter. In addition, GausSim incorporates explicit physics constraints, such as mass and momentum conservation, ensuring interpretable results and robust, physically plausible simulations.
  arXiv  Detail & Related papers  (2024-12-23T18:58:17Z)
• Morphological-Symmetry-Equivariant Heterogeneous Graph Neural Network for Robotic Dynamics Learning [31.728300637833748]
  We present a morphological-symmetry-equivariant heterogeneous graph neural network, namely MS-HGNN, for robotic dynamics learning. MS-HGNN integrates robotic kinematic structures and morphological symmetries into a single graph network.
  arXiv  Detail & Related papers  (2024-12-02T09:10:37Z)
• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Bond Graphs for multi-physics informed Neural Networks for multi-variate time series [6.775534755081169]
  Existing methods are not adapted to tasks with complex multi-physical and multi-domain phenomena. We propose a Neural Bond graph (NBgE) producing multi-physics-informed representations that can be fed into any task-specific model.
  arXiv  Detail & Related papers  (2024-05-22T12:30:25Z)
• Metalearning generalizable dynamics from trajectories [4.4466356883131155]
  We present the interpretable meta neural ordinary differential equation (iMODE) method to rapidly learn generalizable (i.e., not parameter-specific) dynamics. The iMODE method learns meta-knowledge, the functional variations of the force field of dynamical system instances without knowing the physical parameters. We test the validity of the iMODE method on bistable, double pendulum, Van der Pol, Slinky, and reaction-diffusion systems.
  arXiv  Detail & Related papers  (2023-01-03T06:04:28Z)
• Towards Cross Domain Generalization of Hamiltonian Representation via Meta Learning [2.3020018305241337]
  In this work, we take a significant leap forward by targeting cross domain generalization within the field of Hamiltonian dynamics. We model our system with a graph neural network (GNN) and employ a meta learning algorithm to enable the model to gain experience over a distribution of systems. We demonstrate that the meta-trained model captures the generalized Hamiltonian representation that is consistent across different physical domains.
  arXiv  Detail & Related papers  (2022-12-02T13:47:21Z)
• Learning Physical Dynamics with Subequivariant Graph Neural Networks [99.41677381754678]
  Graph Neural Networks (GNNs) have become a prevailing tool for learning physical dynamics. Physical laws abide by symmetry, which is a vital inductive bias accounting for model generalization. Our model achieves on average over 3% enhancement in contact prediction accuracy across 8 scenarios on Physion and 2X lower rollout MSE on RigidFall.
  arXiv  Detail & Related papers  (2022-10-13T10:00:30Z)
• Symmetry Group Equivariant Architectures for Physics [52.784926970374556]
  In the domain of machine learning, an awareness of symmetries has driven impressive performance breakthroughs. We argue that both the physics community and the broader machine learning community have much to understand.
  arXiv  Detail & Related papers  (2022-03-11T18:27:04Z)
• Learning the nonlinear dynamics of soft mechanical metamaterials with graph networks [3.609538870261841]
  We propose a machine learning approach to study the dynamics of soft mechanical metamaterials. The proposed approach can significantly reduce the computational cost when compared to direct numerical simulation.
  arXiv  Detail & Related papers  (2022-02-24T00:20:28Z)
• Learning to Simulate Unseen Physical Systems with Graph Neural Networks [13.202870928432045]
  "Graph-based Physics Engine" is a machine learning method embedded with physical priors and material parameters. We demonstrate that GPE can generalize to materials with different properties not seen in the training set. In addition, introducing the law of momentum conservation in the model significantly improves the efficiency and stability of learning.
  arXiv  Detail & Related papers  (2022-01-28T07:56:46Z)
• Which priors matter? Benchmarking models for learning latent dynamics [70.88999063639146]
  Several methods have proposed to integrate priors from classical mechanics into machine learning models. We take a sober look at the current capabilities of these models. We find that the use of continuous and time-reversible dynamics benefits models of all classes.
  arXiv  Detail & Related papers  (2021-11-09T23:48:21Z)
• Constructing Neural Network-Based Models for Simulating Dynamical Systems [59.0861954179401]
  Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system. This paper provides a survey of the different ways to construct models of dynamical systems using neural networks. In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome.
  arXiv  Detail & Related papers  (2021-11-02T10:51:42Z)
• Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling [86.9726984929758]
  We focus on the integration of incomplete physics models into deep generative models. We propose a VAE architecture in which a part of the latent space is grounded by physics. We demonstrate generative performance improvements over a set of synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2021-02-25T20:28:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.