Learning Modular Simulations for Homogeneous Systems
- URL: http://arxiv.org/abs/2210.16294v1
- Date: Fri, 28 Oct 2022 17:48:01 GMT
- Title: Learning Modular Simulations for Homogeneous Systems
- Authors: Jayesh K. Gupta, Sai Vemprala, Ashish Kapoor
- Abstract summary: We present a modular simulation framework for modeling homogeneous multibody dynamical systems.
An arbitrary number of modules can be combined to simulate systems of a variety of coupling topologies.
We show that our models can be transferred to new system configurations lower with data requirement and training effort, compared to those trained from scratch.
- Score: 23.355189771765644
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Complex systems are often decomposed into modular subsystems for engineering
tractability. Although various equation based white-box modeling techniques
make use of such structure, learning based methods have yet to incorporate
these ideas broadly. We present a modular simulation framework for modeling
homogeneous multibody dynamical systems, which combines ideas from graph neural
networks and neural differential equations. We learn to model the individual
dynamical subsystem as a neural ODE module. Full simulation of the composite
system is orchestrated via spatio-temporal message passing between these
modules. An arbitrary number of modules can be combined to simulate systems of
a wide variety of coupling topologies. We evaluate our framework on a variety
of systems and show that message passing allows coordination between multiple
modules over time for accurate predictions and in certain cases, enables
zero-shot generalization to new system configurations. Furthermore, we show
that our models can be transferred to new system configurations with lower data
requirement and training effort, compared to those trained from scratch.
Related papers
- Learning System Dynamics without Forgetting [60.08612207170659]
Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology.
We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics.
We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
arXiv Detail & Related papers (2024-06-30T14:55:18Z) - Learnable & Interpretable Model Combination in Dynamic Systems Modeling [0.0]
We discuss which types of models are usually combined and propose a model interface that is capable of expressing a variety of mixed equation based models.
We propose a new wildcard topology, that is capable of describing the generic connection between two combined models in an easy to interpret fashion.
The contributions of this paper are highlighted at a proof of concept: Different connection topologies between two models are learned, interpreted and compared.
arXiv Detail & Related papers (2024-06-12T11:17:11Z) - Modular Deep Learning [120.36599591042908]
Transfer learning has recently become the dominant paradigm of machine learning.
It remains unclear how to develop models that specialise towards multiple tasks without incurring negative interference.
Modular deep learning has emerged as a promising solution to these challenges.
arXiv Detail & Related papers (2023-02-22T18:11:25Z) - Compositional Learning of Dynamical System Models Using Port-Hamiltonian
Neural Networks [32.707730631343416]
We present a framework for learning composite models of dynamical systems from data.
neural network submodels are trained on trajectory data generated by relatively simple subsystems.
We demonstrate the novel capabilities of the proposed framework through numerical examples.
arXiv Detail & Related papers (2022-12-01T22:22:38Z) - ModLaNets: Learning Generalisable Dynamics via Modularity and Physical
Inductive Bias [14.474273671369584]
We propose a structural neural network framework with modularity and physical inductive bias.
This framework models the energy of each element using modularity and then construct the target dynamical system via Lagrangian mechanics.
We examine our framework for modelling double-pendulum or three-body systems with small training datasets.
arXiv Detail & Related papers (2022-06-24T14:54:25Z) - Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks [53.09649785009528]
In this paper, we explore a paradigm that does not require training to obtain new models.
Similar to the birth of CNN inspired by receptive fields in the biological visual system, we propose Model Disassembling and Assembling.
For model assembling, we present the alignment padding strategy and parameter scaling strategy to construct a new model tailored for a specific task.
arXiv Detail & Related papers (2022-03-25T05:27:28Z) - Constructing Neural Network-Based Models for Simulating Dynamical
Systems [59.0861954179401]
Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system.
This paper provides a survey of the different ways to construct models of dynamical systems using neural networks.
In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome.
arXiv Detail & Related papers (2021-11-02T10:51:42Z) - S2RMs: Spatially Structured Recurrent Modules [105.0377129434636]
We take a step towards exploiting dynamic structure that are capable of simultaneously exploiting both modular andtemporal structures.
We find our models to be robust to the number of available views and better capable of generalization to novel tasks without additional training.
arXiv Detail & Related papers (2020-07-13T17:44:30Z) - Learning Stable Deep Dynamics Models [91.90131512825504]
We propose an approach for learning dynamical systems that are guaranteed to be stable over the entire state space.
We show that such learning systems are able to model simple dynamical systems and can be combined with additional deep generative models to learn complex dynamics.
arXiv Detail & Related papers (2020-01-17T00:04:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.