Divide and Rule: Recurrent Partitioned Network for Dynamic Processes
- URL: http://arxiv.org/abs/2106.00258v1
- Date: Tue, 1 Jun 2021 06:45:56 GMT
- Title: Divide and Rule: Recurrent Partitioned Network for Dynamic Processes
- Authors: Qianyu Feng, Bang Zhang, Yi Yang
- Abstract summary: Many dynamic processes are involved with interacting variables, from physical systems to sociological analysis.
Our goal is to represent a system with a part-whole hierarchy and discover the implied dependencies among intra-system variables.
The proposed architecture consists of (i) a perceptive module that extracts a hierarchical and temporally consistent representation of the observation at multiple levels, (ii) a deductive module for determining the relational connection between neurons at each level, and (iii) a statistical module that can predict the future by conditioning on the temporal distributional estimation.
- Score: 25.855428321990328
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In general, many dynamic processes are involved with interacting variables,
from physical systems to sociological analysis. The interplay of components in
the system can give rise to confounding dynamic behavior. Many approaches model
temporal sequences holistically ignoring the internal interaction which are
impotent in capturing the protogenic actuation. Differently, our goal is to
represent a system with a part-whole hierarchy and discover the implied
dependencies among intra-system variables: inferring the interactions that
possess causal effects on the sub-system behavior with REcurrent partItioned
Network (REIN). The proposed architecture consists of (i) a perceptive module
that extracts a hierarchical and temporally consistent representation of the
observation at multiple levels, (ii) a deductive module for determining the
relational connection between neurons at each level, and (iii) a statistical
module that can predict the future by conditioning on the temporal
distributional estimation. Our model is demonstrated to be effective in
identifying the componential interactions with limited observation and stable
in long-term future predictions experimented with diverse physical systems.
Related papers
- Behavior-Inspired Neural Networks for Relational Inference [3.7219180084857473]
Recent works learn to categorize relationships between agents based on observations of their physical behavior.
We introduce a level of abstraction between the observable behavior of agents and the latent categories that determine their behavior.
We integrate the physical proximity of agents and their preferences in a nonlinear opinion dynamics model which provides a mechanism to identify mutually exclusive latent categories, predict an agent's evolution in time, and control an agent's physical behavior.
arXiv Detail & Related papers (2024-06-20T21:36:54Z) - Inferring the time-varying coupling of dynamical systems with temporal convolutional autoencoders [0.0]
We introduce Temporal Autoencoders for Causal Inference (TACI)
TACI combines a new surrogate data metric for assessing causal interactions with a novel two-headed machine learning architecture.
We demonstrate TACI's ability to accurately quantify dynamic causal interactions across a variety of systems.
arXiv Detail & Related papers (2024-06-05T12:51:20Z) - Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
In this study, we first construct the brain-effective network via the dynamic causal model.
We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE)
This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
arXiv Detail & Related papers (2024-05-21T20:37:07Z) - LINOCS: Lookahead Inference of Networked Operators for Continuous Stability [4.508868068781057]
We introduce Lookahead-driven Inference of Networked Operators for Continuous Stability (LINOCS)
LINOCS is a robust learning procedure for identifying hidden dynamical interactions in noisy time-series data.
We demonstrate LINOCS' ability to recover the ground truth dynamical operators underlying synthetic time-series data.
arXiv Detail & Related papers (2024-04-28T18:16:58Z) - Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent
Dynamical Systems [70.84976977950075]
Real-world multi-agent systems are often dynamic and continuous, where the agents co-evolve and undergo changes in their trajectories and interactions over time.
We propose a novel model that captures the continuous interaction among agents using a Graph Neural Network (GNN) as the ODE function.
The key innovation of our model is to learn time-dependent representations of treatments and incorporate them into the ODE function, enabling precise predictions of potential outcomes.
arXiv Detail & Related papers (2024-02-29T23:07:07Z) - Diffusion model for relational inference [2.83334745695045]
We propose a financial price model for systems with observable dynamics.
DiffRI learns to infer the probability of presence of connections between components through conditional diffusion modeling.
arXiv Detail & Related papers (2024-01-30T05:25:02Z) - Inferring Relational Potentials in Interacting Systems [56.498417950856904]
We propose Neural Interaction Inference with Potentials (NIIP) as an alternative approach to discover such interactions.
NIIP assigns low energy to the subset of trajectories which respect the relational constraints observed.
It allows trajectory manipulation, such as interchanging interaction types across separately trained models, as well as trajectory forecasting.
arXiv Detail & Related papers (2023-10-23T00:44:17Z) - Learning Interaction Variables and Kernels from Observations of
Agent-Based Systems [14.240266845551488]
We propose a learning technique that, given observations of states and velocities along trajectories of agents, yields both the variables upon which the interaction kernel depends and the interaction kernel itself.
This yields an effective dimension reduction which avoids the curse of dimensionality from the high-dimensional observation data.
We demonstrate the learning capability of our method to a variety of first-order interacting systems.
arXiv Detail & Related papers (2022-08-04T16:31:01Z) - Capturing Actionable Dynamics with Structured Latent Ordinary
Differential Equations [68.62843292346813]
We propose a structured latent ODE model that captures system input variations within its latent representation.
Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
arXiv Detail & Related papers (2022-02-25T20:00:56Z) - Multi-Agent Imitation Learning with Copulas [102.27052968901894]
Multi-agent imitation learning aims to train multiple agents to perform tasks from demonstrations by learning a mapping between observations and actions.
In this paper, we propose to use copula, a powerful statistical tool for capturing dependence among random variables, to explicitly model the correlation and coordination in multi-agent systems.
Our proposed model is able to separately learn marginals that capture the local behavioral patterns of each individual agent, as well as a copula function that solely and fully captures the dependence structure among agents.
arXiv Detail & Related papers (2021-07-10T03:49:41Z) - Causal Discovery in Physical Systems from Videos [123.79211190669821]
Causal discovery is at the core of human cognition.
We consider the task of causal discovery from videos in an end-to-end fashion without supervision on the ground-truth graph structure.
arXiv Detail & Related papers (2020-07-01T17:29:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.