Alternating ConvLSTM: Learning Force Propagation with Alternate State Updates

• URL: http://arxiv.org/abs/2006.07818v1
• Date: Sun, 14 Jun 2020 06:43:33 GMT
• Title: Alternating ConvLSTM: Learning Force Propagation with Alternate State Updates
• Authors: Congyue Deng, Tai-Jiang Mu, Shi-Min Hu
• Abstract summary: We introduce the alternating convolutional Long Short-Term Memory (Alt-ConvLSTM) that models the force propagation mechanisms in a deformable object with near-uniform material properties. We demonstrate how this novel scheme imitates the alternate updates of the first and second-order terms in the forward method of numerical PDE solvers. We validate our Alt-ConvLSTM on human soft tissue simulation with thousands of particles and consistent body pose changes.
• Score: 29.011464047344614
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Data-driven simulation is an important step-forward in computational physics when traditional numerical methods meet their limits. Learning-based simulators have been widely studied in past years; however, most previous works view simulation as a general spatial-temporal prediction problem and take little physical guidance in designing their neural network architectures. In this paper, we introduce the alternating convolutional Long Short-Term Memory (Alt-ConvLSTM) that models the force propagation mechanisms in a deformable object with near-uniform material properties. Specifically, we propose an accumulation state, and let the network update its cell state and the accumulation state alternately. We demonstrate how this novel scheme imitates the alternate updates of the first and second-order terms in the forward Euler method of numerical PDE solvers. Benefiting from this, our network only requires a small number of parameters, independent of the number of the simulated particles, and also retains the essential features in ConvLSTM, making it naturally applicable to sequential data with spatial inputs and outputs. We validate our Alt-ConvLSTM on human soft tissue simulation with thousands of particles and consistent body pose changes. Experimental results show that Alt-ConvLSTM efficiently models the material kinetic features and greatly outperforms vanilla ConvLSTM with only the single state update.

Related papers

• SMART: Scalable Mesh-free Aerodynamic Simulations from Raw Geometries using a Transformer-based Surrogate Model [22.03373840985233]
  Machine learning-based surrogate models have emerged as more efficient alternatives to numerical solvers for physical simulations over complex geometries, such as car bodies.<n>We introduce SMART, a neural surrogate model that predicts physical quantities at arbitrary query locations using only a point-cloud representation of the geometry, without requiring access to the simulation mesh.<n>Extensive experiments show that SMART is competitive with and often outperforms existing methods that rely on the simulation mesh as input, demonstrating its capabilities for industry-level simulations.
  arXiv  Detail & Related papers  (2026-01-26T17:34:16Z)
• Towards Spatio-Temporal Extrapolation of Phase-Field Simulations with Convolution-Only Neural Networks [0.4104352271917983]
  We introduce a fully convolutional, conditionally parameterized U-Net surrogate to extrapolate far beyond its training data in both space and time.<n>Our framework can also deliver speed-ups of up to 36,000 times, bringing the time to run weeks-long simulations down to a few seconds.
  arXiv  Detail & Related papers  (2026-01-08T02:25:14Z)
• NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos [80.0365394106039]
  We present NeuSpring, a neural spring field for the reconstruction and simulation of deformable objects from videos.<n> Experiments on real-world datasets demonstrate that our NeuSping achieves superior reconstruction and simulation performance for current state modeling and future prediction.
  arXiv  Detail & Related papers  (2025-11-11T14:40:09Z)
• Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning [20.72669976554826]
  Learned Graph Network Simulators (GNSs) offer a promising alternative to traditional mesh-based physics simulators.<n>Their speed and inherent differentiability make them well suited for applications that require fast and accurate simulations, such as robotic manipulation or manufacturing optimization.<n>We utilize movement primitives to directly predict fast, stable and accurate simulations from a single model call.
  arXiv  Detail & Related papers  (2025-11-07T13:34:02Z)
• MaNGO - Adaptable Graph Network Simulators via Meta-Learning [25.80703650406406]
  Graph Network Simulators (GNSs) offer faster inference but suffer from two key limitations.<n>They must be retrained from scratch for even minor variations in physical parameters.<n>This is inefficient, as simulations with varying parameters often share a common underlying latent structure.<n>We propose a novel architecture that generates a latent representation by encoding graph trajectories using conditional neural processes.
  arXiv  Detail & Related papers  (2025-10-07T12:44:24Z)
• SIMSHIFT: A Benchmark for Adapting Neural Surrogates to Distribution Shifts [10.815077158164684]
  Domain Adaptation (DA) techniques have been widely used in vision and language processing to generalize from limited information about unseen configurations.<n>We introduce SIMSHIFT, a novel benchmark dataset and evaluation suite composed of four industrial simulation tasks.<n>The goal is to accurately predict target simulations without access to ground truth simulation data.
  arXiv  Detail & Related papers  (2025-06-13T17:56:49Z)
• NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation [41.41450298461784]
  We propose NeuralOM, a general neural operator framework for simulating complex, slow-changing dynamics.<n>We validate NeuralOM on the challenging task of global Subseasonal-to-Seasonal (S2S) ocean simulation.<n>NeuralOM achieves a 13.3% lower RMSE compared to the best-performing baseline.
  arXiv  Detail & Related papers  (2025-05-27T10:54:40Z)
• Hybrid Neural-MPM for Interactive Fluid Simulations in Real-Time [57.30651532625017]
  We present a novel hybrid method that integrates numerical simulation, neural physics, and generative control.<n>Our system demonstrates robust performance across diverse 2D/3D scenarios, material types, and obstacle interactions.<n>We promise to release both models and data upon acceptance.
  arXiv  Detail & Related papers  (2025-05-25T01:27:18Z)
• Flow Matching for Geometric Trajectory Simulation [4.271235935891555]
  N-body systems are a fundamental problem with applications in a wide range of fields, such as molecular dynamics, biochemistry, and pedestrian dynamics.<n>Machine learning has become an invaluable tool for scaling physics-based simulators and developing models directly from experimental data.<n>To generate realistic trajectories, existing methods must learn complex transformations starting from uninformed noise and do not allow for the exploitation of domain-informed priors.<n>We propose STFlow to address this limitation. By leveraging flow matching and data-dependent couplings, STFlow facilitates physics-informed simulation of geometric trajectories without sacrificing model expressivity or scalability.
  arXiv  Detail & Related papers  (2025-05-24T11:18:59Z)
• NeuralCFD: Deep Learning on High-Fidelity Automotive Aerodynamics Simulations [11.849142587216903]
  Key challenges must be overcome before neural network-based simulation surrogates can be implemented at an industry scale. We introduce Geometry-preserving Universal Physics Transformer (GP-UPT), which separates geometry encoding and physics predictions. GP-UPT circumvents the creation of high-quality simulation meshes, enables accurate 3D velocity field predictions at 20 million mesh cells, and excels in transfer learning from low-fidelity to high-fidelity simulation datasets.
  arXiv  Detail & Related papers  (2025-02-13T17:58:07Z)
• GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects [55.02281855589641]
  GausSim is a novel neural network-based simulator designed to capture the dynamic behaviors of real-world elastic objects represented through Gaussian kernels. We leverage continuum mechanics and treat each kernel as a Center of Mass System (CMS) that represents continuous piece of matter. In addition, GausSim incorporates explicit physics constraints, such as mass and momentum conservation, ensuring interpretable results and robust, physically plausible simulations.
  arXiv  Detail & Related papers  (2024-12-23T18:58:17Z)
• A Neural Material Point Method for Particle-based Simulations [5.4346288442609945]
  We present NeuralMPM, a neural emulation framework for particle-based simulations. NeuralMPM interpolates Lagrangian particles onto a fixed-size grid, computes updates on grid nodes using image-to-image neural networks, and interpolates back to the particles. We demonstrate the advantages of NeuralMPM on several datasets, including fluid dynamics and fluid-solid interactions.
  arXiv  Detail & Related papers  (2024-08-28T12:39:51Z)
• Bridging the Sim-to-Real Gap with Bayesian Inference [53.61496586090384]
  We present SIM-FSVGD for learning robot dynamics from data. We use low-fidelity physical priors to regularize the training of neural network models. We demonstrate the effectiveness of SIM-FSVGD in bridging the sim-to-real gap on a high-performance RC racecar system.
  arXiv  Detail & Related papers  (2024-03-25T11:29:32Z)
• Convolutional State Space Models for Long-Range Spatiotemporal Modeling [65.0993000439043]
  ConvS5 is an efficient variant for long-rangetemporal modeling. It significantly outperforms Transformers and ConvNISTTM on a long horizon Moving-Lab experiment while training 3X faster than ConvLSTM and generating samples 400X faster than Transformers.
  arXiv  Detail & Related papers  (2023-10-30T16:11:06Z)
• Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning [0.8250374560598492]
  We propose a deep learning method for predicting displacement fields of soft tissues with viselastic properties. The proposed method achieves a better accuracy over the conventional CNN models. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality.
  arXiv  Detail & Related papers  (2023-01-11T18:17:10Z)
• Multi-fidelity Hierarchical Neural Processes [79.0284780825048]
  Multi-fidelity surrogate modeling reduces the computational cost by fusing different simulation outputs. We propose Multi-fidelity Hierarchical Neural Processes (MF-HNP), a unified neural latent variable model for multi-fidelity surrogate modeling. We evaluate MF-HNP on epidemiology and climate modeling tasks, achieving competitive performance in terms of accuracy and uncertainty estimation.
  arXiv  Detail & Related papers  (2022-06-10T04:54:13Z)
• Analytically Integratable Zero-restlength Springs for Capturing Dynamic Modes unrepresented by Quasistatic Neural Networks [6.601755525003559]
  We present a novel paradigm for modeling certain types of dynamic simulation in real-time with the aid of neural networks. We augment our quasistatic neural network (QNN) inference with a (real-time) dynamic simulation layer. We demonstrate that the spring parameters can be robustly learned from a surprisingly small amount of dynamic simulation data.
  arXiv  Detail & Related papers  (2022-01-25T06:44:15Z)
• A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer [4.80427355202687]
  Recently successful examples on learning slow dynamics by LSTM are given with simulation data of low dimensional reaction coordinate. We show that the following three key factors significantly affect the performance of language model learning, namely dimensionality of reaction coordinates, temporal resolution and state partition.
  arXiv  Detail & Related papers  (2021-07-14T09:26:36Z)
• Deep Bayesian Active Learning for Accelerating Stochastic Simulation [74.58219903138301]
  Interactive Neural Process (INP) is a deep active learning framework for simulations and with active learning approaches. For active learning, we propose a novel acquisition function, Latent Information Gain (LIG), calculated in the latent space of NP based models. The results demonstrate STNP outperforms the baselines in the learning setting and LIG achieves the state-of-the-art for active learning.
  arXiv  Detail & Related papers  (2021-06-05T01:31:51Z)
• Recurrent convolutional neural network for the surrogate modeling of subsurface flow simulation [0.0]
  We propose to combine SegNet with ConvLSTM layers for the surrogate modeling of numerical flow simulation. Results show that the proposed method improves the performance of SegNet based surrogate model remarkably when the output of the simulation is time series data.
  arXiv  Detail & Related papers  (2020-10-08T09:34:48Z)
• Learning to Simulate Complex Physics with Graph Networks [68.43901833812448]
  We present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains. Our framework---which we term "Graph Network-based Simulators" (GNS)--represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time.
  arXiv  Detail & Related papers  (2020-02-21T16:44:28Z)
• Convolutional Tensor-Train LSTM for Spatio-temporal Learning [116.24172387469994]
  We propose a higher-order LSTM model that can efficiently learn long-term correlations in the video sequence. This is accomplished through a novel tensor train module that performs prediction by combining convolutional features across time. Our results achieve state-of-the-art performance-art in a wide range of applications and datasets.
  arXiv  Detail & Related papers  (2020-02-21T05:00:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.