Denoising Hamiltonian Network for Physical Reasoning

• URL: http://arxiv.org/abs/2503.07596v1
• Date: Mon, 10 Mar 2025 17:57:01 GMT
• Title: Denoising Hamiltonian Network for Physical Reasoning
• Authors: Congyue Deng, Brandon Y. Feng, Cecilia Garraffo, Alan Garbarz, Robin Walters, William T. Freeman, Leonidas Guibas, Kaiming He,
• Abstract summary: Denoising Hamiltonian Network (DHN) is a novel framework that generalizes Hamiltonian mechanics operators into more flexible neural operators.<n>DHN captures non-local temporal relationships and mitigates numerical integration errors through a denoising mechanism.<n>We demonstrate its effectiveness and flexibility across three diverse physical reasoning tasks with distinct inputs and outputs.
• Score: 41.88573341335723
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning frameworks for physical problems must capture and enforce physical constraints that preserve the structure of dynamical systems. Many existing approaches achieve this by integrating physical operators into neural networks. While these methods offer theoretical guarantees, they face two key limitations: (i) they primarily model local relations between adjacent time steps, overlooking longer-range or higher-level physical interactions, and (ii) they focus on forward simulation while neglecting broader physical reasoning tasks. We propose the Denoising Hamiltonian Network (DHN), a novel framework that generalizes Hamiltonian mechanics operators into more flexible neural operators. DHN captures non-local temporal relationships and mitigates numerical integration errors through a denoising mechanism. DHN also supports multi-system modeling with a global conditioning mechanism. We demonstrate its effectiveness and flexibility across three diverse physical reasoning tasks with distinct inputs and outputs.

Related papers

• Connecting the geometry and dynamics of many-body complex systems with message passing neural operators [1.8434042562191815]
  We introduce a scalable AI framework, ROMA, for learning multiscale evolution operators of many-body complex systems. An attention mechanism is used to model multiscale interactions by connecting geometric representations of local subgraphs and dynamical operators. We demonstrate that the ROMA framework improves scalability and positive transfer between forecasting and effective dynamics tasks.
  arXiv  Detail & Related papers  (2025-02-21T20:04:09Z)
• Multi-Physics Simulations via Coupled Fourier Neural Operator [9.839064047196114]
  We introduce a novel coupled multi-physics neural operator learning (COMPOL) framework to model interactions among multiple physical processes.<n>Our approach implements feature aggregation through recurrent and attention mechanisms, enabling comprehensive modeling of coupled interactions.<n>Our proposed model demonstrates a two to three-fold improvement in predictive performance compared to existing approaches.
  arXiv  Detail & Related papers  (2025-01-28T20:58:55Z)
• Effective Many-body Interactions in Reduced-Dimensionality Spaces Through Neural Network Models [4.955567578189708]
  We develop a framework that integrates recent advances in the development of active-space representations of Hamiltonians with neural network approaches. The primary objective of this effort is to train neural networks to eliminate the computationally expensive steps required for evaluating hundreds or thousands of Hugen diagrams. We demonstrate that training neural networks employing effective Hamiltonians for a few nuclear geometries of molecules can accurately interpolate/ extrapolate their forms to other geometrical configurations.
  arXiv  Detail & Related papers  (2024-07-08T00:56:24Z)
• Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
  We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations. Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
  arXiv  Detail & Related papers  (2024-02-20T15:23:24Z)
• Deciphering and integrating invariants for neural operator learning with various physical mechanisms [22.508244510177683]
  We propose Physical Invariant Attention Neural Operator (PIANO) to decipher and integrate the physical invariants (PI) for operator learning from the PDE series with various physical mechanisms. Compared to existing techniques, PIANO can reduce the relative error by 13.6%-82.2% on PDE forecasting tasks across varying coefficients, forces, or boundary conditions.
  arXiv  Detail & Related papers  (2023-11-24T09:03:52Z)
• Persistent-Transient Duality: A Multi-mechanism Approach for Modeling Human-Object Interaction [58.67761673662716]
  Humans are highly adaptable, swiftly switching between different modes to handle different tasks, situations and contexts. In Human-object interaction (HOI) activities, these modes can be attributed to two mechanisms: (1) the large-scale consistent plan for the whole activity and (2) the small-scale children interactive actions that start and end along the timeline. This work proposes to model two concurrent mechanisms that jointly control human motion.
  arXiv  Detail & Related papers  (2023-07-24T12:21:33Z)
• AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios [51.94807626839365]
  We propose the attention-inspired numerical solver (AttNS) to solve differential equations due to limited data.<n>AttNS is inspired by the effectiveness of attention modules in Residual Neural Networks (ResNet) in enhancing model generalization and robustness.
  arXiv  Detail & Related papers  (2023-02-05T01:39:21Z)
• Learning Physical Dynamics with Subequivariant Graph Neural Networks [99.41677381754678]
  Graph Neural Networks (GNNs) have become a prevailing tool for learning physical dynamics. Physical laws abide by symmetry, which is a vital inductive bias accounting for model generalization. Our model achieves on average over 3% enhancement in contact prediction accuracy across 8 scenarios on Physion and 2X lower rollout MSE on RigidFall.
  arXiv  Detail & Related papers  (2022-10-13T10:00:30Z)
• Dynamics with autoregressive neural quantum states: application to critical quench dynamics [41.94295877935867]
  We present an alternative general scheme that enables one to capture long-time dynamics of quantum systems in a stable fashion. We apply the scheme to time-dependent quench dynamics by investigating the Kibble-Zurek mechanism in the two-dimensional quantum Ising model.
  arXiv  Detail & Related papers  (2022-09-07T15:50:00Z)
• Pessimism meets VCG: Learning Dynamic Mechanism Design via Offline Reinforcement Learning [114.36124979578896]
  We design a dynamic mechanism using offline reinforcement learning algorithms. Our algorithm is based on the pessimism principle and only requires a mild assumption on the coverage of the offline data set.
  arXiv  Detail & Related papers  (2022-05-05T05:44:26Z)
• Equivariant Graph Mechanics Networks with Constraints [83.38709956935095]
  We propose Graph Mechanics Network (GMN) which is efficient, equivariant and constraint-aware. GMN represents, by generalized coordinates, the forward kinematics information (positions and velocities) of a structural object. Extensive experiments support the advantages of GMN compared to the state-of-the-art GNNs in terms of prediction accuracy, constraint satisfaction and data efficiency.
  arXiv  Detail & Related papers  (2022-03-12T14:22:14Z)
• Nonseparable Symplectic Neural Networks [23.77058934710737]
  We propose a novel neural network architecture, Nonseparable Symplectic Neural Networks (NSSNNs) NSSNNs uncover and embed the symplectic structure of a nonseparable Hamiltonian system from limited observation data. We show the unique computational merits of our approach to yield long-term, accurate, and robust predictions for large-scale Hamiltonian systems.
  arXiv  Detail & Related papers  (2020-10-23T19:50:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.