Multi-Head Residual-Gated DeepONet for Coherent Nonlinear Wave Dynamics

• URL: http://arxiv.org/abs/2604.11972v1
• Date: Mon, 13 Apr 2026 19:05:49 GMT
• Title: Multi-Head Residual-Gated DeepONet for Coherent Nonlinear Wave Dynamics
• Abstract summary: Coherent nonlinear wave dynamics are strongly shaped by a compact set of physically meaningful descriptors of the initial state.<n>Here we introduce a different paradigm, loosely inspired by the complementary roles of state evolution and physically meaningful observables in quantum mechanics.<n>We develop a Multi-Head Residual-Gated DeepONet (MH-RG), which combines a pre-branch residual modulator, a branch residual gate, and a trunk residual gate.
• Score: 3.108753350611607
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Coherent nonlinear wave dynamics are often strongly shaped by a compact set of physically meaningful descriptors of the initial state. Traditional neural operators typically treat the input-output mapping as a largely black-box high-dimensional regression problem, without explicitly exploiting this structured physical context. Common feature-integration strategies usually rely on direct concatenation or FiLM-style affine modulation in hidden latent spaces. Here we introduce a different paradigm, loosely inspired by the complementary roles of state evolution and physically meaningful observables in quantum mechanics: the wave field is learned through a standard DeepONet state pathway, while compact physical descriptors follow a parallel conditioning pathway and act as residual modulation factors on the state prediction. Based on this idea, we develop a Multi-Head Residual-Gated DeepONet (MH-RG), which combines a pre-branch residual modulator, a branch residual gate, and a trunk residual gate with a low-rank multi-head mechanism to capture multiple complementary conditioned response patterns without prohibitive parameter growth. We evaluate the framework on representative benchmarks including highly nonlinear conservative wave dynamics and dissipative trapped dynamics and further perform detailed mechanistic analyses of the learned multi-head gating behavior. Compared with feature-augmented baselines, MH-RG DeepONet achieves consistently lower error while better preserving phase coherence and the fidelity of physically relevant dynamical quantities.

Related papers

• Explainable quantum-compressed machine learning for complex fluid flows [1.418331888050121]
  We introduce quantum-compressed machine learning (QCML) for machine learning surrogates of physical systems.<n>QCML makes the surrogate directly interpretable and controllable without sacrificing expressivity.<n>These results establish QCML as a working component of scientific machine learning and a concrete contribution towards practical quantum advantage in real-world prediction.
  arXiv  Detail & Related papers  (2026-07-23T15:05:04Z)
• Hidden Gauge Freedom in Complex-Pole Hierarchical Equations of Motion [0.0]
  We report a previously unknown gauge freedom in complex-pole HEOM.<n>This gauge controls both the eigenspectrum and non-normality of the hierarchy generator.<n>We extend numerically exact simulations of sub-Ohmic dynamics to previously inaccessible coupling strengths.
  arXiv  Detail & Related papers  (2026-07-06T09:08:52Z)
• Controlled Dynamics Attractor Transformer [58.15454173718687]
  Transformer architectures have advanced representation learning and inference in deep models through self-attention mechanisms.<n>In parallel,associative memory (AM) frameworks map representations onto energy landscapes, offering interpretable retrieval mechanisms.<n>We propose Controlled Dynamics Attractor Transformer (CCAT), which couples a mixture von Mises-Fisher (Mo-vMF) attention energy with a Hopfield refinement energy.<n>CCAT achieves state-of-the-art performance across multiple benchmarks in graph anomaly detection and graph classification.
  arXiv  Detail & Related papers  (2026-06-13T09:04:22Z)
• Imaginary Gauge Field and Non-Hermitian Topological Transition Emerging Through Attenuation-Gauge Duality in Conservative Systems [2.4065240342323384]
  Non-Hermitian physics traditionally relies on active gain--loss modulation or non-reciprocal couplings.<n>We propose an attenuation-gauge duality paradigm in which non-Hermitian topology emerges within fully passive, conservative systems.
  arXiv  Detail & Related papers  (2026-03-18T10:04:21Z)
• OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoning [51.33849811496781]
  Large Language Models (LLMs) have demonstrated exceptional logical reasoning capabilities but frequently struggle with the continuous dynamics by Partial Differential Equations (PDEs)<n>We propose OMNIFLOW, a multimodal-symbolic architecture designed to ground frozen LLMs in fundamental physical laws without requiring domain-specific parameter updates.<n>We evaluate it on a benchmark spanning microscopic turbulence, theoretical Navier-Stokes, and macroscopic global weather forecasting.
  arXiv  Detail & Related papers  (2026-03-16T18:29:01Z)
• KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra [65.11254608352982]
  We introduce a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators.<n>By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation.
  arXiv  Detail & Related papers  (2026-02-15T06:32:23Z)
• Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits [72.0643009153473]
  We show that expressive variational ansatze enter a Haar-like universality class in which both observable expectation values and parameter gradients concentrate exponentially with system size.<n>As a consequence, the hypothesis class induced by such circuits collapses with high probability to a narrow family of near-constant functions.<n>We further show that this collapse is not unavoidable: tensor-structured VQCs, including tensor-network-based and tensor-hypernetwork parameterizations, lie outside the Haar-like universality class.
  arXiv  Detail & Related papers  (2026-01-05T08:04:33Z)
• Variational Physics-Informed Ansatz for Reconstructing Hidden Interaction Networks from Steady States [0.0]
  We propose a Variational Physics-Informed Ansatz (VPIA) that infers general interaction operators directly from heterogeneous steady-state data.<n>VPIA embeds the steady-state constraints of the dynamics into a differentiable variational representation.<n>It reconstructs the underlying couplings by minimizing a physics-derived steady-state residual.
  arXiv  Detail & Related papers  (2025-12-06T08:16:32Z)
• Entanglement and optimization within autoregressive neural quantum states [3.318269729347296]
  Neural quantum states (NQS) are powerful variational ans"atze capable of representing highly entangled quantum many-body wavefunctions.<n>We perform large-scale simulations of ensembles of random autoregressive wavefunctions for chains of up to $256$ spins.<n>We uncover signatures of transitions in their average entanglement scaling, entanglement spectra, and correlation functions.
  arXiv  Detail & Related papers  (2025-09-15T18:59:19Z)
• Dynamics with autoregressive neural quantum states: application to critical quench dynamics [41.94295877935867]
  We present an alternative general scheme that enables one to capture long-time dynamics of quantum systems in a stable fashion. We apply the scheme to time-dependent quench dynamics by investigating the Kibble-Zurek mechanism in the two-dimensional quantum Ising model.
  arXiv  Detail & Related papers  (2022-09-07T15:50:00Z)
• An Ode to an ODE [78.97367880223254]
  We present a new paradigm for Neural ODE algorithms, called ODEtoODE, where time-dependent parameters of the main flow evolve according to a matrix flow on the group O(d) This nested system of two flows provides stability and effectiveness of training and provably solves the gradient vanishing-explosion problem.
  arXiv  Detail & Related papers  (2020-06-19T22:05:19Z)
• Kernel and Rich Regimes in Overparametrized Models [69.40899443842443]
  We show that gradient descent on overparametrized multilayer networks can induce rich implicit biases that are not RKHS norms. We also demonstrate this transition empirically for more complex matrix factorization models and multilayer non-linear networks.
  arXiv  Detail & Related papers  (2020-02-20T15:43:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.