Explicit Discovery of Nonlinear Symmetries from Dynamic Data

• URL: http://arxiv.org/abs/2510.01855v1
• Date: Thu, 02 Oct 2025 09:54:08 GMT
• Title: Explicit Discovery of Nonlinear Symmetries from Dynamic Data
• Authors: Lexiang Hu, Yikang Li, Zhouchen Lin,
• Abstract summary: LieNLSD is the first method capable of determining the number of infinitesimal generators with nonlinear terms and their explicit expressions.<n>LieNLSD shows qualitative advantages over existing methods and improves the long rollout accuracy of neural PDE solvers by over 20%.
• Score: 50.20526548924647
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Symmetry is widely applied in problems such as the design of equivariant networks and the discovery of governing equations, but in complex scenarios, it is not known in advance. Most previous symmetry discovery methods are limited to linear symmetries, and recent attempts to discover nonlinear symmetries fail to explicitly get the Lie algebra subspace. In this paper, we propose LieNLSD, which is, to our knowledge, the first method capable of determining the number of infinitesimal generators with nonlinear terms and their explicit expressions. We specify a function library for the infinitesimal group action and aim to solve for its coefficient matrix, proving that its prolongation formula for differential equations, which governs dynamic data, is also linear with respect to the coefficient matrix. By substituting the central differences of the data and the Jacobian matrix of the trained neural network into the infinitesimal criterion, we get a system of linear equations for the coefficient matrix, which can then be solved using SVD. On top quark tagging and a series of dynamic systems, LieNLSD shows qualitative advantages over existing methods and improves the long rollout accuracy of neural PDE solvers by over 20% while applying to guide data augmentation. Code and data are available at https://github.com/hulx2002/LieNLSD.

Related papers

• Disordered Dynamics in High Dimensions: Connections to Random Matrices and Machine Learning [52.26396748560348]
  We provide an overview of high dimensional dynamical systems driven by random matrices.<n>We focus on applications to simple models of learning and generalization in machine learning theory.
  arXiv  Detail & Related papers  (2026-01-03T00:12:32Z)
• Symmetry Discovery for Different Data Types [52.2614860099811]
  Equivariant neural networks incorporate symmetries into their architecture, achieving higher generalization performance. We propose LieSD, a method for discovering symmetries via trained neural networks which approximate the input-output mappings of the tasks. We validate the performance of LieSD on tasks with symmetries such as the two-body problem, the moment of inertia matrix prediction, and top quark tagging.
  arXiv  Detail & Related papers  (2024-10-13T13:39:39Z)
• Symmetry-Informed Governing Equation Discovery [29.16110821783827]
  We propose to leverage symmetry in automated equation discovery to compress the equation search space and improve the accuracy and simplicity of the learned equations. Our approach demonstrates better robustness against noise and recovers governing equations with significantly higher probability than baselines without symmetry.
  arXiv  Detail & Related papers  (2024-05-27T01:58:23Z)
• Latent Space Symmetry Discovery [31.28537696897416]
  We propose a novel generative model, Latent LieGAN, which can discover symmetries of nonlinear group actions. We show that our model can express nonlinear symmetries under some conditions about the group action. LaLiGAN also results in a well-structured latent space that is useful for downstream tasks including equation discovery and long-term forecasting.
  arXiv  Detail & Related papers  (2023-09-29T19:33:01Z)
• Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nystr\"om method [14.470859959783995]
  Asymmetric data naturally exist in real life, such as directed graphs. This paper tackles the asymmetric kernel-based learning problem. Experiments show that asymmetric KSVD learns features outperforming Mercer- Kernel.
  arXiv  Detail & Related papers  (2023-06-12T11:39:34Z)
• Oracle-Preserving Latent Flows [58.720142291102135]
  We develop a methodology for the simultaneous discovery of multiple nontrivial continuous symmetries across an entire labelled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to transformations invariant with respect to high-dimensional oracles.
  arXiv  Detail & Related papers  (2023-02-02T00:13:32Z)
• Towards Neural Sparse Linear Solvers [0.0]
  We propose neural sparse linear solvers to learn approximate solvers for sparse symmetric linear systems. Our method relies on representing a sparse symmetric linear system as an undirected weighted graph. We test sparse linear solvers on static linear analysis problems from structural engineering.
  arXiv  Detail & Related papers  (2022-03-14T09:17:02Z)
• Nonlinear Isometric Manifold Learning for Injective Normalizing Flows [58.720142291102135]
  We use isometries to separate manifold learning and density estimation. We also employ autoencoders to design embeddings with explicit inverses that do not distort the probability distribution.
  arXiv  Detail & Related papers  (2022-03-08T08:57:43Z)
• Understanding Implicit Regularization in Over-Parameterized Single Index Model [55.41685740015095]
  We design regularization-free algorithms for the high-dimensional single index model. We provide theoretical guarantees for the induced implicit regularization phenomenon.
  arXiv  Detail & Related papers  (2020-07-16T13:27:47Z)
• WICA: nonlinear weighted ICA [72.02008296553318]
  Independent Component Analysis (ICA) aims to find a coordinate system in which the components of the data are independent. We construct a new nonlinear ICA model, called WICA, which obtains better and more stable results than other algorithms.
  arXiv  Detail & Related papers  (2020-01-13T10:38:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.