Autonomous Discovery of the Ising Model's Critical Parameters with Reinforcement Learning

• URL: http://arxiv.org/abs/2601.05577v1
• Date: Fri, 09 Jan 2026 06:55:02 GMT
• Title: Autonomous Discovery of the Ising Model's Critical Parameters with Reinforcement Learning
• Authors: Hai Man, Chaobo Wang, Jia-Rui Li, Yuping Tian, Shu-Gang Chen,
• Abstract summary: This research introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical environments.<n>Our algorithm exhibits search behavior reminiscent of phase transitions, efficiently converging to target parameters regardless of initial conditions.
• Score: 7.2581513446221315
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traditional methods for determining critical parameters are often influenced by human factors. This research introduces a physics-inspired adaptive reinforcement learning framework that enables agents to autonomously interact with physical environments, simultaneously identifying both the critical temperature and various types of critical exponents in the Ising model with precision. Interestingly, our algorithm exhibits search behavior reminiscent of phase transitions, efficiently converging to target parameters regardless of initial conditions. Experimental results demonstrate that this method significantly outperforms traditional approaches, particularly in environments with strong perturbations. This study not only incorporates physical concepts into machine learning to enhance algorithm interpretability but also establishes a new paradigm for scientific exploration, transitioning from manual analysis to autonomous AI discovery.

Related papers

• An Attention-based Spatio-Temporal Neural Operator for Evolving Physics [15.451874867285957]
  Key challenge in machine learning is learning unknown physical processes and making predictions across real-scales.<n>We propose Attention-based S-Temporal Neural Operator (ASNO), a novel architecture that combines separable attention mechanisms for spatial and temporal interactions.<n>ASNO learns a transformer for temporal prediction and adapts to unseen physical parameters, enhancing interpretability by historical state contributions.
  arXiv  Detail & Related papers  (2025-06-12T21:54:47Z)
• Parameter Estimation using Reinforcement Learning Causal Curiosity: Limits and Challenges [6.872096639211664]
  Causal Curiosity aims to estimate as accurately and efficiently as possible, without directly measuring them.<n>We present for the first time a measurement accuracy analysis of the future potentials and current limitations of this technique.<n>As a result of our work, we promote proposals for an improved and efficient design of Causal Curiosity methods.
  arXiv  Detail & Related papers  (2025-05-13T11:30:51Z)
• A Symbolic and Statistical Learning Framework to Discover Bioprocessing Regulatory Mechanism: Cell Culture Example [2.325005809983534]
  This paper introduces a symbolic and statistical learning framework to identify key regulatory mechanisms and model uncertainty.<n>A Metropolis-adjusted Langevin algorithm with adjoint sensitivity analysis is developed for posterior exploration.<n>An empirical study demonstrates its ability to recover missing regulatory mechanisms and improve model fidelity under datalimited conditions.
  arXiv  Detail & Related papers  (2025-05-06T04:39:34Z)
• Towards Physically Consistent Deep Learning For Climate Model Parameterizations [46.07009109585047]
  parameterizations are a major source of systematic errors and large uncertainties in climate projections. Deep learning (DL)-based parameterizations, trained on data from computationally expensive short, high-resolution simulations, have shown great promise for improving climate models. We propose an efficient supervised learning framework for DL-based parameterizations that leads to physically consistent models.
  arXiv  Detail & Related papers  (2024-06-06T10:02:49Z)
• Deep Learning-based Analysis of Basins of Attraction [49.812879456944984]
  This research addresses the challenge of characterizing the complexity and unpredictability of basins within various dynamical systems. The main focus is on demonstrating the efficiency of convolutional neural networks (CNNs) in this field.
  arXiv  Detail & Related papers  (2023-09-27T15:41:12Z)
• Learning minimal representations of stochastic processes with variational autoencoders [52.99137594502433]
  We introduce an unsupervised machine learning approach to determine the minimal set of parameters required to describe a process. Our approach enables for the autonomous discovery of unknown parameters describing processes.
  arXiv  Detail & Related papers  (2023-07-21T14:25:06Z)
• AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios [51.94807626839365]
  We propose the attention-inspired numerical solver (AttNS) to solve differential equations due to limited data.<n>AttNS is inspired by the effectiveness of attention modules in Residual Neural Networks (ResNet) in enhancing model generalization and robustness.
  arXiv  Detail & Related papers  (2023-02-05T01:39:21Z)
• Latent Variable Representation for Reinforcement Learning [131.03944557979725]
  It remains unclear theoretically and empirically how latent variable models may facilitate learning, planning, and exploration to improve the sample efficiency of model-based reinforcement learning. We provide a representation view of the latent variable models for state-action value functions, which allows both tractable variational learning algorithm and effective implementation of the optimism/pessimism principle. In particular, we propose a computationally efficient planning algorithm with UCB exploration by incorporating kernel embeddings of latent variable models.
  arXiv  Detail & Related papers  (2022-12-17T00:26:31Z)
• Improving robustness of jet tagging algorithms with adversarial training [56.79800815519762]
  We investigate the vulnerability of flavor tagging algorithms via application of adversarial attacks. We present an adversarial training strategy that mitigates the impact of such simulated attacks.
  arXiv  Detail & Related papers  (2022-03-25T19:57:19Z)
• Learning Neural Causal Models with Active Interventions [83.44636110899742]
  We introduce an active intervention-targeting mechanism which enables a quick identification of the underlying causal structure of the data-generating process. Our method significantly reduces the required number of interactions compared with random intervention targeting. We demonstrate superior performance on multiple benchmarks from simulated to real-world data.
  arXiv  Detail & Related papers  (2021-09-06T13:10:37Z)
• Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
  Inferring the parameters of a model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations. We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
  arXiv  Detail & Related papers  (2021-02-12T12:23:13Z)
• Automatic Differentiation and Continuous Sensitivity Analysis of Rigid Body Dynamics [15.565726546970678]
  We introduce a differentiable physics simulator for rigid body dynamics. In the context of trajectory optimization, we introduce a closed-loop model-predictive control algorithm.
  arXiv  Detail & Related papers  (2020-01-22T03:54:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.