Deep generative modelling of canonical ensemble with differentiable thermal properties

• URL: http://arxiv.org/abs/2404.18404v1
• Date: Mon, 29 Apr 2024 03:41:49 GMT
• Title: Deep generative modelling of canonical ensemble with differentiable thermal properties
• Authors: Shuo-Hui Li, Yao-Wen Zhang, Ding Pan,
• Abstract summary: We propose a variational modelling method with differentiable temperature for canonical ensembles. Using a deep generative model, the free energy is estimated and minimized simultaneously in a continuous temperature range. The training process requires no dataset, and works with arbitrary explicit density generative models.
• Score: 0.9421843976231371
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a variational modelling method with differentiable temperature for canonical ensembles. Using a deep generative model, the free energy is estimated and minimized simultaneously in a continuous temperature range. At optimal, this generative model is a Boltzmann distribution with temperature dependence. The training process requires no dataset, and works with arbitrary explicit density generative models. We applied our method to study the phase transitions (PT) in the Ising and XY models, and showed that the direct-sampling simulation of our model is as accurate as the Markov Chain Monte Carlo (MCMC) simulation, but more efficient. Moreover, our method can give thermodynamic quantities as differentiable functions of temperature akin to an analytical solution. The free energy aligns closely with the exact one to the second-order derivative, so this inclusion of temperature dependence enables the otherwise biased variational model to capture the subtle thermal effects at the PTs. These findings shed light on the direct simulation of physical systems using deep generative models

Related papers

• Energy-Based Diffusion Language Models for Text Generation [126.23425882687195]
  Energy-based Diffusion Language Model (EDLM) is an energy-based model operating at the full sequence level for each diffusion step. Our framework offers a 1.3$times$ sampling speedup over existing diffusion models.
  arXiv  Detail & Related papers  (2024-10-28T17:25:56Z)
• Latent Space Energy-based Neural ODEs [73.01344439786524]
  This paper introduces a novel family of deep dynamical models designed to represent continuous-time sequence data. We train the model using maximum likelihood estimation with Markov chain Monte Carlo. Experiments on oscillating systems, videos and real-world state sequences (MuJoCo) illustrate that ODEs with the learnable energy-based prior outperform existing counterparts.
  arXiv  Detail & Related papers  (2024-09-05T18:14:22Z)
• Speed-accuracy trade-off for the diffusion models: Wisdom from nonequilibrium thermodynamics and optimal transport [0.0]
  We discuss a connection between a generative model, called the diffusion model, and nonequilibrium thermodynamics for the Fokker-Planck equation. We derive the speed-accuracy trade-off for the diffusion models, which is a trade-off relationship between the speed and accuracy of data generation in diffusion models.
  arXiv  Detail & Related papers  (2024-07-05T13:35:14Z)
• Temperature dependence of energy transport in the $\mathbb{Z}_3$ chiral clock model [0.0]
  We study energy transport within the non-integrable regime of the one-dimensional $mathbbZ_3$ chiral clock model. We extract the transport coefficients of the model at relatively high temperatures above both its gapless and gapped low-temperature phases. Although we are not yet able to reach temperatures where quantum critical scaling would be observed, our approach is able to access the transport properties of the model.
  arXiv  Detail & Related papers  (2023-10-31T18:00:30Z)
• Geometric Neural Diffusion Processes [55.891428654434634]
  We extend the framework of diffusion models to incorporate a series of geometric priors in infinite-dimension modelling. We show that with these conditions, the generative functional model admits the same symmetry.
  arXiv  Detail & Related papers  (2023-07-11T16:51:38Z)
• Long Horizon Temperature Scaling [90.03310732189543]
  Long Horizon Temperature Scaling (LHTS) is a novel approach for sampling from temperature-scaled joint distributions. We derive a temperature-dependent LHTS objective, and show that finetuning a model on a range of temperatures produces a single model capable of generation with a controllable long horizon temperature parameter.
  arXiv  Detail & Related papers  (2023-02-07T18:59:32Z)
• Your Autoregressive Generative Model Can be Better If You Treat It as an Energy-Based One [83.5162421521224]
  We propose a unique method termed E-ARM for training autoregressive generative models. E-ARM takes advantage of a well-designed energy-based learning objective. We show that E-ARM can be trained efficiently and is capable of alleviating the exposure bias problem.
  arXiv  Detail & Related papers  (2022-06-26T10:58:41Z)
• Physics-based Learning of Parameterized Thermodynamics from Real-time Thermography [0.0]
  We present a novel physics-based approach to learning a thermal process's dynamics from real-time thermographic data. We show that our approach is robust against noise, and can be used to further refine parameter estimates.
  arXiv  Detail & Related papers  (2022-03-24T16:06:31Z)
• Identification of high order closure terms from fully kinetic simulations using machine learning [0.0]
  We show how two different machine learning models can synthesize higher-order moments extracted from a kinetic simulation. The accuracy of the models and their ability to generalize are evaluated and compared to a baseline model. We learn that both models can capture heat flux and pressure tensor very well, with the gradient boosting regressor being the most stable of the two models.
  arXiv  Detail & Related papers  (2021-10-19T12:27:02Z)
• Uhlmann Fidelity and Fidelity Susceptibility for Integrable Spin Chains at Finite Temperature: Exact Results [68.8204255655161]
  We show that the proper inclusion of the odd parity subspace leads to the enhancement of maximal fidelity susceptibility in the intermediate range of temperatures. The correct low-temperature behavior is captured by an approximation involving the two lowest many-body energy eigenstates.
  arXiv  Detail & Related papers  (2021-05-11T14:08:02Z)
• Accurate simulation and thermal tuning by temperature-adaptive boundary interactions on quantum many-body systems [2.13230439190003]
  We propose the temperature-adaptive entanglement simulator (TAES) that mimics and tunes the thermodynamics of the one-dimensional (1D) many-body system. With the benchmark on 1D spin chains, TAES surpasses the state-of-the-art accuracy compared with the existing finite-temperature approaches.
  arXiv  Detail & Related papers  (2021-04-30T15:21:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.