Machine learning moment closure models for the radiative transfer
equation I: directly learning a gradient based closure
- URL: http://arxiv.org/abs/2105.05690v1
- Date: Wed, 12 May 2021 14:24:20 GMT
- Title: Machine learning moment closure models for the radiative transfer
equation I: directly learning a gradient based closure
- Abstract summary: We propose to learn the gradient of the high order moment using neural networks.
A variety of benchmark tests, including the variable scattering problem, show both good accuracy and generalizability of our machine learning closure model.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we take a data-driven approach and apply machine learning to
the moment closure problem for radiative transfer equation in slab geometry.
Instead of learning the unclosed high order moment, we propose to directly
learn the gradient of the high order moment using neural networks. This new
approach is consistent with the exact closure we derive for the free streaming
limit and also provides a natural output normalization. A variety of benchmark
tests, including the variable scattering problem, the Gaussian source problem
and the two material problem, show both good accuracy and generalizability of
our machine learning closure model.
Related papers
- LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction [59.32834240526981]
Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE)<n>Existing GRPO methods for flow models replace the Euler-time ODE with aotropic differential equation (SDE) during training.<n>We introduce LC-GRPO, a flow-based GRPO framework with Langevin correction targeting the marginal distribution at the resulting timestep.
arXiv Detail & Related papers (2026-08-06T04:47:57Z) - Bundle Network: a Machine Learning-Based Bundle Method [5.611428210450043]
This paper presents Bundle Network, a learning-based algorithm inspired by the Bundle Method for convex non-smooth problems.<n>By leveraging the unrolled graph of computation, our Bundle Network can be trained end-to-end via automatic differentiation.
arXiv Detail & Related papers (2025-09-29T12:59:49Z) - On the Wasserstein Convergence and Straightness of Rectified Flow [54.580605276017096]
Rectified Flow (RF) is a generative model that aims to learn straight flow trajectories from noise to data.
We provide a theoretical analysis of the Wasserstein distance between the sampling distribution of RF and the target distribution.
We present general conditions guaranteeing uniqueness and straightness of 1-RF, which is in line with previous empirical findings.
arXiv Detail & Related papers (2024-10-19T02:36:11Z) - Hyperbolic Machine Learning Moment Closures for the BGK Equations [0.0]
We introduce a hyperbolic closure for the Grad moment expansion of the Bhatnagar-Gross-Krook's kinetic model using a neural network (NN) trained on BGK's moment data.
This closure is motivated by the exact closure for the free streaming limit that we derived in our paper on closures in transport citeHuang2022-RTE1.
arXiv Detail & Related papers (2024-01-09T19:14:57Z) - Stochastic Gradient Descent for Gaussian Processes Done Right [86.83678041846971]
We show that when emphdone right -- by which we mean using specific insights from optimisation and kernel communities -- gradient descent is highly effective.
We introduce a emphstochastic dual descent algorithm, explain its design in an intuitive manner and illustrate the design choices.
Our method places Gaussian process regression on par with state-of-the-art graph neural networks for molecular binding affinity prediction.
arXiv Detail & Related papers (2023-10-31T16:15:13Z) - Machine learning in and out of equilibrium [58.88325379746631]
Our study uses a Fokker-Planck approach, adapted from statistical physics, to explore these parallels.
We focus in particular on the stationary state of the system in the long-time limit, which in conventional SGD is out of equilibrium.
We propose a new variation of Langevin dynamics (SGLD) that harnesses without replacement minibatching.
arXiv Detail & Related papers (2023-06-06T09:12:49Z) - Constrained Optimization via Exact Augmented Lagrangian and Randomized
Iterative Sketching [55.28394191394675]
We develop an adaptive inexact Newton method for equality-constrained nonlinear, nonIBS optimization problems.
We demonstrate the superior performance of our method on benchmark nonlinear problems, constrained logistic regression with data from LVM, and a PDE-constrained problem.
arXiv Detail & Related papers (2023-05-28T06:33:37Z) - NeuralEF: Deconstructing Kernels by Deep Neural Networks [47.54733625351363]
Traditional nonparametric solutions based on the Nystr"om formula suffer from scalability issues.
Recent work has resorted to a parametric approach, i.e., training neural networks to approximate the eigenfunctions.
We show that these problems can be fixed by using a new series of objective functions that generalizes to space of supervised and unsupervised learning problems.
arXiv Detail & Related papers (2022-04-30T05:31:07Z) - Error-Correcting Neural Networks for Two-Dimensional Curvature
Computation in the Level-Set Method [0.0]
We present an error-neural-modeling-based strategy for approximating two-dimensional curvature in the level-set method.
Our main contribution is a redesigned hybrid solver that relies on numerical schemes to enable machine-learning operations on demand.
arXiv Detail & Related papers (2022-01-22T05:14:40Z) - Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms.
Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
arXiv Detail & Related papers (2021-11-27T12:12:57Z) - Machine learning moment closure models for the radiative transfer
equation III: enforcing hyperbolicity and physical characteristic speeds [0.0]
Third paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE)
Motivated by the observation that the coefficient matrix of the closure system is lower Hessenberg matrix, we relate its eigenvalues to the roots of an associated neural network.
arXiv Detail & Related papers (2021-09-02T04:16:56Z) - Machine learning moment closure models for the radiative transfer
equation II: enforcing global hyperbolicity in gradient based closures [0.0]
This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE)
We propose a method to enforce the global hyperbolicity of the ML closure model.
It is shown that the new ML closure system inherits the dissipativeness of the RTE and preserves the correct diffusion limit as the Knunsden number goes to zero.
arXiv Detail & Related papers (2021-05-30T02:10:59Z) - A Near-Optimal Gradient Flow for Learning Neural Energy-Based Models [93.24030378630175]
We propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs)
We derive a second-order Wasserstein gradient flow of the global relative entropy from Fokker-Planck equation.
Compared with existing schemes, Wasserstein gradient flow is a smoother and near-optimal numerical scheme to approximate real data densities.
arXiv Detail & Related papers (2019-10-31T02:26:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.