Few-Shot Learning by Explicit Physics Integration: An Application to Groundwater Heat Transport
- URL: http://arxiv.org/abs/2507.06062v1
- Date: Tue, 08 Jul 2025 15:06:15 GMT
- Title: Few-Shot Learning by Explicit Physics Integration: An Application to Groundwater Heat Transport
- Abstract summary: Local-Global Convolutional Neural Network (LGCNN) approach is introduced.<n>Model is first systematically analyzed based on random input fields.<n>Then, the model is trained on a handful of cut-outs from a real-world Classical map of the Munich region in Germany.
- Score: 41.94295877935867
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Machine learning methods often struggle with real-world applications in science and engineering due to limited or low-quality training data. In this work, the example of groundwater flow with heat transport is considered; this corresponds to an advection-diffusion process under heterogeneous flow conditions, that is, spatially distributed material parameters and heat sources. Classical numerical simulations are costly and challenging due to high spatio-temporal resolution requirements and large domains. While often computationally more efficient, purely data-driven surrogate models face difficulties, particularly in predicting the advection process, which is highly sensitive to input variations and involves long-range spatial interactions. Therefore, in this work, a Local-Global Convolutional Neural Network (LGCNN) approach is introduced. It combines a lightweight numerical surrogate for the transport process (global) with convolutional neural networks for the groundwater velocity and heat diffusion processes (local). With the LGCNN, a city-wide subsurface temperature field is modeled, involving a heterogeneous groundwater flow field and one hundred groundwater heat pump injection points forming interacting heat plumes over long distances. The model is first systematically analyzed based on random subsurface input fields. Then, the model is trained on a handful of cut-outs from a real-world subsurface map of the Munich region in Germany, and it scales to larger cut-outs without retraining. All datasets, our code, and trained models are published for reproducibility.
Related papers
- Neural Operator based Multi-Field Reconstruction of Inner Solar Boundary State [1.2314765641075438]
We study the problem of learning the multi-field multi-scale solar magnetohydrodynamic state at 30 solar radii.<n>We employ a Local Neural Operator (LocalNO) that learns mappings between input and output function spaces.<n>The resulting predictions along with inputs are intended to serve as boundary condition variables for future inner-heliospheric modeling pipelines.
arXiv Detail & Related papers (2026-08-24T04:11:59Z) - Hybrid Quantum CNN for Cross-Sensor Spaceborne Volcanic Thermal Activity Recognition Worldwide [63.84017474733142]
This work proposes a Hybrid Quantum AlexNet architecture for cross-sensor recognition of volcanic thermal activity at the global scale.<n>The proposed model combines a classical convolutional backbone for high-level spatial features extraction with a parameterized quantum circuit (PQC) acting as a variational layer.<n> Experimental results demonstrate that the proposed hybrid quantum model learns more discriminative feature representations, leading to improved cross-sensor transferability and robustness across heterogeneous volcanic environments.
arXiv Detail & Related papers (2026-07-29T08:34:44Z) - Multi-Fidelity Learning with Shallow Recurrent Decoders for Reactor Physics [2.268582656930941]
In reactor physics, neutronics can be treated with different fidelity levels, according to the needs of the user.<n>This work investigates the possibility by leveraging multi-fidelity information with Shallow Recurrent Decoders.
arXiv Detail & Related papers (2026-05-22T17:14:48Z) - Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting [6.433158386048011]
Recent machine-learning approaches to weather forecasting often employ a monolithic architecture.<n>We present PARADIS, a physics-inspired global weather prediction model that imposes inductive biases on network behavior.<n>We implement advection through a Neural Semi-Lagrangian operator that performs trajectory-based transport via differentiable on the sphere.<n>Diffusion-like processes are modeled through depthwise-separable spatial mixing, while local source terms and vertical interactions are modeled via pointwise channel interactions.
arXiv Detail & Related papers (2026-01-29T01:20:21Z) - Inverse Autoregressive Flows for Zero Degree Calorimeter fast simulation [0.0]
Physics-based machine learning blends traditional science with modern data-driven techniques.<n>We leverage this paradigm to accelerate simulations of the Zero Degree Calorimeter (ZDC) of the ALICE experiment at CERN.<n>Our approach not only outperforms classic data-driven model assimilation but also yields models that are 421 times faster than existing NF implementations in ZDC simulation literature.
arXiv Detail & Related papers (2025-12-23T13:28:15Z) - Curly Flow Matching for Learning Non-gradient Field Dynamics [49.480209466896035]
We introduce Curly Flow Matching (Curly-FM), a novel approach to learning non-gradient field dynamics.<n>Curly-FM is capable of learning non-gradient field dynamics by designing and solving a Schr"odinger bridge problem.<n>Curly-FM can learn trajectories that better match both the reference process and population marginals.
arXiv Detail & Related papers (2025-10-30T16:11:39Z) - Interactive Atmospheric Composition Emulation for Next-Generation Earth System Models [0.0]
Interactive simulations in Earth System Models (ESMs) are computationally expensive as they transport numerous gaseous and aerosols at each timestep.<n>We extend the ModelE NINT tracer version using machine learning (ML) to create SmartINT, which emulates interactive emissions.<n>Smart NINT interactively calculates concentrations using ML with surface emissions meteorological data as inputs, avoiding full physics parameterizations.
arXiv Detail & Related papers (2025-10-12T15:18:37Z) - A Neural Operator-Based Emulator for Regional Shallow Water Dynamics [5.09419041446345]
Coastal regions are particularly vulnerable to the impacts of rising sea levels and extreme weather events.<n> Accurate real-time forecasting of hydrodynamic processes in these areas is essential for infrastructure planning and climate adaptation.<n>We present a novel autoregressive neural emulator that employs dimensionality reduction to efficiently approximate high-dimensional numerical solvers.
arXiv Detail & Related papers (2025-02-20T18:02:44Z) - Learning Pore-scale Multi-phase Flow from Experimental Data with Graph Neural Network [2.2101344151283944]
Current numerical models are often incapable of accurately capturing the complex pore-scale physics observed in experiments.
We propose a graph neural network-based approach and directly learn pore-scale fluid flow using micro-CT experimental data.
arXiv Detail & Related papers (2024-11-21T15:01:17Z) - Enforcing the Principle of Locality for Physical Simulations with Neural Operators [0.0]
Time-dependent partial differential equations (PDEs) are strictly local-dependent according to the principle of locality in physics.<n>Deep learning architecture cannot strictly enforce the local-dependency as it inevitably increases the scope of information to make local predictions.<n>This paper proposes a data decomposition method to strictly limit the scope of information for neural operators making local predictions.
arXiv Detail & Related papers (2024-05-02T14:24:56Z) - Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes [57.396578974401734]
We introduce a principled framework for building a generative diffusion process on general manifold.
Instead of following the denoising approach of previous diffusion models, we construct a diffusion process using a mixture of bridge processes.
We develop a geometric understanding of the mixture process, deriving the drift as a weighted mean of tangent directions to the data points.
arXiv Detail & Related papers (2023-10-11T06:04:40Z) - Fourier Neural Operators for Arbitrary Resolution Climate Data
Downscaling [16.890326773246414]
We propose a downscaling method based on the Fourier neural operator.
We show that our method significantly outperforms state-of-the-art convolutional and generative adversarial downscaling models.
Overall, our work bridges the gap between simulation of a physical process and low-resolution output.
arXiv Detail & Related papers (2023-05-23T18:25:08Z) - Reduced Order Probabilistic Emulation for Physics-Based Thermosphere
Models [0.0]
This work aims to employ a probabilistic machine learning (ML) method to create an efficient surrogate for the Thermosphere Ionosphere Electrodynamics Circulation General Model (TIE-GCM)
We show that across the available data, TIE-GCM ROPE has similar error to previous linear approaches while improving storm-time modeling.
We also conduct a satellite propagation study for the significant November 2003 storm which shows that TIE-GCM ROPE can capture the position resulting from TIE-GCM density with 5 km bias.
arXiv Detail & Related papers (2022-11-08T17:36:37Z) - Manifold Interpolating Optimal-Transport Flows for Trajectory Inference [64.94020639760026]
We present a method called Manifold Interpolating Optimal-Transport Flow (MIOFlow)
MIOFlow learns, continuous population dynamics from static snapshot samples taken at sporadic timepoints.
We evaluate our method on simulated data with bifurcations and merges, as well as scRNA-seq data from embryoid body differentiation, and acute myeloid leukemia treatment.
arXiv Detail & Related papers (2022-06-29T22:19:03Z) - Learning Large-scale Subsurface Simulations with a Hybrid Graph Network
Simulator [57.57321628587564]
We introduce Hybrid Graph Network Simulator (HGNS) for learning reservoir simulations of 3D subsurface fluid flows.
HGNS consists of a subsurface graph neural network (SGNN) to model the evolution of fluid flows, and a 3D-U-Net to model the evolution of pressure.
Using an industry-standard subsurface flow dataset (SPE-10) with 1.1 million cells, we demonstrate that HGNS is able to reduce the inference time up to 18 times compared to standard subsurface simulators.
arXiv Detail & Related papers (2022-06-15T17:29:57Z) - A Gradient-based Deep Neural Network Model for Simulating Multiphase
Flow in Porous Media [1.5791732557395552]
We describe a gradient-based deep neural network (GDNN) constrained by the physics related to multiphase flow in porous media.
We demonstrate that GDNN can effectively predict the nonlinear patterns of subsurface responses.
arXiv Detail & Related papers (2021-04-30T02:14:00Z) - Machine learning for rapid discovery of laminar flow channel wall
modifications that enhance heat transfer [56.34005280792013]
We present a combination of accurate numerical simulations of arbitrary, flat, and non-flat channels and machine learning models predicting drag coefficient and Stanton number.
We show that convolutional neural networks (CNN) can accurately predict the target properties at a fraction of the time of numerical simulations.
arXiv Detail & Related papers (2021-01-19T16:14:02Z) - A Near-Optimal Gradient Flow for Learning Neural Energy-Based Models [93.24030378630175]
We propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs)
We derive a second-order Wasserstein gradient flow of the global relative entropy from Fokker-Planck equation.
Compared with existing schemes, Wasserstein gradient flow is a smoother and near-optimal numerical scheme to approximate real data densities.
arXiv Detail & Related papers (2019-10-31T02:26:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.