Adaptive Physics-Informed Neural Networks with Multi-Category Feature Engineering for Hydrogen Sorption Prediction in Clays, Shales, and Coals
- URL: http://arxiv.org/abs/2509.00049v1
- Date: Sun, 24 Aug 2025 19:41:33 GMT
- Title: Adaptive Physics-Informed Neural Networks with Multi-Category Feature Engineering for Hydrogen Sorption Prediction in Clays, Shales, and Coals
- Authors: Mohammad Nooraiepour, Mohammad Masoudi, Zezhang Song, Helge Hellevang,
- Abstract summary: This study introduces an adaptive physics-informed neural network (PINN) framework to enhance hydrogen sorption prediction.<n>The PINN employs deep residual networks with multi-head attention, optimized via adaptive loss functions and Monte Carlo dropout for uncertainty quantification.<n>The framework demonstrates robust lithology-specific performance across clay minerals, shales, and coals, maintaining 85-91% reliability scores.
- Score: 1.5749416770494706
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Accurate prediction of hydrogen sorption in clays, shales, and coals is vital for advancing underground hydrogen storage, natural hydrogen exploration, and radioactive waste containment. Traditional experimental methods, while foundational, are time-consuming, error-prone, and limited in capturing geological heterogeneity. This study introduces an adaptive physics-informed neural network (PINN) framework with multi-category feature engineering to enhance hydrogen sorption prediction. The framework integrates classical isotherm models with thermodynamic constraints to ensure physical consistency while leveraging deep learning flexibility. A comprehensive dataset consisting of 155 samples, which includes 50 clays, 60 shales, and 45 coals, was employed, incorporating diverse compositional properties and experimental conditions. Multi-category feature engineering across seven categories captured complex sorption dynamics. The PINN employs deep residual networks with multi-head attention, optimized via adaptive loss functions and Monte Carlo dropout for uncertainty quantification. K-fold cross-validation and hyperparameter optimization achieve significant accuracy (R2 = 0.979, RMSE = 0.045 mol per kg) with 67% faster convergence despite 15-fold increased complexity. The framework demonstrates robust lithology-specific performance across clay minerals (R2 = 0.981), shales (R2 = 0.971), and coals (R2 = 0.978), maintaining 85-91% reliability scores. Interpretability analysis via SHAP, accumulated local effects, and Friedman's H-statistics reveal that hydrogen adsorption capacity dominates predictions, while 86.7% of feature pairs exhibit strong interactions, validating the necessity of non-linear modeling approaches. This adaptive physics-informed framework accelerates site screening and enables risk-informed decision-making through robust uncertainty quantification.
Related papers
- Function-Space Decoupled Diffusion for Forward and Inverse Modeling in Carbon Capture and Storage [65.51149575007149]
We present Fun-DDPS, a generative framework that combines function-space diffusion models with differentiable neural operator surrogates for both forward and inverse modeling.<n>Fun-DDPS produces physically consistent realizations free from the high-frequency artifacts observed in joint-state baselines.
arXiv Detail & Related papers (2026-02-12T18:58:12Z) - Estimating Dense-Packed Zone Height in Liquid-Liquid Separation: A Physics-Informed Neural Network Approach [35.66975292316149]
Separating liquid-liquid dispersions in gravity settlers is critical in chemical, pharmaceutical, and recycling processes.<n>Dense-packed zone height is an important performance and safety indicator but it is often expensive and impractical to measure.<n>We propose to estimate phase heights using only inexpensive volume flow measurements.
arXiv Detail & Related papers (2026-01-26T11:57:28Z) - Physics-informed Neural Operator Learning for Nonlinear Grad-Shafranov Equation [18.564353542797946]
In magnetic confinement nuclear fusion, rapid and accurate solution of the Grad-Shafranov equation (GSE) is essential for real-time plasma control and analysis.<n>Traditional numerical solvers achieve high precision but are computationally prohibitive, while data-driven surrogates infer quickly but fail to enforce physical laws and generalize poorly beyond training distributions.<n>We present a Physics-Informed Neural Operator (PINO) that directly learns the GSE solution operator, mapping shape parameters of last closed flux surface to equilibrium solutions for realistic nonlinear current profiles.
arXiv Detail & Related papers (2025-11-24T13:46:38Z) - Physics-Guided Deep Learning for Heat Pump Stress Detection: A Comprehensive Analysis on When2Heat Dataset [0.0]
This paper presents a novel Physics-Guided Deep Neural Network (PG-DNN) approach for heat pump stress classification.<n>The methodology integrates physics-guided feature selection and class definition with a deep neural network architecture.<n>The model achieves 78.1% test accuracy and 78.5% validation accuracy, demonstrating significant improvements over baseline approaches.
arXiv Detail & Related papers (2025-11-23T18:50:47Z) - Resolving Turbulent Magnetohydrodynamics: A Hybrid Operator-Diffusion Framework [0.2999888908665658]
Hybrid machine learning framework is trained on a comprehensive ensemble of high-fidelity simulations with $mathrmRe in 100, 250, 500, 750, 1000, 3000, 10000$.<n>At extreme turbulence levels, it remains the first surrogate capable of recovering the high-wavenumber evolution of the magnetic field.
arXiv Detail & Related papers (2025-07-02T19:33:57Z) - ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion [48.540756751934836]
ReconMOST is a data-driven guided diffusion model framework for multi-layer sea temperature reconstruction.<n>Our method extends ML-based SST reconstruction to a global, multi-layer setting, handling over 92.5% missing data.
arXiv Detail & Related papers (2025-06-12T06:27:22Z) - Bridging Equilibrium and Kinetics Prediction with a Data-Weighted Neural Network Model of Methane Steam Reforming [0.0]
We show a surrogate model capable of unifying both kinetic and equilibrium regimes.<n>An artificial neural network trained on a comprehensive dataset that includes experimental data from kinetic and equilibrium experiments.<n>The network's ability to provide continuous derivatives of its predictions makes it particularly useful for process modeling and optimization.
arXiv Detail & Related papers (2025-04-15T14:55:06Z) - Biogeochemistry-Informed Neural Network (BINN) for Improving Accuracy of Model Prediction and Scientific Understanding of Soil Organic Carbon [20.23597761416224]
We develop a Biogeochemistry-Informed Neural Network (BINN) to retrieve mechanistic knowledge from big data.<n>BINN predicts six major processes regulating the soil carbon cycle from 25,925 observed SOC profiles across the US.<n>The integration of neural networks and process-based models in BINN improves computational efficiency by more than 50 times over PRODA.
arXiv Detail & Related papers (2025-02-02T05:02:42Z) - A finite element-based machine learning model for hydro-mechanical analysis of swelling behavior in clay-sulfate rocks [1.9489690270805868]
The hydro-mechanical behavior of clay-sulfate rocks, especially their swelling properties, poses significant challenges in geotechnical engineering.<n>This study presents a hybrid constrained machine learning (ML) model tuned with a Bayesian optimization algorithm to predict and analyze the swelling behavior of these complex geological materials.<n>The study demonstrates the ability of the model to predict the swelling behavior of clay-sulfate rocks, providing a robust tool for risk assessment and management in affected regions.
arXiv Detail & Related papers (2025-01-29T10:19:18Z) - UQ of 2D Slab Burner DNS: Surrogates, Uncertainty Propagation, and Parameter Calibration [36.136619420474766]
The goal of this paper is to demonstrate and address challenges related to performing a complete uncertainty quantification analysis of a complicated physics-based simulation like a 2D slab burner direct numerical simulation (DNS)<n>The UQ framework includes the development of data-driven surrogate models and the propagation of parametric uncertainties to the fuel regression rate.<n>This study highlights the importance of surrogate model selection and parameter calibration in quantifying uncertainty in predictions of fuel regression rates in complex combustion systems.
arXiv Detail & Related papers (2024-11-09T20:56:05Z) - Machine-Learning Prediction of the Computed Band Gaps of Double
Perovskite Materials [3.2798940914359056]
Prediction of the electronic structure of functional materials is essential for the engineering of new devices.
In this study, we use machine learning to predict the electronic structure of double perovskite materials.
Our results are significant in the sense that they attest to the potential of machine learning regressions for the rapid screening of promising candidate functional materials.
arXiv Detail & Related papers (2023-01-04T08:19:18Z) - Predictive Scale-Bridging Simulations through Active Learning [43.48102250786867]
We use an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics.
Our approach addresses three challenges: forecasting continuum coarse-scale trajectory, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.
arXiv Detail & Related papers (2022-09-20T15:58:50Z) - Physics-informed machine learning with differentiable programming for
heterogeneous underground reservoir pressure management [64.17887333976593]
Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO2 sequestration and wastewater injection.
Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface.
We use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization.
arXiv Detail & Related papers (2022-06-21T20:38:13Z) - Prediction of liquid fuel properties using machine learning models with
Gaussian processes and probabilistic conditional generative learning [56.67751936864119]
The present work aims to construct cheap-to-compute machine learning (ML) models to act as closure equations for predicting the physical properties of alternative fuels.
Those models can be trained using the database from MD simulations and/or experimental measurements in a data-fusion-fidelity approach.
The results show that ML models can predict accurately the fuel properties of a wide range of pressure and temperature conditions.
arXiv Detail & Related papers (2021-10-18T14:43:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.