Differentiable Hybrid Modelling for Learning and Optimising Chemical Transport Processes from Experimental Data
- URL: http://arxiv.org/abs/2609.04011v1
- Date: Thu, 03 Sep 2026 15:50:56 GMT
- Title: Differentiable Hybrid Modelling for Learning and Optimising Chemical Transport Processes from Experimental Data
- Abstract summary: We introduce a differentiable hybrid modelling framework for transport processes, specifically for the case of population balance equations.<n>Our framework integrates a finite volume population balance solver with learnable neural network components which are trained to both discover laws and fit initial conditions from real experimental data.<n>This work highlights the huge potential of such differentiable hybrid modelling frameworks for learning and optimising any given chemical separation which involves mass, energy, and/or momentum transport.
- Score: 0.34998703934432673
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Reliable transport models are essential when modelling and optimising many chemical engineering processes, yet, most models assume hand-picked constitutive laws which may not reflect reality, and often assume initial conditions are known exactly. Both restrictions can significantly bias model predictions and lead to systematic error when used in predictive and control settings. Black-box neural surrogate alternatives for modelling can better match real example data, but are confined to the task they were trained on and cannot be interrogated for physical consistency. Here we introduce a general-purpose differentiable hybrid modelling framework for transport processes, specifically for the case of population balance equations. Our framework integrates a JAX finite volume population balance solver with learnable neural network components which are trained to both discover constitutive laws and fit initial conditions from real experimental data, allowing us to better model real experimental transport systems. Furthermore, we use our framework for process optimisation, using its differentiability to allow us to direct optimising experimental settings for quantities of interest. This work highlights the huge potential of such differentiable hybrid modelling frameworks for learning and optimising any given chemical separation which involves mass, energy, and/or momentum transport.
Related papers
- A tale of perfect fit and phantom optima: how data-driven models can fail in real-time optimization [0.0]
Real-time optimization (RTO) relies on process models to locate economically optimal operating conditions.<n>Modern machine-learning models can fit historical plant data accurately and often pass standard validation tests.<n>We investigate whether such models can be trusted for economic optimization.
arXiv Detail & Related papers (2026-08-24T22:51:30Z) - Distributionally Robust Feature Selection [14.493253907785473]
We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations.<n>Our method frames the problem as a continuous relaxation of traditional variable selection using a noising mechanism.<n>We develop a model-agnostic framework that balances overall performance of downstream prediction across populations.
arXiv Detail & Related papers (2025-10-24T03:03:30Z) - Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulators [9.402119111650613]
We develop an explainable AI framework for Earth system emulators.<n>It bridges the model hierarchy through a reconfigured latent data assimilation technique.<n>It achieves global accuracy enhancements through targeted improvements from idealized models.
arXiv Detail & Related papers (2025-10-14T23:02:40Z) - Efficient Regression-Based Training of Normalizing Flows for Boltzmann Generators [85.25962679349551]
Boltzmann Generators (BGs) offer efficient sampling and likelihoods, but their training via maximum likelihood is often unstable and computationally challenging.<n>We propose Regression Training of Normalizing Flows (RegFlow), a novel and scalable-based training objective that bypasses the numerical instability and computational challenge of conventional maximum likelihood training.
arXiv Detail & Related papers (2025-06-01T20:32:27Z) - Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models [54.132297393662654]
We introduce a hybrid method that fine-tunes cutting-edge diffusion models by optimizing reward models through RL.
We demonstrate the capability of our approach to outperform the best designs in offline data, leveraging the extrapolation capabilities of reward models.
arXiv Detail & Related papers (2024-05-30T03:57:29Z) - Hybrid additive modeling with partial dependence for supervised regression and dynamical systems forecasting [5.611231523622238]
We introduce a new hybrid training approach based on partial dependence, which removes the need for intricate regularization.<n>We compare, on both synthetic and real regression problems, several approaches for training such hybrid models.<n>Experiments are carried out with different types of machine learning models, including tree-based models and artificial neural networks.
arXiv Detail & Related papers (2023-07-05T12:13:56Z) - Online simulator-based experimental design for cognitive model selection [74.76661199843284]
We propose BOSMOS: an approach to experimental design that can select between computational models without tractable likelihoods.
In simulated experiments, we demonstrate that the proposed BOSMOS technique can accurately select models in up to 2 orders of magnitude less time than existing LFI alternatives.
arXiv Detail & Related papers (2023-03-03T21:41:01Z) - Hybrid Machine Learning Modeling of Engineering Systems -- A
Probabilistic Perspective Tested on a Multiphase Flow Modeling Case Study [0.0]
We propose a hybrid modeling machine learning framework that allows tuning first principles models to process conditions.
Our approach not only estimates the expected values of the first principles model parameters but also quantifies the uncertainty of these estimates.
In the simulation results, we show how uncertainty estimates of the resulting hybrid models can be used to make better operation decisions.
arXiv Detail & Related papers (2022-05-18T20:15:25Z) - Prediction of liquid fuel properties using machine learning models with
Gaussian processes and probabilistic conditional generative learning [56.67751936864119]
The present work aims to construct cheap-to-compute machine learning (ML) models to act as closure equations for predicting the physical properties of alternative fuels.
Those models can be trained using the database from MD simulations and/or experimental measurements in a data-fusion-fidelity approach.
The results show that ML models can predict accurately the fuel properties of a wide range of pressure and temperature conditions.
arXiv Detail & Related papers (2021-10-18T14:43:50Z) - Conservative Objective Models for Effective Offline Model-Based
Optimization [78.19085445065845]
Computational design problems arise in a number of settings, from synthetic biology to computer architectures.
We propose a method that learns a model of the objective function that lower bounds the actual value of the ground-truth objective on out-of-distribution inputs.
COMs are simple to implement and outperform a number of existing methods on a wide range of MBO problems.
arXiv Detail & Related papers (2021-07-14T17:55:28Z) - A Twin Neural Model for Uplift [59.38563723706796]
Uplift is a particular case of conditional treatment effect modeling.
We propose a new loss function defined by leveraging a connection with the Bayesian interpretation of the relative risk.
We show our proposed method is competitive with the state-of-the-art in simulation setting and on real data from large scale randomized experiments.
arXiv Detail & Related papers (2021-05-11T16:02:39Z) - Design of Dynamic Experiments for Black-Box Model Discrimination [72.2414939419588]
Consider a dynamic model discrimination setting where we wish to chose: (i) what is the best mechanistic, time-varying model and (ii) what are the best model parameter estimates.
For rival mechanistic models where we have access to gradient information, we extend existing methods to incorporate a wider range of problem uncertainty.
We replace these black-box models with Gaussian process surrogate models and thereby extend the model discrimination setting to additionally incorporate rival black-box model.
arXiv Detail & Related papers (2021-02-07T11:34:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.