Learning with Embedded Linear Equality Constraints via Variational Bayesian Inference

• URL: http://arxiv.org/abs/2604.24911v1
• Date: Mon, 27 Apr 2026 18:47:13 GMT
• Title: Learning with Embedded Linear Equality Constraints via Variational Bayesian Inference
• Abstract summary: We propose a Bayesian framework to embed linear relationships across inputs and outputs into the learning process.<n>We evaluate our method on learning the single particle battery model subject to voltage and energy balances.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine Learning is becoming more prevalent in science and engineering, but many approaches do not provide meaningful uncertainty estimates and predictions may also violate known physical knowledge. We propose a Bayesian framework to embed linear relationships across inputs and outputs into the learning process, whilst characterizing full predictive uncertainty over both the model parameters and the domain knowledge. We evaluated our method on learning the single particle battery model subject to voltage and energy balances, showing its ability to provide reduced credible intervals and constraint violations compared to standard Bayesian neural networks based on variational inference.

Related papers

• Dirichlet-Based Monte Carlo Dropout for Uncertainty Estimation in Neural Networks [0.5599792629509229]
  In this work, we enhance uncertainty estimation in deep learning by integrating a Dirichlet-based framework within MC Dropout.<n>The proposed approach maintains the computational efficiency of MC Dropout while improving the quality of uncertainty estimates.
  arXiv  Detail & Related papers  (2026-05-22T13:50:50Z)
• Non-Parametric Rehearsal Learning via Conditional Mean Embeddings [88.89267783967263]
  We propose a non-parametric rehearsal learning approach for textitavoiding undesired future (AUF) problems.<n>Specifically, we use kernel machinery to reformulate the AUF objective into a unified representation that disentangles desirability modeling from action-induced distributional changes.
  arXiv  Detail & Related papers  (2026-05-09T15:30:52Z)
• Bridging the Gap Between Bayesian Deep Learning and Ensemble Weather Forecasts [100.26854618129039]
  Weather forecasting is fundamentally challenged by the chaotic nature of the atmosphere.<n>Recent advances in Bayesian Deep Learning (BDL) offer a promising but often disconnected alternative.<n>We bridge these paradigms through a unified hybrid BDL framework for ensemble weather forecasting.
  arXiv  Detail & Related papers  (2025-11-18T07:49:52Z)
• Enhancing Uncertainty Estimation and Interpretability via Bayesian Non-negative Decision Layer [55.66973223528494]
  We develop a Bayesian Non-negative Decision Layer (BNDL), which reformulates deep neural networks as a conditional Bayesian non-negative factor analysis.<n>BNDL can model complex dependencies and provide robust uncertainty estimation.<n>We also offer theoretical guarantees that BNDL can achieve effective disentangled learning.
  arXiv  Detail & Related papers  (2025-05-28T10:23:34Z)
• Certified Neural Approximations of Nonlinear Dynamics [51.01318247729693]
  In safety-critical contexts, the use of neural approximations requires formal bounds on their closeness to the underlying system.<n>We propose a novel, adaptive, and parallelizable verification method based on certified first-order models.
  arXiv  Detail & Related papers  (2025-05-21T13:22:20Z)
• Calibration-Aware Bayesian Learning [37.82259435084825]
  This paper proposes an integrated framework, referred to as calibration-aware Bayesian neural networks (CA-BNNs) It applies both data-dependent or data-independent regularizers while optimizing over a variational distribution as in Bayesian learning. Numerical results validate the advantages of the proposed approach in terms of expected calibration error (ECE) and reliability diagrams.
  arXiv  Detail & Related papers  (2023-05-12T14:19:15Z)
• Variational Inference for Bayesian Neural Networks under Model and Parameter Uncertainty [12.211659310564425]
  We apply the concept of model uncertainty as a framework for structural learning in BNNs. We suggest an adaptation of a scalable variational inference approach with reparametrization of marginal inclusion probabilities.
  arXiv  Detail & Related papers  (2023-05-01T16:38:17Z)
• Bayesian Learning for Dynamic Inference [2.2843885788439793]
  In some sequential estimation problems, the future values of the quantity to be estimated depend on the estimate of its current value. We formulate the Bayesian learning problem for dynamic inference, where the unknown quantity-generation model is assumed to be randomly drawn. We derive the optimal Bayesian learning rules, both offline and online, to minimize the inference loss.
  arXiv  Detail & Related papers  (2022-12-30T19:16:23Z)
• The Unreasonable Effectiveness of Deep Evidential Regression [72.30888739450343]
  A new approach with uncertainty-aware regression-based neural networks (NNs) shows promise over traditional deterministic methods and typical Bayesian NNs. We detail the theoretical shortcomings and analyze the performance on synthetic and real-world data sets, showing that Deep Evidential Regression is a quantification rather than an exact uncertainty.
  arXiv  Detail & Related papers  (2022-05-20T10:10:32Z)
• Evaluating Sensitivity to the Stick-Breaking Prior in Bayesian Nonparametrics [85.31247588089686]
  We show that variational Bayesian methods can yield sensitivities with respect to parametric and nonparametric aspects of Bayesian models. We provide both theoretical and empirical support for our variational approach to Bayesian sensitivity analysis.
  arXiv  Detail & Related papers  (2021-07-08T03:40:18Z)
• Constrained Neural Ordinary Differential Equations with Stability Guarantees [1.1086440815804224]
  We show how to model discrete ordinary differential equations with algebraic nonlinearities as deep neural networks. We derive the stability guarantees of the network layers based on the implicit constraints imposed on the weight's eigenvalues. We demonstrate the prediction accuracy of learned neural ODEs evaluated on open-loop simulations.
  arXiv  Detail & Related papers  (2020-04-22T22:07:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.