LiD-GLM: Lipschitz-constrained Deep Generalized Linear Models

• URL: http://arxiv.org/abs/2608.16340v1
• Date: Mon, 17 Aug 2026 09:45:35 GMT
• Title: LiD-GLM: Lipschitz-constrained Deep Generalized Linear Models
• Abstract summary: Combination of traditional statistical models and neural network (NN) components is an intriguing approach to construct hybrid models.<n>We propose invertible residual neural networks (i-ResNets) to equip models with a flexible correction of distributional assumptions.<n>We develop specific inherent interpretation techniques for our model and enforce model identifiability through an adapted post-hocization.
• Score: 1.389948527681755
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The combination of traditional statistical models and neural network (NN) components into semi-structured hybrid models is an intriguing approach to construct models that, ideally, combine traditional interpretability with the unprecedented flexibility of NNs. In order to preserve interpretability, it is usually necessary to restrict the NN components to prevent them from dominating the model. However, existing methods that enforce structural constraints on their NN components severely limit their models' flexibility; in contrast, methods that only enforce weak, indirect constraints lose meaningful interpretability. The method we propose therefore leverages invertible residual neural networks (i-ResNets) to equip generalized linear models with both nonlinear parameter estimation and a flexible correction of their distributional assumptions while always retaining stochastic monotonicity of the modeled distribution in the (formerly linear) predictor. The i-ResNets correspond to a controlled deviation from identity and by constraining their Lipschitz constant one can rigorously limit and quantify how far the hybrid model deviates from its traditional counterpart. This enables a user-specifiable compromise between flexibility and interpretability without limiting the structure of nonlinear and interaction effects that can be learned. Furthermore, we develop specific inherent interpretation techniques for our model and enforce model identifiability through an adapted post-hoc orthogonalization.

Related papers

• Convex Hybrid Modeling: An Operator-Based Approach [0.989901717499058]
  This paper considers hybrid modeling by formulating convex learning problems that account for interpretability systematically.<n>In the more general setting, the system is regarded as a kernel-based mixture of interpretable models.
  arXiv  Detail & Related papers  (2026-05-22T01:56:51Z)
• SOLIS: Physics-Informed Learning of Interpretable Neural Surrogates for Nonlinear Systems [6.5745172279769255]
  textbfSOLIS models unknown dynamics via a emphstate-conditioned second-order surrogate model<n>textbfLocal Physics Hints windowed ridge-regression anchors that mitigate optimization collapse.<n>Experiments on benchmarks show accurate parameter-manifold recovery and coherent physical rollouts from sparse data, including regimes where standard inverse methods fail.
  arXiv  Detail & Related papers  (2026-04-16T11:12:36Z)
• Robustly Invertible Nonlinear Dynamics and the BiLipREN: Contracting Neural Models with Contracting Inverses [2.0277446818410994]
  We study the invertibility of nonlinear dynamical systems from the perspective of contraction and incremental stability analysis.<n>We propose a new invertible recurrent neural model: the BiLipREN.
  arXiv  Detail & Related papers  (2025-05-05T23:27:52Z)
• Can KAN CANs? Input-convex Kolmogorov-Arnold Networks (KANs) as hyperelastic constitutive artificial neural networks (CANs) [0.0]
  We present a new type of model for learning the laws of.<n>trainable material behavior.<n>The resulting models are both compact hyper-trainible interpretable.<n>relationships analytical compressionity.<n>We show that ICKANs accurately capture stress-s models across diverse diverse strain states.
  arXiv  Detail & Related papers  (2025-03-07T17:42:24Z)
• A Non-negative VAE:the Generalized Gamma Belief Network [49.970917207211556]
  The gamma belief network (GBN) has demonstrated its potential for uncovering multi-layer interpretable latent representations in text data. We introduce the generalized gamma belief network (Generalized GBN) in this paper, which extends the original linear generative model to a more expressive non-linear generative model. We also propose an upward-downward Weibull inference network to approximate the posterior distribution of the latent variables.
  arXiv  Detail & Related papers  (2024-08-06T18:18:37Z)
• Scaling and renormalization in high-dimensional regression [72.59731158970894]
  We present a unifying perspective on recent results on ridge regression.<n>We use the basic tools of random matrix theory and free probability, aimed at readers with backgrounds in physics and deep learning.<n>Our results extend and provide a unifying perspective on earlier models of scaling laws.
  arXiv  Detail & Related papers  (2024-05-01T15:59:00Z)
• Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Models [88.63781315038824]
  We present a framework that enables us to analyze a regularizer's behavior empirically with a slight change in the neural net's architecture and the training objective.
  arXiv  Detail & Related papers  (2022-10-24T10:42:26Z)
• Lipschitz Continuity Retained Binary Neural Network [52.17734681659175]
  We introduce the Lipschitz continuity as the rigorous criteria to define the model robustness for BNN. We then propose to retain the Lipschitz continuity as a regularization term to improve the model robustness. Our experiments prove that our BNN-specific regularization method can effectively strengthen the robustness of BNN.
  arXiv  Detail & Related papers  (2022-07-13T22:55:04Z)
• Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustness [3.2872586139884623]
  This paper introduces recurrent equilibrium networks (RENs) for applications in machine learning, system identification and control. RENs are parameterized directly by quadratic vector in RN, i.e. stability and robustness are ensured without parameter constraints. The paper also presents applications in data-driven nonlinear observer design and control with stability guarantees.
  arXiv  Detail & Related papers  (2021-04-13T05:09:41Z)
• Identification of Probability weighted ARX models with arbitrary domains [75.91002178647165]
  PieceWise Affine models guarantees universal approximation, local linearity and equivalence to other classes of hybrid system. In this work, we focus on the identification of PieceWise Auto Regressive with eXogenous input models with arbitrary regions (NPWARX) The architecture is conceived following the Mixture of Expert concept, developed within the machine learning field.
  arXiv  Detail & Related papers  (2020-09-29T12:50:33Z)
• Monotone operator equilibrium networks [97.86610752856987]
  We develop a new class of implicit-depth model based on the theory of monotone operators, the Monotone Operator Equilibrium Network (monDEQ) We show the close connection between finding the equilibrium point of an implicit network and solving a form of monotone operator splitting problem. We then develop a parameterization of the network which ensures that all operators remain monotone, which guarantees the existence of a unique equilibrium point.
  arXiv  Detail & Related papers  (2020-06-15T17:57:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.