Uncertainty Injection: A Deep Learning Method for Robust Optimization
- URL: http://arxiv.org/abs/2302.12304v2
- Date: Mon, 27 Feb 2023 02:49:51 GMT
- Title: Uncertainty Injection: A Deep Learning Method for Robust Optimization
- Authors: Wei Cui and Wei Yu
- Abstract summary: This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems.
We identify the wireless communications as an application field where uncertainties are prevalent in problem parameters.
We show the effectiveness of the proposed training scheme in two applications.
- Score: 16.13344685457395
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper proposes a paradigm of uncertainty injection for training deep
learning model to solve robust optimization problems. The majority of existing
studies on deep learning focus on the model learning capability, while assuming
the quality and accuracy of the inputs data can be guaranteed. However, in
realistic applications of deep learning for solving optimization problems, the
accuracy of inputs, which are the problem parameters in this case, plays a
large role. This is because, in many situations, it is often costly or sometime
impossible to obtain the problem parameters accurately, and correspondingly, it
is highly desirable to develop learning algorithms that can account for the
uncertainties in the input and produce solutions that are robust against these
uncertainties. This paper presents a novel uncertainty injection scheme for
training machine learning models that are capable of implicitly accounting for
the uncertainties and producing statistically robust solutions. We further
identify the wireless communications as an application field where
uncertainties are prevalent in problem parameters such as the channel
coefficients. We show the effectiveness of the proposed training scheme in two
applications: the robust power loading for multiuser
multiple-input-multiple-output (MIMO) downlink transmissions; and the robust
power control for device-to-device (D2D) networks.
Related papers
- Learning Controlled Stochastic Differential Equations [61.82896036131116]
This work proposes a novel method for estimating both drift and diffusion coefficients of continuous, multidimensional, nonlinear controlled differential equations with non-uniform diffusion.
We provide strong theoretical guarantees, including finite-sample bounds for (L2), (Linfty), and risk metrics, with learning rates adaptive to coefficients' regularity.
Our method is available as an open-source Python library.
arXiv Detail & Related papers (2024-11-04T11:09:58Z) - A deep neural network framework for dynamic multi-valued mapping estimation and its applications [3.21704928672212]
This paper introduces a deep neural network framework incorporating a generative network and a classification component.
The objective is to model the dynamic multi-valued mapping between the input and output by providing a reliable uncertainty measurement.
Experimental results show that our framework accurately estimates the dynamic multi-valued mapping with uncertainty estimation.
arXiv Detail & Related papers (2024-06-29T03:26:51Z) - Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning [17.962860438133312]
Decision-focused learning (DFL) paradigm overcomes limitation by training to directly minimize a task loss, e.g. regret.
We propose an alternative method that makes no such assumptions, it combines smoothing with score function estimation which works on any task loss.
Experiments show that it typically requires more epochs, but that it is on par with specialized methods and performs especially well for the difficult case of problems with uncertainty in the constraints, in terms of solution quality, scalability, or both.
arXiv Detail & Related papers (2023-07-11T12:32:13Z) - An Efficient Learning-Based Solver for Two-Stage DC Optimal Power Flow with Feasibility Guarantees [4.029937264494929]
This paper proposes a learning method to solve the two-stage problem in a more efficient and optimal way.
A technique called the gauge map is incorporated into the learning architecture design to guarantee the learned solutions' feasibility to the network constraints.
arXiv Detail & Related papers (2023-04-03T22:56:08Z) - A Learning-Based Optimal Uncertainty Quantification Method and Its
Application to Ballistic Impact Problems [1.713291434132985]
This paper concerns the optimal (supremum and infimum) uncertainty bounds for systems where the input (or prior) measure is only partially/imperfectly known.
We demonstrate the learning based framework on the uncertainty optimization problem.
We show that the approach can be used to construct maps for the performance certificate and safety in engineering practice.
arXiv Detail & Related papers (2022-12-28T14:30:53Z) - Learning MDPs from Features: Predict-Then-Optimize for Sequential
Decision Problems by Reinforcement Learning [52.74071439183113]
We study the predict-then-optimize framework in the context of sequential decision problems (formulated as MDPs) solved via reinforcement learning.
Two significant computational challenges arise in applying decision-focused learning to MDPs.
arXiv Detail & Related papers (2021-06-06T23:53:31Z) - Probabilistic robust linear quadratic regulators with Gaussian processes [73.0364959221845]
Probabilistic models such as Gaussian processes (GPs) are powerful tools to learn unknown dynamical systems from data for subsequent use in control design.
We present a novel controller synthesis for linearized GP dynamics that yields robust controllers with respect to a probabilistic stability margin.
arXiv Detail & Related papers (2021-05-17T08:36:18Z) - Offline Model-Based Optimization via Normalized Maximum Likelihood
Estimation [101.22379613810881]
We consider data-driven optimization problems where one must maximize a function given only queries at a fixed set of points.
This problem setting emerges in many domains where function evaluation is a complex and expensive process.
We propose a tractable approximation that allows us to scale our method to high-capacity neural network models.
arXiv Detail & Related papers (2021-02-16T06:04:27Z) - High Dimensional Level Set Estimation with Bayesian Neural Network [58.684954492439424]
This paper proposes novel methods to solve the high dimensional Level Set Estimation problems using Bayesian Neural Networks.
For each problem, we derive the corresponding theoretic information based acquisition function to sample the data points.
Numerical experiments on both synthetic and real-world datasets show that our proposed method can achieve better results compared to existing state-of-the-art approaches.
arXiv Detail & Related papers (2020-12-17T23:21:53Z) - Combining Deep Learning and Optimization for Security-Constrained
Optimal Power Flow [94.24763814458686]
Security-constrained optimal power flow (SCOPF) is fundamental in power systems.
Modeling of APR within the SCOPF problem results in complex large-scale mixed-integer programs.
This paper proposes a novel approach that combines deep learning and robust optimization techniques.
arXiv Detail & Related papers (2020-07-14T12:38:21Z) - An Hybrid Method for the Estimation of the Breast Mechanical Parameters [0.9176056742068814]
An accurate numerical breast model can provide assistance to surgeons with visual information of the breast as a result of a surgery simulation.
The process of finding the model parameters requires numeric inputs, either based in medical imaging techniques, or other measures.
Inverse elasticity solvers are highly robust and provide solutions within the required degree of accuracy.
Deep-learning methods, such as neural networks, can provide accurate results in the majority of cases.
arXiv Detail & Related papers (2020-03-09T11:21:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.