Runtime Safety Assurance Using Reinforcement Learning
- URL: http://arxiv.org/abs/2010.10618v1
- Date: Tue, 20 Oct 2020 20:54:46 GMT
- Title: Runtime Safety Assurance Using Reinforcement Learning
- Authors: Christopher Lazarus, James G. Lopez, Mykel J. Kochenderfer
- Abstract summary: This paper aims to design a meta-controller capable of identifying unsafe situations with high accuracy.
We frame the design of RTSA with the Markov decision process (MDP) and use reinforcement learning (RL) to solve it.
- Score: 37.61747231296097
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The airworthiness and safety of a non-pedigreed autopilot must be verified,
but the cost to formally do so can be prohibitive. We can bypass formal
verification of non-pedigreed components by incorporating Runtime Safety
Assurance (RTSA) as mechanism to ensure safety. RTSA consists of a
meta-controller that observes the inputs and outputs of a non-pedigreed
component and verifies formally specified behavior as the system operates. When
the system is triggered, a verified recovery controller is deployed. Recovery
controllers are designed to be safe but very likely disruptive to the
operational objective of the system, and thus RTSA systems must balance safety
and efficiency. The objective of this paper is to design a meta-controller
capable of identifying unsafe situations with high accuracy. High dimensional
and non-linear dynamics in which modern controllers are deployed along with the
black-box nature of the nominal controllers make this a difficult problem.
Current approaches rely heavily on domain expertise and human engineering. We
frame the design of RTSA with the Markov decision process (MDP) framework and
use reinforcement learning (RL) to solve it. Our learned meta-controller
consistently exhibits superior performance in our experiments compared to our
baseline, human engineered approach.
Related papers
Err
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.