Abstracting Noisy Robot Programs
- URL: http://arxiv.org/abs/2204.03536v1
- Date: Thu, 7 Apr 2022 16:04:19 GMT
- Title: Abstracting Noisy Robot Programs
- Authors: Till Hofmann, Vaishak Belle
- Abstract summary: We describe an approach to abstraction of probabilistic and dynamic systems.
Based on a variant of the situation calculus with probabilistic belief, we define a notion of bisimulation.
We obtain abstract Golog programs that omit unnecessary details and which can be translated back to a detailed program for actual execution.
- Score: 17.04153879817609
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Abstraction is a commonly used process to represent some low-level system by
a more coarse specification with the goal to omit unnecessary details while
preserving important aspects. While recent work on abstraction in the situation
calculus has focused on non-probabilistic domains, we describe an approach to
abstraction of probabilistic and dynamic systems. Based on a variant of the
situation calculus with probabilistic belief, we define a notion of
bisimulation that allows to abstract a detailed probabilistic basic action
theory with noisy actuators and sensors by a possibly deterministic basic
action theory. By doing so, we obtain abstract Golog programs that omit
unnecessary details and which can be translated back to a detailed program for
actual execution. This simplifies the implementation of noisy robot programs,
opens up the possibility of using deterministic reasoning methods (e.g.,
planning) on probabilistic problems, and provides domain descriptions that are
more easily understandable and explainable.
Related papers
- From Reals to Logic and Back: Inventing Symbolic Vocabularies, Actions,
and Models for Planning from Raw Data [20.01856556195228]
This paper presents the first approach for autonomously learning logic-based relational representations for abstract states and actions.
The learned representations constitute auto-invented PDDL-like domain models.
Empirical results in deterministic settings show that powerful abstract representations can be learned from just a handful of robot trajectories.
arXiv Detail & Related papers (2024-02-19T06:28:21Z) - Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning [83.41487567765871]
Skipper is a model-based reinforcement learning framework.
It automatically generalizes the task given into smaller, more manageable subtasks.
It enables sparse decision-making and focused abstractions on the relevant parts of the environment.
arXiv Detail & Related papers (2023-09-30T02:25:18Z) - AI planning in the imagination: High-level planning on learned abstract
search spaces [68.75684174531962]
We propose a new method, called PiZero, that gives an agent the ability to plan in an abstract search space that the agent learns during training.
We evaluate our method on multiple domains, including the traveling salesman problem, Sokoban, 2048, the facility location problem, and Pacman.
arXiv Detail & Related papers (2023-08-16T22:47:16Z) - Ideal Abstractions for Decision-Focused Learning [108.15241246054515]
We propose a method that configures the output space automatically in order to minimize the loss of decision-relevant information.
We demonstrate the method in two domains: data acquisition for deep neural network training and a closed-loop wildfire management task.
arXiv Detail & Related papers (2023-03-29T23:31:32Z) - Abstraction-Refinement for Hierarchical Probabilistic Models [8.959154445409057]
We exploit a hierarchical structure with repetitive parts to verify Markov decision processes.
In this paper, we focus on a local case, in which the subroutines have a limited effect on the overall system state.
The key ideas to accelerate analysis of such programs are (1) to treat the behavior of the subroutine as uncertain and only remove this uncertainty by a detailed analysis if needed, and (2) to abstract similar subroutines into a parametric template, and then analyse this template.
arXiv Detail & Related papers (2022-06-06T14:44:36Z) - Inventing Relational State and Action Abstractions for Effective and
Efficient Bilevel Planning [26.715198108255162]
We develop a novel framework for learning state and action abstractions.
We learn relational, neuro-symbolic abstractions that generalize over object identities and numbers.
We show that our learned abstractions are able to quickly solve held-out tasks of longer horizons.
arXiv Detail & Related papers (2022-03-17T22:13:09Z) - Towards a Mathematical Theory of Abstraction [0.0]
We provide a precise characterisation of what an abstraction is and, perhaps more importantly, suggest how abstractions can be learnt directly from data.
Our results have deep implications for statistical inference and machine learning and could be used to develop explicit methods for learning precise kinds of abstractions directly from data.
arXiv Detail & Related papers (2021-06-03T13:23:49Z) - Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and
Execution [97.50813120600026]
Spatial-temporal reasoning is a challenging task in Artificial Intelligence (AI)
Recent works have focused on an abstract reasoning task of this kind -- Raven's Progressive Matrices ( RPM)
We propose a neuro-symbolic Probabilistic Abduction and Execution learner (PrAE) learner.
arXiv Detail & Related papers (2021-03-26T02:42:18Z) - Representing Partial Programs with Blended Abstract Semantics [62.20775388513027]
We introduce a technique for representing partially written programs in a program synthesis engine.
We learn an approximate execution model implemented as a modular neural network.
We show that these hybrid neuro-symbolic representations enable execution-guided synthesizers to use more powerful language constructs.
arXiv Detail & Related papers (2020-12-23T20:40:18Z) - Process Discovery for Structured Program Synthesis [70.29027202357385]
A core task in process mining is process discovery which aims to learn an accurate process model from event log data.
In this paper, we propose to use (block-) structured programs directly as target process models.
We develop a novel bottom-up agglomerative approach to the discovery of such structured program process models.
arXiv Detail & Related papers (2020-08-13T10:33:10Z) - Extracting Semantic Indoor Maps from Occupancy Grids [2.4214518935746185]
We focus on the semantic mapping of indoor environments.
We propose a method to extract an abstracted floor plan from typical grid maps using Bayesian reasoning.
We demonstrate the effectiveness of the approach using real-world data.
arXiv Detail & Related papers (2020-02-19T18:52:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.