Inverse Optimal Control Adapted to the Noise Characteristics of the
Human Sensorimotor System
- URL: http://arxiv.org/abs/2110.11130v1
- Date: Thu, 21 Oct 2021 13:30:14 GMT
- Title: Inverse Optimal Control Adapted to the Noise Characteristics of the
Human Sensorimotor System
- Authors: Matthias Schultheis, Dominik Straub, Constantin A. Rothkopf
- Abstract summary: We introduce inverse optimal control with signal-dependent noise, which allows inferring the cost function from observed behavior.
We derive a probabilistic formulation of the evolution of states and belief states.
We extend the model to the case of partial observability of state variables from the point of view of the experimenter.
- Score: 5.629161809575013
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Computational level explanations based on optimal feedback control with
signal-dependent noise have been able to account for a vast array of phenomena
in human sensorimotor behavior. However, commonly a cost function needs to be
assumed for a task and the optimality of human behavior is evaluated by
comparing observed and predicted trajectories. Here, we introduce inverse
optimal control with signal-dependent noise, which allows inferring the cost
function from observed behavior. To do so, we formalize the problem as a
partially observable Markov decision process and distinguish between the
agent's and the experimenter's inference problems. Specifically, we derive a
probabilistic formulation of the evolution of states and belief states and an
approximation to the propagation equation in the linear-quadratic Gaussian
problem with signal-dependent noise. We extend the model to the case of partial
observability of state variables from the point of view of the experimenter. We
show the feasibility of the approach through validation on synthetic data and
application to experimental data. Our approach enables recovering the costs and
benefits implicit in human sequential sensorimotor behavior, thereby
reconciling normative and descriptive approaches in a computational framework.
Related papers
- Efficient Prior Calibration From Indirect Data [5.588334720483076]
This paper is concerned with learning the prior model from data, in particular, learning the prior from multiple realizations of indirect data obtained through the noisy observation process.
An efficient residual-based neural operator approximation of the forward model is proposed and it is shown that this may be learned concurrently with the pushforward map.
arXiv Detail & Related papers (2024-05-28T08:34:41Z) - Risk-Sensitive Diffusion for Perturbation-Robust Optimization [58.68233326265417]
We show that noisy samples incur another objective function, rather than the one with score function, which will wrongly optimize the model.
We introduce risk-sensitive SDE, a type of differential equation (SDE) parameterized by the risk vector.
We prove that zero instability measure is only achievable in the case where noisy samples are caused by Gaussian perturbation.
arXiv Detail & Related papers (2024-02-03T08:41:51Z) - Robust Estimation of Causal Heteroscedastic Noise Models [7.568978862189266]
Student's $t$-distribution is known for its robustness in accounting for sampling variability with smaller sample sizes and extreme values without significantly altering the overall distribution shape.
Our empirical evaluations demonstrate that our estimators are more robust and achieve better overall performance across synthetic and real benchmarks.
arXiv Detail & Related papers (2023-12-15T02:26:35Z) - Learning Unnormalized Statistical Models via Compositional Optimization [73.30514599338407]
Noise-contrastive estimation(NCE) has been proposed by formulating the objective as the logistic loss of the real data and the artificial noise.
In this paper, we study it a direct approach for optimizing the negative log-likelihood of unnormalized models.
arXiv Detail & Related papers (2023-06-13T01:18:16Z) - Probabilistic inverse optimal control for non-linear partially
observable systems disentangles perceptual uncertainty and behavioral costs [33.690374799743076]
We introduce a probabilistic approach to inverse optimal control for partially observable non-linear systems with unobserved action signals.
We show that our method can disentangle perceptual factors and behavioral costs despite the fact that neuroscience and pragmatic actions are intertwined in sequential decision-making under uncertainty.
arXiv Detail & Related papers (2023-03-29T13:51:06Z) - Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous
Unobserved Confounders [16.193776814471768]
We study robust policy evaluation and policy optimization in the presence of sequentially-exogenous unobserved confounders.
We provide sample complexity bounds, insights, and show effectiveness both in simulations and on real-world longitudinal healthcare data of treating sepsis.
arXiv Detail & Related papers (2023-02-01T18:40:53Z) - Data-Driven Influence Functions for Optimization-Based Causal Inference [105.5385525290466]
We study a constructive algorithm that approximates Gateaux derivatives for statistical functionals by finite differencing.
We study the case where probability distributions are not known a priori but need to be estimated from data.
arXiv Detail & Related papers (2022-08-29T16:16:22Z) - Partial Identification with Noisy Covariates: A Robust Optimization
Approach [94.10051154390237]
Causal inference from observational datasets often relies on measuring and adjusting for covariates.
We show that this robust optimization approach can extend a wide range of causal adjustment methods to perform partial identification.
Across synthetic and real datasets, we find that this approach provides ATE bounds with a higher coverage probability than existing methods.
arXiv Detail & Related papers (2022-02-22T04:24:26Z) - Efficient Causal Inference from Combined Observational and
Interventional Data through Causal Reductions [68.6505592770171]
Unobserved confounding is one of the main challenges when estimating causal effects.
We propose a novel causal reduction method that replaces an arbitrary number of possibly high-dimensional latent confounders.
We propose a learning algorithm to estimate the parameterized reduced model jointly from observational and interventional data.
arXiv Detail & Related papers (2021-03-08T14:29:07Z) - Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
Inferring the parameters of a model based on experimental observations is central to the scientific method.
A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations.
We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
arXiv Detail & Related papers (2021-02-12T12:23:13Z) - Generalized Multi-Output Gaussian Process Censored Regression [7.111443975103331]
We introduce a heteroscedastic multi-output Gaussian process model which combines the non-parametric flexibility of GPs with the ability to leverage information from correlated outputs under input-dependent noise conditions.
Results show how the added flexibility allows our model to better estimate the underlying non-censored (i.e. true) process under potentially complex censoring dynamics.
arXiv Detail & Related papers (2020-09-10T12:46:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.