Evaluating Temporal Observation-Based Causal Discovery Techniques
Applied to Road Driver Behaviour
- URL: http://arxiv.org/abs/2302.00064v2
- Date: Fri, 7 Apr 2023 12:57:26 GMT
- Title: Evaluating Temporal Observation-Based Causal Discovery Techniques
Applied to Road Driver Behaviour
- Authors: Rhys Howard, Lars Kunze
- Abstract summary: We evaluate 10 contemporary observational temporal causal discovery methods in the domain of autonomous driving.
By evaluating these methods upon causal scenes drawn from real world datasets in addition to those generated synthetically we highlight where improvements need to be made.
We discuss potential directions for future work that could help better tackle the difficulties currently experienced by state of the art techniques.
- Score: 6.980076213134384
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Autonomous robots are required to reason about the behaviour of dynamic
agents in their environment. The creation of models to describe these
relationships is typically accomplished through the application of causal
discovery techniques. However, as it stands observational causal discovery
techniques struggle to adequately cope with conditions such as causal sparsity
and non-stationarity typically seen during online usage in autonomous agent
domains. Meanwhile, interventional techniques are not always feasible due to
domain restrictions. In order to better explore the issues facing observational
techniques and promote further discussion of these topics we carry out a
benchmark across 10 contemporary observational temporal causal discovery
methods in the domain of autonomous driving. By evaluating these methods upon
causal scenes drawn from real world datasets in addition to those generated
synthetically we highlight where improvements need to be made in order to
facilitate the application of causal discovery techniques to the aforementioned
use-cases. Finally, we discuss potential directions for future work that could
help better tackle the difficulties currently experienced by state of the art
techniques.
Related papers
- RealTCD: Temporal Causal Discovery from Interventional Data with Large Language Model [15.416325455014462]
Temporal causal discovery aims to identify temporal causal relationships between variables directly from observations.
Existing methods mainly focus on synthetic datasets with heavy reliance on intervention targets.
We propose the RealTCD framework, which is able to leverage domain knowledge to discover temporal causal relationships without interventional targets.
arXiv Detail & Related papers (2024-04-23T06:52:40Z) - Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations [53.797896854533384]
Class-agnostic motion prediction methods directly predict the motion of the entire point cloud.
While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming.
We introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively.
arXiv Detail & Related papers (2024-03-20T02:58:45Z) - Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing [51.524108608250074]
Black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in remote sensing.
We perform a systematic review to identify the key trends in the field and shed light on novel explainable AI approaches.
We also give a detailed outlook on the challenges and promising research directions.
arXiv Detail & Related papers (2024-02-21T13:19:58Z) - Sim-to-Real Causal Transfer: A Metric Learning Approach to
Causally-Aware Interaction Representations [62.48505112245388]
We take an in-depth look at the causal awareness of modern representations of agent interactions.
We show that recent representations are already partially resilient to perturbations of non-causal agents.
We propose a metric learning approach that regularizes latent representations with causal annotations.
arXiv Detail & Related papers (2023-12-07T18:57:03Z) - Social Interaction-Aware Dynamical Models and Decision Making for
Autonomous Vehicles [20.123965317836106]
Interaction-aware Autonomous Driving (IAAD) is a rapidly growing field of research.
It focuses on the development of autonomous vehicles that are capable of interacting safely and efficiently with human road users.
This is a challenging task, as it requires the autonomous vehicle to be able to understand and predict the behaviour of human road users.
arXiv Detail & Related papers (2023-10-29T03:43:50Z) - A Survey on Transferability of Adversarial Examples across Deep Neural Networks [53.04734042366312]
adversarial examples can manipulate machine learning models into making erroneous predictions.
The transferability of adversarial examples enables black-box attacks which circumvent the need for detailed knowledge of the target model.
This survey explores the landscape of the adversarial transferability of adversarial examples.
arXiv Detail & Related papers (2023-10-26T17:45:26Z) - Simulation-Based Counterfactual Causal Discovery on Real World Driver
Behaviour [6.273003557777915]
We present three variants of the proposed counterfactual causal discovery method.
We evaluate these against state of the art observational temporal causal discovery methods across 3396 causal scenes extracted from a real world driving dataset.
arXiv Detail & Related papers (2023-06-06T02:10:20Z) - CausalBench: A Large-scale Benchmark for Network Inference from
Single-cell Perturbation Data [61.088705993848606]
We introduce CausalBench, a benchmark suite for evaluating causal inference methods on real-world interventional data.
CaulBench incorporates biologically-motivated performance metrics, including new distribution-based interventional metrics.
arXiv Detail & Related papers (2022-10-31T13:04:07Z) - When not to use machine learning: a perspective on potential and
limitations [0.0]
We highlight the guiding principles of data-driven modeling, how these principles imbue models with almost magical predictive power.
We hope that the discussion to follow provides researchers throughout the sciences with a better understanding of when said techniques are appropriate.
arXiv Detail & Related papers (2022-10-06T04:00:00Z) - Causal Navigation by Continuous-time Neural Networks [108.84958284162857]
We propose a theoretical and experimental framework for learning causal representations using continuous-time neural networks.
We evaluate our method in the context of visual-control learning of drones over a series of complex tasks.
arXiv Detail & Related papers (2021-06-15T17:45:32Z) - Augmented Behavioral Cloning from Observation [14.45796459531414]
Imitation from observation is a technique that teaches an agent on how to mimic the behavior of an expert by observing only the sequence of states from the expert demonstrations.
We show empirically that our approach outperforms the state-of-the-art approaches in four different environments by a large margin.
arXiv Detail & Related papers (2020-04-28T13:56:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.