Explainable Online Lane Change Predictions on a Digital Twin with a Layer Normalized LSTM and Layer-wise Relevance Propagation

• URL: http://arxiv.org/abs/2204.01292v1
• Date: Mon, 4 Apr 2022 07:54:42 GMT
• Title: Explainable Online Lane Change Predictions on a Digital Twin with a Layer Normalized LSTM and Layer-wise Relevance Propagation
• Authors: Christoph Wehner and Francis Powlesland and Bashar Altakrouri and Ute Schmid
• Abstract summary: Long short-term memory (LSTM) is a leading driver in the field of lane change prediction for manoeuvre anticipation. This work presents an innovative approach and a technical implementation for explaining lane change predictions of layer normalized LSTMs. The core implementation includes consuming live data from a digital twin on a German highway, live predictions and explanations of lane changes by extending LRP to layer normalized LSTMs, and an interface for communicating and explaining the predictions to a human user.
• Score: 0.8137198664755597
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Artificial Intelligence and Digital Twins play an integral role in driving innovation in the domain of intelligent driving. Long short-term memory (LSTM) is a leading driver in the field of lane change prediction for manoeuvre anticipation. However, the decision-making process of such models is complex and non-transparent, hence reducing the trustworthiness of the smart solution. This work presents an innovative approach and a technical implementation for explaining lane change predictions of layer normalized LSTMs using Layer-wise Relevance Propagation (LRP). The core implementation includes consuming live data from a digital twin on a German highway, live predictions and explanations of lane changes by extending LRP to layer normalized LSTMs, and an interface for communicating and explaining the predictions to a human user. We aim to demonstrate faithful, understandable, and adaptable explanations of lane change prediction to increase the adoption and trustworthiness of AI systems that involve humans. Our research also emphases that explainability and state-of-the-art performance of ML models for manoeuvre anticipation go hand in hand without negatively affecting predictive effectiveness.

Related papers

• Strada-LLM: Graph LLM for traffic prediction [62.2015839597764]
  A considerable challenge in traffic prediction lies in handling the diverse data distributions caused by vastly different traffic conditions. We propose a graph-aware LLM for traffic prediction that considers proximal traffic information. We adopt a lightweight approach for efficient domain adaptation when facing new data distributions in few-shot fashion.
  arXiv  Detail & Related papers  (2024-10-28T09:19:29Z)
• GenFollower: Enhancing Car-Following Prediction with Large Language Models [11.847589952558566]
  We propose GenFollower, a novel zero-shot prompting approach that leverages large language models (LLMs) to address these challenges. We reframe car-following behavior as a language modeling problem and integrate heterogeneous inputs into structured prompts for LLMs. Experiments on Open datasets demonstrate GenFollower's superior performance and ability to provide interpretable insights.
  arXiv  Detail & Related papers  (2024-07-08T04:54:42Z)
• On the Road to Clarity: Exploring Explainable AI for World Models in a Driver Assistance System [3.13366804259509]
  We build a transparent backbone model for convolutional variational autoencoders (VAE) We propose explanation and evaluation techniques for the internal dynamics and feature relevance of prediction networks. We showcase our methods by analyzing a VAE-LSTM world model that predicts pedestrian perception in an urban traffic situation.
  arXiv  Detail & Related papers  (2024-04-26T11:57:17Z)
• LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models [8.624969693477448]
  Existing motion prediction approaches have ample room for improvement, particularly in terms of long-term prediction accuracy and interpretability. We propose LC-LLM, an explainable lane change prediction model that leverages the strong reasoning capabilities and self-explanation abilities of Large Language Models.
  arXiv  Detail & Related papers  (2024-03-27T08:34:55Z)
• Towards Safe and Reliable Autonomous Driving: Dynamic Occupancy Set Prediction [12.336412741837407]
  This study introduces a novel method for Dynamic Occupancy Set (DOS) prediction, it effectively combines advanced trajectory prediction networks with a DOS prediction module. The innovative contributions of this study include the development of a novel DOS prediction model specifically tailored for navigating complex scenarios.
  arXiv  Detail & Related papers  (2024-02-29T17:36:39Z)
• RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality [51.244807332133696]
  This paper introduces RACER, a cutting-edge deep learning car-following model to predict Adaptive Cruise Control (ACC) driving behavior. Unlike conventional models, RACER effectively integrates Rational Driving Constraints (RDCs), crucial tenets of actual driving. RACER excels across key metrics, such as acceleration, velocity, and spacing, registering zero violations.
  arXiv  Detail & Related papers  (2023-12-12T06:21:30Z)
• Adaptive Trajectory Prediction via Transferable GNN [74.09424229172781]
  We propose a novel Transferable Graph Neural Network (T-GNN) framework, which jointly conducts trajectory prediction as well as domain alignment in a unified framework. Specifically, a domain invariant GNN is proposed to explore the structural motion knowledge where the domain specific knowledge is reduced. An attention-based adaptive knowledge learning module is further proposed to explore fine-grained individual-level feature representation for knowledge transfer.
  arXiv  Detail & Related papers  (2022-03-09T21:08:47Z)
• Bayesian Optimization and Deep Learning forsteering wheel angle prediction [58.720142291102135]
  This work aims to obtain an accurate model for the prediction of the steering angle in an automated driving system. BO was able to identify, within a limited number of trials, a model -- namely BOST-LSTM -- which resulted, the most accurate when compared to classical end-to-end driving models.
  arXiv  Detail & Related papers  (2021-10-22T15:25:14Z)
• Online Metro Origin-Destination Prediction via Heterogeneous Information Aggregation [99.54200992904721]
  We propose a novel neural network module termed Heterogeneous Information Aggregation Machine (HIAM) to jointly learn the evolutionary patterns of OD and DO ridership. An OD modeling branch estimates the potential destinations of unfinished orders explicitly to complement the information of incomplete OD matrices. A DO modeling branch takes DO matrices as input to capture the spatial-temporal distribution of DO ridership. Based on the proposed HIAM, we develop a unified Seq2Seq network to forecast the future OD and DO ridership simultaneously.
  arXiv  Detail & Related papers  (2021-07-02T10:11:51Z)
• A Driving Behavior Recognition Model with Bi-LSTM and Multi-Scale CNN [59.57221522897815]
  We propose a neural network model based on trajectories information for driving behavior recognition. We evaluate the proposed model on the public BLVD dataset, achieving a satisfying performance.
  arXiv  Detail & Related papers  (2021-03-01T06:47:29Z)
• A Multi-Modal States based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction [3.131740922192114]
  We propose a vehicle-descriptor based LSTM model with the dilated convolutional social pooling (VD+DCS-LSTM) to cope with the above issues. Each vehicle's multi-modal state information is employed as our model's input. The validity of the overall model was verified over the NGSIM US-101 and I-80 datasets.
  arXiv  Detail & Related papers  (2020-03-07T01:23:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.