Automatic Clustering for Unsupervised Risk Diagnosis of Vehicle Driving
for Smart Road
- URL: http://arxiv.org/abs/2011.11933v1
- Date: Tue, 24 Nov 2020 07:15:03 GMT
- Title: Automatic Clustering for Unsupervised Risk Diagnosis of Vehicle Driving
for Smart Road
- Authors: Xiupeng Shi, Yiik Diew Wong, Chen Chai, Michael Zhi-Feng Li, Tianyi
Chen, Zeng Zeng
- Abstract summary: This study proposes a domain-specific automatic clustering (termed Autocluster) to self-learn the optimal models for unsupervised risk assessment.
Findings show that Autocluster is reliable and promising to diagnose multiple distinct risk exposures inherent to generalised driving behaviour.
- Score: 20.544782390670512
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Early risk diagnosis and driving anomaly detection from vehicle stream are of
great benefits in a range of advanced solutions towards Smart Road and crash
prevention, although there are intrinsic challenges, especially lack of ground
truth, definition of multiple risk exposures. This study proposes a
domain-specific automatic clustering (termed Autocluster) to self-learn the
optimal models for unsupervised risk assessment, which integrates key steps of
risk clustering into an auto-optimisable pipeline, including feature and
algorithm selection, hyperparameter auto-tuning. Firstly, based on surrogate
conflict measures, indicator-guided feature extraction is conducted to
construct temporal-spatial and kinematical risk features. Then we develop an
elimination-based model reliance importance (EMRI) method to
unsupervised-select the useful features. Secondly, we propose balanced
Silhouette Index (bSI) to evaluate the internal quality of imbalanced
clustering. A loss function is designed that considers the clustering
performance in terms of internal quality, inter-cluster variation, and model
stability. Thirdly, based on Bayesian optimisation, the algorithm selection and
hyperparameter auto-tuning are self-learned to generate the best clustering
partitions. Various algorithms are comprehensively investigated. Herein, NGSIM
vehicle trajectory data is used for test-bedding. Findings show that
Autocluster is reliable and promising to diagnose multiple distinct risk
exposures inherent to generalised driving behaviour. Besides, we also delve
into risk clustering, such as, algorithms heterogeneity, Silhouette analysis,
hierarchical clustering flows, etc. Meanwhile, the Autocluster is also a method
for unsupervised multi-risk data labelling and indicator threshold calibration.
Furthermore, Autocluster is useful to tackle the challenges in imbalanced
clustering without ground truth or priori knowledge
Related papers
- Secure Hierarchical Federated Learning in Vehicular Networks Using Dynamic Client Selection and Anomaly Detection [10.177917426690701]
Hierarchical Federated Learning (HFL) faces the challenge of adversarial or unreliable vehicles in vehicular networks.
Our study introduces a novel framework that integrates dynamic vehicle selection and robust anomaly detection mechanisms.
Our proposed algorithm demonstrates remarkable resilience even under intense attack conditions.
arXiv Detail & Related papers (2024-05-25T18:31:20Z) - Likelihood Ratio Confidence Sets for Sequential Decision Making [51.66638486226482]
We revisit the likelihood-based inference principle and propose to use likelihood ratios to construct valid confidence sequences.
Our method is especially suitable for problems with well-specified likelihoods.
We show how to provably choose the best sequence of estimators and shed light on connections to online convex optimization.
arXiv Detail & Related papers (2023-11-08T00:10:21Z) - Unsupervised Self-Driving Attention Prediction via Uncertainty Mining
and Knowledge Embedding [51.8579160500354]
We propose an unsupervised way to predict self-driving attention by uncertainty modeling and driving knowledge integration.
Results show equivalent or even more impressive performance compared to fully-supervised state-of-the-art approaches.
arXiv Detail & Related papers (2023-03-17T00:28:33Z) - Multi-Agent Chance-Constrained Stochastic Shortest Path with Application
to Risk-Aware Intelligent Intersection [15.149982804527182]
A formidable challenge for existing automated intersections lies in detecting and reasoning about uncertainty from the operating environment and human-driven vehicles.
We propose a risk-aware intelligent intersection system for autonomous vehicles (AVs) as well as human-driven vehicles (HVs)
arXiv Detail & Related papers (2022-10-03T06:49:23Z) - Hybrid Dynamic Contrast and Probability Distillation for Unsupervised
Person Re-Id [109.1730454118532]
Unsupervised person re-identification (Re-Id) has attracted increasing attention due to its practical application in the read-world video surveillance system.
We present the hybrid dynamic cluster contrast and probability distillation algorithm.
It formulates the unsupervised Re-Id problem into an unified local-to-global dynamic contrastive learning and self-supervised probability distillation framework.
arXiv Detail & Related papers (2021-09-29T02:56:45Z) - I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of
Strategic Planners for Autonomous Vehicles Using Hypergames [12.244501203346566]
We develop a novel multi-agent dynamic occlusion risk measure for assessing situational risk.
We present a white-box, scenario-based, accelerated safety validation framework for assessing safety of strategic planners in AV.
arXiv Detail & Related papers (2021-09-20T19:38:14Z) - Applying Semi-Automated Hyperparameter Tuning for Clustering Algorithms [0.0]
This study proposes a framework for semi-automated hyperparameter tuning of clustering problems.
It uses a grid search to develop a series of graphs and easy to interpret metrics that can then be used for more efficient domain-specific evaluation.
Preliminary results show that internal metrics are unable to capture the semantic quality of the clusters developed.
arXiv Detail & Related papers (2021-08-25T05:48:06Z) - Large Scale Autonomous Driving Scenarios Clustering with Self-supervised
Feature Extraction [6.804209932400134]
This article proposes a comprehensive data clustering framework for a large set of vehicle driving data.
Our approach thoroughly considers the traffic elements, including both in-traffic agent objects and map information.
With the newly designed driving data clustering evaluation metrics based on data-augmentation, the accuracy assessment does not require a human-labeled data-set.
arXiv Detail & Related papers (2021-03-30T06:22:40Z) - Generating and Characterizing Scenarios for Safety Testing of Autonomous
Vehicles [86.9067793493874]
We propose efficient mechanisms to characterize and generate testing scenarios using a state-of-the-art driving simulator.
We use our method to characterize real driving data from the Next Generation Simulation (NGSIM) project.
We rank the scenarios by defining metrics based on the complexity of avoiding accidents and provide insights into how the AV could have minimized the probability of incurring an accident.
arXiv Detail & Related papers (2021-03-12T17:00:23Z) - Attribute-Guided Adversarial Training for Robustness to Natural
Perturbations [64.35805267250682]
We propose an adversarial training approach which learns to generate new samples so as to maximize exposure of the classifier to the attributes-space.
Our approach enables deep neural networks to be robust against a wide range of naturally occurring perturbations.
arXiv Detail & Related papers (2020-12-03T10:17:30Z) - ClusterVO: Clustering Moving Instances and Estimating Visual Odometry
for Self and Surroundings [54.33327082243022]
ClusterVO is a stereo Visual Odometry which simultaneously clusters and estimates the motion of both ego and surrounding rigid clusters/objects.
Unlike previous solutions relying on batch input or imposing priors on scene structure or dynamic object models, ClusterVO is online, general and thus can be used in various scenarios including indoor scene understanding and autonomous driving.
arXiv Detail & Related papers (2020-03-29T09:06:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.