Reliability Validation of Learning Enabled Vehicle Tracking

• URL: http://arxiv.org/abs/2002.02424v1
• Date: Thu, 6 Feb 2020 18:07:54 GMT
• Title: Reliability Validation of Learning Enabled Vehicle Tracking
• Abstract summary: This paper studies the reliability of a real-world learning-enabled system, which conducts dynamic vehicle tracking. It is known that neural networks suffer from adversarial examples, which make them lack robustness. By integrating a coverage-guided neural network testing tool, DeepConcolic, with the vehicle tracking system, we found that the overall system can be resilient to some adversarial examples.
• Score: 13.642244802899471
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper studies the reliability of a real-world learning-enabled system, which conducts dynamic vehicle tracking based on a high-resolution wide-area motion imagery input. The system consists of multiple neural network components -- to process the imagery inputs -- and multiple symbolic (Kalman filter) components -- to analyse the processed information for vehicle tracking. It is known that neural networks suffer from adversarial examples, which make them lack robustness. However, it is unclear if and how the adversarial examples over learning components can affect the overall system-level reliability. By integrating a coverage-guided neural network testing tool, DeepConcolic, with the vehicle tracking system, we found that (1) the overall system can be resilient to some adversarial examples thanks to the existence of other components, and (2) the overall system presents an extra level of uncertainty which cannot be determined by analysing the deep learning components only. This research suggests the need for novel verification and validation methods for learning-enabled systems.

Related papers

• SETA: Statistical Fault Attribution for Compound AI Systems [0.0]
  Testing AI systems for robustness and safety entails significant challenges.<n>We propose a modular robustness testing framework that applies a given set of perturbations to test data.<n>We apply the framework to a real-world autonomous rail inspection system composed of multiple deep networks.
  arXiv  Detail & Related papers  (2026-01-27T08:21:28Z)
• Demystifying the Role of Rule-based Detection in AI Systems for Windows Malware Detection [12.318835339832056]
  Malware detection increasingly relies on AI systems that integrate signature-based detection with machine learning.<n>We investigate the influence that signature-based detection exerts on model training, when they are included inside the training pipeline.
  arXiv  Detail & Related papers  (2025-08-13T09:35:51Z)
• A General Framework for Property-Driven Machine Learning [1.0485739694839669]
  We show that adversarial training can be used to improve robustness to small perturbations within $epsilon$-cubes.<n> domains other than computer vision may require more flexible input region specifications via generalised hyper-rectangles.<n>In this paper, we investigate how these two complementary approaches can be unified within a single framework for property-driven machine learning.
  arXiv  Detail & Related papers  (2025-05-01T11:33:38Z)
• Critical Learning Periods for Multisensory Integration in Deep Networks [112.40005682521638]
  We show that the ability of a neural network to integrate information from diverse sources hinges critically on being exposed to properly correlated signals during the early phases of training. We show that critical periods arise from the complex and unstable early transient dynamics, which are decisive of final performance of the trained system and their learned representations.
  arXiv  Detail & Related papers  (2022-10-06T23:50:38Z)
• Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks [107.8565143456161]
  We investigate the information processing strategies adopted by simple artificial neural networks performing a variety of cognitive tasks. Results show that synergy increases as neural networks learn multiple diverse tasks. randomly turning off neurons during training through dropout increases network redundancy, corresponding to an increase in robustness.
  arXiv  Detail & Related papers  (2022-10-06T15:36:27Z)
• Neurosymbolic hybrid approach to driver collision warning [64.02492460600905]
  There are two main algorithmic approaches to autonomous driving systems. Deep learning alone has achieved state-of-the-art results in many areas. But sometimes it can be very difficult to debug if the deep learning model doesn't work.
  arXiv  Detail & Related papers  (2022-03-28T20:29:50Z)
• Simultaneous Learning of the Inputs and Parameters in Neural Collaborative Filtering [5.076419064097734]
  We show that the non-zero elements of the inputs are learnable parameters that determine the weights in combining the user/item embeddings. We propose to learn the value of the non-zero elements of the inputs jointly with the neural network parameters.
  arXiv  Detail & Related papers  (2022-03-14T19:47:38Z)
• Statistical Mechanical Analysis of Catastrophic Forgetting in Continual Learning with Teacher and Student Networks [5.209145866174911]
  When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. We provide the theoretical framework for analyzing catastrophic forgetting by using teacher-student learning. We find that the network can avoid catastrophic forgetting when the similarity among input distributions is small and that of the input-output relationship of the target functions is large.
  arXiv  Detail & Related papers  (2021-05-16T09:02:48Z)
• A neural anisotropic view of underspecification in deep learning [60.119023683371736]
  We show that the way neural networks handle the underspecification of problems is highly dependent on the data representation. Our results highlight that understanding the architectural inductive bias in deep learning is fundamental to address the fairness, robustness, and generalization of these systems.
  arXiv  Detail & Related papers  (2021-04-29T14:31:09Z)
• Increasing the Confidence of Deep Neural Networks by Coverage Analysis [71.57324258813674]
  This paper presents a lightweight monitoring architecture based on coverage paradigms to enhance the model against different unsafe inputs. Experimental results show that the proposed approach is effective in detecting both powerful adversarial examples and out-of-distribution inputs.
  arXiv  Detail & Related papers  (2021-01-28T16:38:26Z)
• Safety Verification of Neural Network Controlled Systems [0.0]
  We propose a system-level approach for verifying the safety of neural network controlled systems. We assume a generic model for the controller that can capture both simple and complex behaviours. We perform a reachability analysis that soundly approximates the reachable states of the overall system.
  arXiv  Detail & Related papers  (2020-11-10T15:26:38Z)
• VATLD: A Visual Analytics System to Assess, Understand and Improve Traffic Light Detection [15.36267013724161]
  We propose a visual analytics system, VATLD, to assess, understand, and improve the accuracy and robustness of traffic light detectors in autonomous driving applications. The disentangled representation learning extracts data semantics to augment human cognition with human-friendly visual summarization. We also demonstrate the effectiveness of various performance improvement strategies with our visual analytics system, VATLD, and illustrate some practical implications for safety-critical applications in autonomous driving.
  arXiv  Detail & Related papers  (2020-09-27T22:39:00Z)
• Firearm Detection and Segmentation Using an Ensemble of Semantic Neural Networks [62.997667081978825]
  We present a weapon detection system based on an ensemble of semantic Convolutional Neural Networks. A set of simpler neural networks dedicated to specific tasks requires less computational resources and can be trained in parallel. The overall output of the system given by the aggregation of the outputs of individual networks can be tuned by a user to trade-off false positives and false negatives.
  arXiv  Detail & Related papers  (2020-02-11T13:58:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.