Accelerating Road Sign Ground Truth Construction with Knowledge Graph and Machine Learning

• URL: http://arxiv.org/abs/2012.02672v1
• Date: Fri, 4 Dec 2020 15:42:08 GMT
• Title: Accelerating Road Sign Ground Truth Construction with Knowledge Graph and Machine Learning
• Authors: Ji Eun Kim, Cory Henson, Kevin Huang, Tuan A. Tran, Wan-Yi Lin
• Abstract summary: We propose a novel approach using knowledge graphs and a machine learning algorithm to assist human annotators in classifying road signs effectively. Annotators can query the Road Sign Knowledge Graph using visual attributes and receive closest matching candidates suggested by the VPE model. We show that our knowledge graph approach can reduce sign search space by 98.9%.
• Score: 5.226306460380354
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Having a comprehensive, high-quality dataset of road sign annotation is critical to the success of AI-based Road Sign Recognition (RSR) systems. In practice, annotators often face difficulties in learning road sign systems of different countries; hence, the tasks are often time-consuming and produce poor results. We propose a novel approach using knowledge graphs and a machine learning algorithm - variational prototyping-encoder (VPE) - to assist human annotators in classifying road signs effectively. Annotators can query the Road Sign Knowledge Graph using visual attributes and receive closest matching candidates suggested by the VPE model. The VPE model uses the candidates from the knowledge graph and a real sign image patch as inputs. We show that our knowledge graph approach can reduce sign search space by 98.9%. Furthermore, with VPE, our system can propose the correct single candidate for 75% of signs in the tested datasets, eliminating the human search effort entirely in those cases.

Related papers

• Training A Neural Network For Partially Occluded Road Sign Identification In The Context Of Autonomous Vehicles [0.0]
  We investigated how partial occlusion of traffic signs affects their recognition. We compared the performance of our custom convolutional neural network (CNN), which achieved 96% accuracy, with models trained using transfer learning. Additional experiments revealed that models trained solely on fully visible signs lose effectiveness when recognizing occluded signs.
  arXiv  Detail & Related papers  (2025-03-23T19:25:56Z)
• Adversary ML Resilience in Autonomous Driving Through Human Centered Perception Mechanisms [0.0]
  This paper explores the resilience of autonomous driving systems against three main physical adversarial attacks (tape, graffiti, illumination) To build robustness against attacks, defense techniques like adversarial training and transfer learning were implemented. Results demonstrated transfer learning models played a crucial role in performance by allowing knowledge gained from shape training to improve generalizability of road sign classification.
  arXiv  Detail & Related papers  (2023-11-02T04:11:45Z)
• Learning Transferable Pedestrian Representation from Multimodal Information Supervision [174.5150760804929]
  VAL-PAT is a novel framework that learns transferable representations to enhance various pedestrian analysis tasks with multimodal information. We first perform pre-training on LUPerson-TA dataset, where each image contains text and attribute annotations. We then transfer the learned representations to various downstream tasks, including person reID, person attribute recognition and text-based person search.
  arXiv  Detail & Related papers  (2023-04-12T01:20:58Z)
• Learning Graph Search Heuristics [48.83557172525969]
  We present PHIL (Path Heuristic with Imitation Learning), a novel neural architecture and a training algorithm for discovering graph search and navigations from data. Our function learns graph embeddings useful for inferring node distances, runs in constant time independent of graph sizes, and can be easily incorporated in an algorithm such as A* at test time. Experiments show that PHIL reduces the number of explored nodes compared to state-of-the-art methods on benchmark datasets by 58.5% on average.
  arXiv  Detail & Related papers  (2022-12-07T22:28:00Z)
• A Survey on Visual Transfer Learning using Knowledge Graphs [0.8701566919381223]
  This survey focuses on visual transfer learning approaches using knowledge graphs (KGs) KGs can represent auxiliary knowledge either in an underlying graph-structured schema or in a vector-based knowledge graph embedding. We provide a broad overview of knowledge graph embedding methods and describe several joint training objectives suitable to combine them with high dimensional visual embeddings.
  arXiv  Detail & Related papers  (2022-01-27T20:19:55Z)
• RoadAtlas: Intelligent Platform for Automated Road Defect Detection and Asset Management [8.441428233111843]
  RoadAtlas is a novel end-to-end integrated system that can support road defect detection, road marking parsing, and a web-based dashboard for presenting and inputting data by users.
  arXiv  Detail & Related papers  (2021-09-08T01:26:15Z)
• Don't Forget to Sign the Gradients! [60.98885980669777]
  GradSigns is a novel watermarking framework for deep neural networks (DNNs) We present GradSigns, a novel watermarking framework for deep neural networks (DNNs)
  arXiv  Detail & Related papers  (2021-03-05T14:24:32Z)
• Graph Self-Supervised Learning: A Survey [73.86209411547183]
  Self-supervised learning (SSL) has become a promising and trending learning paradigm for graph data. We present a timely and comprehensive review of the existing approaches which employ SSL techniques for graph data.
  arXiv  Detail & Related papers  (2021-02-27T03:04:21Z)
• Structural Information Preserving for Graph-to-Text Generation [59.00642847499138]
  The task of graph-to-text generation aims at producing sentences that preserve the meaning of input graphs. We propose to tackle this problem by leveraging richer training signals that can guide our model for preserving input information. Experiments on two benchmarks for graph-to-text generation show the effectiveness of our approach over a state-of-the-art baseline.
  arXiv  Detail & Related papers  (2021-02-12T20:09:01Z)
• Road images augmentation with synthetic traffic signs using neural networks [3.330229314824913]
  We consider the task of rare traffic sign detection and classification. We aim to solve that problem by using synthetic training data. We propose three methods for making synthetic signs consistent with a scene in appearance.
  arXiv  Detail & Related papers  (2021-01-13T08:10:33Z)
• BoMuDANet: Unsupervised Adaptation for Visual Scene Understanding in Unstructured Driving Environments [54.22535063244038]
  We present an unsupervised adaptation approach for visual scene understanding in unstructured traffic environments. Our method is designed for unstructured real-world scenarios with dense and heterogeneous traffic consisting of cars, trucks, two-and three-wheelers, and pedestrians.
  arXiv  Detail & Related papers  (2020-09-22T08:25:44Z)
• Automatic Signboard Detection and Localization in Densely Populated Developing Cities [0.0]
  Signboard detection in natural scene images is the foremost task for error-free information retrieval. We present a novel object detection approach that can detect signboards automatically and is suitable for such cities. Our proposed method can detect signboards accurately (even if the images contain multiple signboards with diverse shapes and colours in a noisy background) achieving 0.90 mAP (mean average precision)
  arXiv  Detail & Related papers  (2020-03-04T08:04:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.