Towards Real-time Traffic Sign and Traffic Light Detection on Embedded Systems

• URL: http://arxiv.org/abs/2205.02421v1
• Date: Thu, 5 May 2022 03:46:19 GMT
• Title: Towards Real-time Traffic Sign and Traffic Light Detection on Embedded Systems
• Authors: Oshada Jayasinghe, Sahan Hemachandra, Damith Anhettigama, Shenali Kariyawasam, Tharindu Wickremasinghe, Chalani Ekanayake, Ranga Rodrigo, Peshala Jayasekara
• Abstract summary: We propose a simple deep learning based end-to-end detection framework to tackle challenges inherent to traffic sign and traffic light detection. The overall system achieves a high inference speed of 63 frames per second, demonstrating the capability of our system to perform in real-time. CeyRo is the first ever large-scale traffic sign and traffic light detection dataset for the Sri Lankan context.
• Score: 0.6143225301480709
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent work done on traffic sign and traffic light detection focus on improving detection accuracy in complex scenarios, yet many fail to deliver real-time performance, specifically with limited computational resources. In this work, we propose a simple deep learning based end-to-end detection framework, which effectively tackles challenges inherent to traffic sign and traffic light detection such as small size, large number of classes and complex road scenarios. We optimize the detection models using TensorRT and integrate with Robot Operating System to deploy on an Nvidia Jetson AGX Xavier as our embedded device. The overall system achieves a high inference speed of 63 frames per second, demonstrating the capability of our system to perform in real-time. Furthermore, we introduce CeyRo, which is the first ever large-scale traffic sign and traffic light detection dataset for the Sri Lankan context. Our dataset consists of 7984 total images with 10176 traffic sign and traffic light instances covering 70 traffic sign and 5 traffic light classes. The images have a high resolution of 1920 x 1080 and capture a wide range of challenging road scenarios with different weather and lighting conditions. Our work is publicly available at https://github.com/oshadajay/CeyRo.

Related papers

• IncidentNet: Traffic Incident Detection, Localization and Severity Estimation with Sparse Sensing [0.6787248655856052]
  IncidentNet is a novel approach for classifying, localizing, and estimating the severity of traffic incidents. Our model works on microscopic traffic data that can be collected using cameras installed at traffic intersections.
  arXiv  Detail & Related papers  (2024-08-02T04:09:15Z)
• EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks [107.62975594230687]
  We demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms.
  arXiv  Detail & Related papers  (2023-04-14T15:23:28Z)
• Traffic Scene Parsing through the TSP6K Dataset [109.69836680564616]
  We introduce a specialized traffic monitoring dataset, termed TSP6K, with high-quality pixel-level and instance-level annotations. The dataset captures more crowded traffic scenes with several times more traffic participants than the existing driving scenes. We propose a detail refining decoder for scene parsing, which recovers the details of different semantic regions in traffic scenes.
  arXiv  Detail & Related papers  (2023-03-06T02:05:14Z)
• GLARE: A Dataset for Traffic Sign Detection in Sun Glare [28.692414823901313]
  GLARE is a collection of images with U.S.-based traffic signs under heavy visual interference by sunlight. It provides an essential enrichment to the widely used LISA Traffic Sign dataset. Current architectures have better detection when trained on images of traffic signs in sun glare performance.
  arXiv  Detail & Related papers  (2022-09-19T02:25:41Z)
• DualCam: A Novel Benchmark Dataset for Fine-grained Real-time Traffic Light Detection [0.7130302992490973]
  We introduce a novel benchmark traffic light dataset captured using a synchronized pair of narrow-angle and wide-angle cameras. The dataset includes images of resolution 1920$times$1080 covering 10 different classes. Results show that our technique can strike a balance between speed and accuracy, compared to the conventional approach of using a single camera frame.
  arXiv  Detail & Related papers  (2022-09-03T08:02:55Z)
• TraCon: A novel dataset for real-time traffic cones detection using deep learning [7.759841699582662]
  In this work, the YOLOv5 algorithm is employed, in order to find a solution for the efficient and fast detection of traffic cones. The YOLOv5 can achieve a high detection accuracy with the score of IoU up to 91.31%.
  arXiv  Detail & Related papers  (2022-05-24T06:51:58Z)
• Road Network Guided Fine-Grained Urban Traffic Flow Inference [108.64631590347352]
  Accurate inference of fine-grained traffic flow from coarse-grained one is an emerging yet crucial problem. We propose a novel Road-Aware Traffic Flow Magnifier (RATFM) that exploits the prior knowledge of road networks. Our method can generate high-quality fine-grained traffic flow maps.
  arXiv  Detail & Related papers  (2021-09-29T07:51:49Z)
• End-to-End Intersection Handling using Multi-Agent Deep Reinforcement Learning [63.56464608571663]
  Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. In this work, we focus on the implementation of a system able to navigate through intersections where only traffic signs are provided. We propose a multi-agent system using a continuous, model-free Deep Reinforcement Learning algorithm used to train a neural network for predicting both the acceleration and the steering angle at each time step.
  arXiv  Detail & Related papers  (2021-04-28T07:54:40Z)
• Deep traffic light detection by overlaying synthetic context on arbitrary natural images [49.592798832978296]
  We propose a method to generate artificial traffic-related training data for deep traffic light detectors. This data is generated using basic non-realistic computer graphics to blend fake traffic scenes on top of arbitrary image backgrounds. It also tackles the intrinsic data imbalance problem in traffic light datasets, caused mainly by the low amount of samples of the yellow state.
  arXiv  Detail & Related papers  (2020-11-07T19:57:22Z)
• Artificial Intelligence Enabled Traffic Monitoring System [3.085453921856008]
  This article presents a novel approach to automatically monitor real time traffic footage using deep convolutional neural networks. The proposed system deploys several state-of-the-art deep learning algorithms to automate different traffic monitoring needs.
  arXiv  Detail & Related papers  (2020-10-02T22:28:02Z)
• Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learning [59.19469551774703]
  Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle. Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
  arXiv  Detail & Related papers  (2020-03-05T05:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.