Monocular Cyclist Detection with Convolutional Neural Networks

• URL: http://arxiv.org/abs/2303.11223v2
• Date: Tue, 13 Feb 2024 01:45:37 GMT
• Title: Monocular Cyclist Detection with Convolutional Neural Networks
• Authors: Charles Tang
• Abstract summary: This study aims to reduce the number of vehicle-cyclist collisions, which are often caused by poor driver attention to blind spots. We designed a state-of-the-art real-time monocular cyclist detection that can detect cyclists with object detection convolutional neural networks. We conclude that this cyclist detection device can accurately and quickly detect cyclists and has the potential to improve cyclist safety significantly.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Cycling is an increasingly popular method of transportation for sustainability and health benefits. However, cyclists face growing risks, especially when encountering large vehicles on the road. This study aims to reduce the number of vehicle-cyclist collisions, which are often caused by poor driver attention to blind spots. To achieve this, we designed a state-of-the-art real-time monocular cyclist detection that can detect cyclists with object detection convolutional neural networks, such as EfficientDet Lite and SSD MobileNetV2. First, our proposed cyclist detection models achieve greater than 0.900 mAP (IoU: 0.5), fine-tuned on a newly proposed cyclist image dataset comprising over 20,000 images. Next, the models were deployed onto a Google Coral Dev Board mini-computer with a camera module and analyzed for speed, reaching inference times as low as 15 milliseconds. Lastly, the end-to-end cyclist detection device was tested in real-time to model traffic scenarios and analyzed further for performance and feasibility. We concluded that this cyclist detection device can accurately and quickly detect cyclists and has the potential to improve cyclist safety significantly. Future studies could determine the feasibility of the proposed device in the vehicle industry and improvements to cyclist safety over time.

Related papers

• CycleCrash: A Dataset of Bicycle Collision Videos for Collision Prediction and Analysis [21.584020544141797]
  CycleCrash is a novel dataset consisting of 3,000 dashcam videos with 436,347 frames that capture cyclists in a range of critical situations. This dataset enables 9 different cyclist collision prediction and classification tasks focusing on potentially hazardous conditions for cyclists. We propose VidNeXt, a novel method that leverages a ConvNeXt spatial encoder and a non-stationary transformer to capture the temporal dynamics of videos for the tasks defined in our dataset.
  arXiv  Detail & Related papers  (2024-09-30T04:46:35Z)
• Pedestrian Environment Model for Automated Driving [54.16257759472116]
  We propose an environment model that includes the position of the pedestrians as well as their pose information. We extract the skeletal information with a neural network human pose estimator from the image. To obtain the 3D information of the position, we aggregate the data from consecutive frames in conjunction with the vehicle position.
  arXiv  Detail & Related papers  (2023-08-17T16:10:58Z)
• A Benchmark for Cycling Close Pass Near Miss Event Detection from Video Streams [35.17510169229505]
  We introduce a novel benchmark, called Cyc-CP, towards cycling close pass near miss event detection from video streams. We propose two benchmark models based on deep learning techniques for these two problems. Our models can achieve 88.13% and 84.60% accuracy on the real-world dataset.
  arXiv  Detail & Related papers  (2023-04-24T07:30:01Z)
• Bent & Broken Bicycles: Leveraging synthetic data for damaged object re-identification [59.80753896200009]
  We propose a novel task of damaged object re-identification, which aims at distinguishing changes in visual appearance due to deformations or missing parts from subtle intra-class variations. We leverage the power of computer-generated imagery to create, in a semi-automatic fashion, high-quality synthetic images of the same bike before and after a damage occurs. As a baseline for this task, we propose TransReI3D, a multi-task, transformer-based deep network unifying damage detection.
  arXiv  Detail & Related papers  (2023-04-16T20:23:58Z)
• Real-Time Helmet Violation Detection Using YOLOv5 and Ensemble Learning [4.397520291340696]
  This paper presents the development and evaluation of a real-time YOLOv5 Deep Learning (DL) model for detecting riders and passengers on motorbikes. We trained the model on 100 videos recorded at 10 fps, each for 20 seconds. The proposed model was tested on 100 test videos and produced an mAP score of 0.5267, ranking 11th on the AI City Track 5 public leaderboard.
  arXiv  Detail & Related papers  (2023-04-14T14:15:56Z)
• DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Driving [76.29141888408265]
  We propose a large-scale dataset containing diverse accident scenarios that frequently occur in real-world driving. The proposed DeepAccident dataset includes 57K annotated frames and 285K annotated samples, approximately 7 times more than the large-scale nuScenes dataset.
  arXiv  Detail & Related papers  (2023-04-03T17:37:00Z)
• CycleSense: Detecting Near Miss Incidents in Bicycle Traffic from Mobile Motion Sensors [3.5127092215732176]
  In cities worldwide, cars cause health and traffic problems which could be partly mitigated through an increased modal share of bicycles. Many people, however, avoid cycling due to a lack of perceived safety. For city planners, addressing this is hard as they lack insights into where cyclists feel safe and where they do not.
  arXiv  Detail & Related papers  (2022-04-21T21:43:23Z)
• Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing [70.16043883381677]
  In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions. We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
  arXiv  Detail & Related papers  (2022-01-10T10:02:40Z)
• Real Time Monocular Vehicle Velocity Estimation using Synthetic Data [78.85123603488664]
  We look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. We propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity.
  arXiv  Detail & Related papers  (2021-09-16T13:10:27Z)
• Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centers [126.81938540470847]
  We propose Euro-PVI, a dataset of pedestrian and bicyclist trajectories. In this work, we develop a joint inference model that learns an expressive multi-modal shared latent space across agents in the urban scene. We achieve state of the art results on the nuScenes and Euro-PVI datasets demonstrating the importance of capturing interactions between ego-vehicle and pedestrians (bicyclists) for accurate predictions.
  arXiv  Detail & Related papers  (2021-06-22T15:40:21Z)
• CyclingNet: Detecting cycling near misses from video streams in complex urban scenes with deep learning [1.462434043267217]
  CyclingNet is a deep computer vision model based on convolutional structure embedded with self-attention bidirectional long-short term memory (LSTM) blocks. After 42 hours of training on a single GPU, the model shows high accuracy on the training, testing and validation sets. The model is intended to be used for generating information that can draw significant conclusions regarding cycling behaviour in cities.
  arXiv  Detail & Related papers  (2021-01-31T23:59:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.