Spiking-DD: Neuromorphic Event Camera based Driver Distraction Detection with Spiking Neural Network

• URL: http://arxiv.org/abs/2407.20633v2
• Date: Mon, 30 Sep 2024 14:14:52 GMT
• Title: Spiking-DD: Neuromorphic Event Camera based Driver Distraction Detection with Spiking Neural Network
• Authors: Waseem Shariff, Paul Kielty, Joseph Lemley, Peter Corcoran,
• Abstract summary: Event camera-based driver monitoring is emerging as a pivotal area of research. To the best of our knowledge, this study is the first to utilize event camera data with spiking neural networks for driver distraction.
• Score: 0.09999629695552192
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Event camera-based driver monitoring is emerging as a pivotal area of research, driven by its significant advantages such as rapid response, low latency, power efficiency, enhanced privacy, and prevention of undersampling. Effective detection of driver distraction is crucial in driver monitoring systems to enhance road safety and reduce accident rates. The integration of an optimized sensor such as Event Camera with an optimized network is essential for maximizing these benefits. This paper introduces the innovative concept of sensing without seeing to detect driver distraction, leveraging computationally efficient spiking neural networks (SNN). To the best of our knowledge, this study is the first to utilize event camera data with spiking neural networks for driver distraction. The proposed Spiking-DD network not only achieve state of the art performance but also exhibit fewer parameters and provides greater accuracy than current event-based methodologies.

Related papers

• N-DriverMotion: Driver motion learning and prediction using an event-based camera and directly trained spiking neural networks [2.3941497253612085]
  This paper presents a novel system for learning and predicting driver motions and an event-based high-resolution (1280x720) dataset. The proposed neuromorphic vision system achieves comparable accuracy, 94.04%, in recognizing driver motions with the CSNN architecture.
  arXiv  Detail & Related papers  (2024-08-23T21:25:16Z)
• Enhancing Road Safety: Real-Time Detection of Driver Distraction through Convolutional Neural Networks [0.0]
  This study seeks to identify the most efficient model for real-time detection of driver distractions. The ultimate aim is to incorporate the findings into vehicle safety systems, significantly boosting their capability to prevent accidents triggered by inattention.
  arXiv  Detail & Related papers  (2024-05-28T03:34:55Z)
• Deep Event-based Object Detection in Autonomous Driving: A Survey [7.197775088663435]
  Event cameras have emerged as promising sensors for autonomous driving due to their low latency, high dynamic range, and low power consumption. This paper provides an overview of object detection using event data in autonomous driving, showcasing the competitive benefits of event cameras.
  arXiv  Detail & Related papers  (2024-05-07T04:17:04Z)
• PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search [64.28335667655129]
  Multiple object tracking is a critical task in autonomous driving. As tracking accuracy improves, neural networks become increasingly complex, posing challenges for their practical application in real driving scenarios due to the high level of latency. In this paper, we explore the use of the neural architecture search (NAS) methods to search for efficient architectures for tracking, aiming for low real-time latency while maintaining relatively high accuracy.
  arXiv  Detail & Related papers  (2024-03-23T04:18:49Z)
• Autonomous Driving using Spiking Neural Networks on Dynamic Vision Sensor Data: A Case Study of Traffic Light Change Detection [0.0]
  Spiking neural networks (SNNs) provide an alternative model to process information and make decisions. Recent work using SNNs for autonomous driving mostly focused on simple tasks like lane keeping in simplified simulation environments. This project studies SNNs on photo-realistic driving scenes in the CARLA simulator, which is an important step toward using SNNs on real vehicles.
  arXiv  Detail & Related papers  (2023-09-27T23:31:30Z)
• FBLNet: FeedBack Loop Network for Driver Attention Prediction [75.83518507463226]
  Nonobjective driving experience is difficult to model. In this paper, we propose a FeedBack Loop Network (FBLNet) which attempts to model the driving experience accumulation procedure. Under the guidance of the incremental knowledge, our model fuses the CNN feature and Transformer feature that are extracted from the input image to predict driver attention.
  arXiv  Detail & Related papers  (2022-12-05T08:25:09Z)
• NVRadarNet: Real-Time Radar Obstacle and Free Space Detection for Autonomous Driving [57.03126447713602]
  We present a deep neural network (DNN) that detects dynamic obstacles and drivable free space using automotive RADAR sensors. The network runs faster than real time on an embedded GPU and shows good generalization across geographic regions.
  arXiv  Detail & Related papers  (2022-09-29T01:30:34Z)
• Efficient Federated Learning with Spike Neural Networks for Traffic Sign Recognition [70.306089187104]
  We introduce powerful Spike Neural Networks (SNNs) into traffic sign recognition for energy-efficient and fast model training. Numerical results indicate that the proposed federated SNN outperforms traditional federated convolutional neural networks in terms of accuracy, noise immunity, and energy efficiency as well.
  arXiv  Detail & Related papers  (2022-05-28T03:11:48Z)
• Achieving Real-Time LiDAR 3D Object Detection on a Mobile Device [53.323878851563414]
  We propose a compiler-aware unified framework incorporating network enhancement and pruning search with the reinforcement learning techniques. Specifically, a generator Recurrent Neural Network (RNN) is employed to provide the unified scheme for both network enhancement and pruning search automatically. The proposed framework achieves real-time 3D object detection on mobile devices with competitive detection performance.
  arXiv  Detail & Related papers  (2020-12-26T19:41:15Z)
• Temporal Pulses Driven Spiking Neural Network for Fast Object Recognition in Autonomous Driving [65.36115045035903]
  We propose an approach to address the object recognition problem directly with raw temporal pulses utilizing the spiking neural network (SNN) Being evaluated on various datasets, our proposed method has shown comparable performance as the state-of-the-art methods, while achieving remarkable time efficiency.
  arXiv  Detail & Related papers  (2020-01-24T22:58:55Z)
• Driver Safety Development Real Time Driver Drowsiness Detection System Based on Convolutional Neural Network [1.7188280334580195]
  This paper focuses on the challenge of driver safety on the road and presents a novel system for drowsiness detection. To detect the falling sleep state of the driver as the sign of drowsiness, Convolutional Neural Networks (CNN) are used.
  arXiv  Detail & Related papers  (2020-01-15T05:38:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.