Robust Two-Stream Multi-Feature Network for Driver Drowsiness Detection
- URL: http://arxiv.org/abs/2010.06235v1
- Date: Tue, 13 Oct 2020 08:49:35 GMT
- Title: Robust Two-Stream Multi-Feature Network for Driver Drowsiness Detection
- Authors: Qi Shen, Shengjie Zhao, Rongqing Zhang, Bin Zhang
- Abstract summary: The drowsiness detection system is trained and evaluated on the famous Nation Tsing Hua University Driver Drowsiness Detection (NTHU-DDD)
We obtain an accuracy of 94.46%, which outperforms most existing fatigue detection models.
- Score: 16.474150429342153
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Drowsiness driving is a major cause of traffic accidents and thus numerous
previous researches have focused on driver drowsiness detection. Many drive
relevant factors have been taken into consideration for fatigue detection and
can lead to high precision, but there are still several serious constraints,
such as most existing models are environmentally susceptible. In this paper,
fatigue detection is considered as temporal action detection problem instead of
image classification. The proposed detection system can be divided into four
parts: (1) Localize the key patches of the detected driver picture which are
critical for fatigue detection and calculate the corresponding optical flow.
(2) Contrast Limited Adaptive Histogram Equalization (CLAHE) is used in our
system to reduce the impact of different light conditions. (3) Three individual
two-stream networks combined with attention mechanism are designed for each
feature to extract temporal information. (4) The outputs of the three
sub-networks will be concatenated and sent to the fully-connected network,
which judges the status of the driver. The drowsiness detection system is
trained and evaluated on the famous Nation Tsing Hua University Driver
Drowsiness Detection (NTHU-DDD) dataset and we obtain an accuracy of 94.46%,
which outperforms most existing fatigue detection models.
Related papers
- Uncertainty Estimation for 3D Object Detection via Evidential Learning [63.61283174146648]
We introduce a framework for quantifying uncertainty in 3D object detection by leveraging an evidential learning loss on Bird's Eye View representations in the 3D detector.
We demonstrate both the efficacy and importance of these uncertainty estimates on identifying out-of-distribution scenes, poorly localized objects, and missing (false negative) detections.
arXiv Detail & Related papers (2024-10-31T13:13:32Z) - Correlating sparse sensing for large-scale traffic speed estimation: A
Laplacian-enhanced low-rank tensor kriging approach [76.45949280328838]
We propose a Laplacian enhanced low-rank tensor (LETC) framework featuring both lowrankness and multi-temporal correlations for large-scale traffic speed kriging.
We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging.
arXiv Detail & Related papers (2022-10-21T07:25:57Z) - Real-Time Driver Monitoring Systems through Modality and View Analysis [28.18784311981388]
Driver distractions are known to be the dominant cause of road accidents.
State-of-the-art methods prioritize accuracy while ignoring latency.
We propose time-effective detection models by neglecting the temporal relation between video frames.
arXiv Detail & Related papers (2022-10-17T21:22:41Z) - Active Gaze Control for Foveal Scene Exploration [124.11737060344052]
We propose a methodology to emulate how humans and robots with foveal cameras would explore a scene.
The proposed method achieves an increase in detection F1-score of 2-3 percentage points for the same number of gaze shifts.
arXiv Detail & Related papers (2022-08-24T14:59:28Z) - Blind-Spot Collision Detection System for Commercial Vehicles Using
Multi Deep CNN Architecture [0.17499351967216337]
Two convolutional neural networks (CNNs) based on high-level feature descriptors are proposed to detect blind-spot collisions for heavy vehicles.
A fusion approach is proposed to integrate two pre-trained networks for extracting high level features for blind-spot vehicle detection.
The fusion of features significantly improves the performance of faster R-CNN and outperformed the existing state-of-the-art methods.
arXiv Detail & Related papers (2022-08-17T11:10:37Z) - ReDFeat: Recoupling Detection and Description for Multimodal Feature
Learning [51.07496081296863]
We recouple independent constraints of detection and description of multimodal feature learning with a mutual weighting strategy.
We propose a detector that possesses a large receptive field and is equipped with learnable non-maximum suppression layers.
We build a benchmark that contains cross visible, infrared, near-infrared and synthetic aperture radar image pairs for evaluating the performance of features in feature matching and image registration tasks.
arXiv Detail & Related papers (2022-05-16T04:24:22Z) - Bandit Quickest Changepoint Detection [55.855465482260165]
Continuous monitoring of every sensor can be expensive due to resource constraints.
We derive an information-theoretic lower bound on the detection delay for a general class of finitely parameterized probability distributions.
We propose a computationally efficient online sensing scheme, which seamlessly balances the need for exploration of different sensing options with exploitation of querying informative actions.
arXiv Detail & Related papers (2021-07-22T07:25:35Z) - Driver Drowsiness Classification Based on Eye Blink and Head Movement
Features Using the k-NN Algorithm [8.356765961526955]
This work is to extend the driver drowsiness detection in vehicles using signals of a driver monitoring camera.
For this purpose, 35 features related to the driver's eye blinking behavior and head movements are extracted in driving simulator experiments.
A concluding analysis of the best performing feature sets yields valuable insights about the influence of drowsiness on the driver's blink behavior and head movements.
arXiv Detail & Related papers (2020-09-28T12:37:38Z) - A Driver Fatigue Recognition Algorithm Based on Spatio-Temporal Feature
Sequence [22.71097598048225]
This paper develops a real-time fatigue state recognition algorithm based on a sequence of features.
Experiments show that the algorithm has the advantages of small volume, high speed and high accuracy.
arXiv Detail & Related papers (2020-03-18T10:25:27Z) - Training-free Monocular 3D Event Detection System for Traffic
Surveillance [93.65240041833319]
Existing event detection systems are mostly learning-based and have achieved convincing performance when a large amount of training data is available.
In real-world scenarios, collecting sufficient labeled training data is expensive and sometimes impossible.
We propose a training-free monocular 3D event detection system for traffic surveillance.
arXiv Detail & Related papers (2020-02-01T04:42:57Z) - Driver Safety Development Real Time Driver Drowsiness Detection System
Based on Convolutional Neural Network [1.7188280334580195]
This paper focuses on the challenge of driver safety on the road and presents a novel system for drowsiness detection.
To detect the falling sleep state of the driver as the sign of drowsiness, Convolutional Neural Networks (CNN) are used.
arXiv Detail & Related papers (2020-01-15T05:38:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.