EEG-based Drowsiness Estimation for Driving Safety using Deep Q-Learning

• URL: http://arxiv.org/abs/2001.02399v2
• Date: Sat, 16 May 2020 12:37:46 GMT
• Title: EEG-based Drowsiness Estimation for Driving Safety using Deep Q-Learning
• Authors: Yurui Ming, Dongrui Wu, Yu-Kai Wang, Yuhui Shi, Chin-Teng Lin
• Abstract summary: We propose using deep Q-learning to analyze an electroencephalogram (EEG) dataset captured during a simulated endurance driving test. We adapt the terminologies in the driving test to fit the reinforcement learning framework, thus formulate the drowsiness estimation problem as an optimization of a Q-learning task. Our results show that the trained model can trace the variations of mind state in a satisfactory way against the testing EEG data.
• Score: 46.3327842128563
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fatigue is the most vital factor of road fatalities and one manifestation of fatigue during driving is drowsiness. In this paper, we propose using deep Q-learning to analyze an electroencephalogram (EEG) dataset captured during a simulated endurance driving test. By measuring the correlation between drowsiness and driving performance, this experiment represents an important brain-computer interface (BCI) paradigm especially from an application perspective. We adapt the terminologies in the driving test to fit the reinforcement learning framework, thus formulate the drowsiness estimation problem as an optimization of a Q-learning task. By referring to the latest deep Q-Learning technologies and attending to the characteristics of EEG data, we tailor a deep Q-network for action proposition that can indirectly estimate drowsiness. Our results show that the trained model can trace the variations of mind state in a satisfactory way against the testing EEG data, which demonstrates the feasibility and practicability of this new computation paradigm. We also show that our method outperforms the supervised learning counterpart and is superior for real applications. To the best of our knowledge, we are the first to introduce the deep reinforcement learning method to this BCI scenario, and our method can be potentially generalized to other BCI cases.

Related papers

• Unsupervised Adaptive Deep Learning Method For BCI Motor Imagery Decoding [2.0039413639026917]
  We propose an adaptive method that reaches offline performance level while being usable online without requiring supervision. We demonstrate its efficiency for Motor Imagery brain decoding from electroencephalography data, considering challenging cross-subject scenarios.
  arXiv  Detail & Related papers  (2024-03-15T22:22:10Z)
• RLIF: Interactive Imitation Learning as Reinforcement Learning [56.997263135104504]
  We show how off-policy reinforcement learning can enable improved performance under assumptions that are similar but potentially even more practical than those of interactive imitation learning. Our proposed method uses reinforcement learning with user intervention signals themselves as rewards. This relaxes the assumption that intervening experts in interactive imitation learning should be near-optimal and enables the algorithm to learn behaviors that improve over the potential suboptimal human expert.
  arXiv  Detail & Related papers  (2023-11-21T21:05:21Z)
• An Expert's Guide to Training Physics-informed Neural Networks [5.198985210238479]
  Physics-informed neural networks (PINNs) have been popularized as a deep learning framework. PINNs can seamlessly synthesize observational data and partial differential equation (PDE) constraints. We present a series of best practices that can significantly improve the training efficiency and overall accuracy of PINNs.
  arXiv  Detail & Related papers  (2023-08-16T16:19:25Z)
• EEG-based Cognitive Load Classification using Feature Masked Autoencoding and Emotion Transfer Learning [13.404503606887715]
  We present a new solution for the classification of cognitive load using electroencephalogram (EEG) We pre-train our model using self-supervised masked autoencoding on emotion-related EEG datasets. The results of our experiments show that our proposed approach achieves strong results and outperforms conventional single-stage fully supervised learning.
  arXiv  Detail & Related papers  (2023-08-01T02:59:19Z)
• Evaluating the structure of cognitive tasks with transfer learning [67.22168759751541]
  This study investigates the transferability of deep learning representations between different EEG decoding tasks. We conduct extensive experiments using state-of-the-art decoding models on two recently released EEG datasets.
  arXiv  Detail & Related papers  (2023-07-28T14:51:09Z)
• A Study of Situational Reasoning for Traffic Understanding [63.45021731775964]
  We devise three novel text-based tasks for situational reasoning in the traffic domain. We adopt four knowledge-enhanced methods that have shown generalization capability across language reasoning tasks in prior work. We provide in-depth analyses of model performance on data partitions and examine model predictions categorically.
  arXiv  Detail & Related papers  (2023-06-05T01:01:12Z)
• Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation [78.17108227614928]
  We propose a benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. We consider a value-based and policy-gradient Deep Reinforcement Learning (DRL) We also propose a verification strategy that checks the behavior of the trained models over a set of desired properties.
  arXiv  Detail & Related papers  (2021-12-16T16:53:56Z)
• EEG-based Classification of Drivers Attention using Convolutional Neural Network [0.0]
  This study compares the performance of several attention classifiers trained on participants brain activity. CNN model trained on raw EEG data obtained under kinesthetic feedback achieved the highest accuracy 89%. Our findings show that CNN and raw EEG signals can be employed for effective training of a passive BCI for real-time attention classification.
  arXiv  Detail & Related papers  (2021-08-23T10:55:52Z)
• Improving Robustness of Learning-based Autonomous Steering Using Adversarial Images [58.287120077778205]
  We introduce a framework for analyzing robustness of the learning algorithm w.r.t varying quality in the image input for autonomous driving. Using the results of sensitivity analysis, we propose an algorithm to improve the overall performance of the task of "learning to steer"
  arXiv  Detail & Related papers  (2021-02-26T02:08:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.