Seamless Multimodal Biometrics for Continuous Personalised Wellbeing Monitoring

• URL: http://arxiv.org/abs/2301.03045v1
• Date: Sun, 8 Jan 2023 14:07:01 GMT
• Title: Seamless Multimodal Biometrics for Continuous Personalised Wellbeing Monitoring
• Authors: Jo\~ao Ribeiro Pinto
• Abstract summary: This work focuses on advancing in-vehicle sensing through the research of novel computer vision and pattern recognition methodologies. The main focus has been on electrocardiogram (ECG) biometrics, a trait well-known for its potential for seamless driver monitoring. In the topic of wellbeing monitoring, improved solutions to multimodal emotion recognition in groups of people and activity/violence recognition in in-vehicle scenarios were proposed.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Artificially intelligent perception is increasingly present in the lives of every one of us. Vehicles are no exception, (...) In the near future, pattern recognition will have an even stronger role in vehicles, as self-driving cars will require automated ways to understand what is happening around (and within) them and act accordingly. (...) This doctoral work focused on advancing in-vehicle sensing through the research of novel computer vision and pattern recognition methodologies for both biometrics and wellbeing monitoring. The main focus has been on electrocardiogram (ECG) biometrics, a trait well-known for its potential for seamless driver monitoring. Major efforts were devoted to achieving improved performance in identification and identity verification in off-the-person scenarios, well-known for increased noise and variability. Here, end-to-end deep learning ECG biometric solutions were proposed and important topics were addressed such as cross-database and long-term performance, waveform relevance through explainability, and interlead conversion. Face biometrics, a natural complement to the ECG in seamless unconstrained scenarios, was also studied in this work. The open challenges of masked face recognition and interpretability in biometrics were tackled in an effort to evolve towards algorithms that are more transparent, trustworthy, and robust to significant occlusions. Within the topic of wellbeing monitoring, improved solutions to multimodal emotion recognition in groups of people and activity/violence recognition in in-vehicle scenarios were proposed. At last, we also proposed a novel way to learn template security within end-to-end models, dismissing additional separate encryption processes, and a self-supervised learning approach tailored to sequential data, in order to ensure data security and optimal performance. (...)

Related papers

• Real-Time Detection and Analysis of Vehicles and Pedestrians using Deep Learning [0.0]
  Current traffic monitoring systems confront major difficulty in recognizing small objects and pedestrians effectively in real-time. Our project focuses on the creation and validation of an advanced deep-learning framework capable of processing complex visual input for precise, real-time recognition of cars and people. The YOLOv8 Large version proved to be the most effective, especially in pedestrian recognition, with great precision and robustness.
  arXiv  Detail & Related papers  (2024-04-11T18:42:14Z)
• Biometrics Employing Neural Network [0.0]
  Fingerprints, iris and retina patterns, facial recognition, hand shapes, palm prints, and voice recognition are frequently used forms of biometrics. For systems to be effective and widely accepted, the error rate in recognition and verification must approach zero. Artificial Neural Networks, which simulate the human brain's operations, present themselves as a promising approach.
  arXiv  Detail & Related papers  (2024-02-01T03:59:04Z)
• Multi-Channel Time-Series Person and Soft-Biometric Identification [65.83256210066787]
  This work investigates person and soft-biometrics identification from recordings of humans performing different activities using deep architectures. We evaluate the method on four datasets of multi-channel time-series human activity recognition (HAR) Soft-biometric based attribute representation shows promising results and emphasis the necessity of larger datasets.
  arXiv  Detail & Related papers  (2023-04-04T07:24:51Z)
• Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification [67.64124512185087]
  Soft biometrics such as gait are widely used with face in surveillance tasks like person recognition and re-identification. We propose a novel adaptive multi-biometric fusion strategy for the dynamic incorporation of gait and face biometric cues by leveraging keyless attention deep neural networks.
  arXiv  Detail & Related papers  (2023-03-24T05:28:35Z)
• Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embedding [51.8579160500354]
  We propose an unsupervised way to predict self-driving attention by uncertainty modeling and driving knowledge integration. Results show equivalent or even more impressive performance compared to fully-supervised state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-03-17T00:28:33Z)
• A Survey on Computer Vision based Human Analysis in the COVID-19 Era [58.79053747159797]
  The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications. These developments triggered the need for novel and improved computer vision techniques capable of (i) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and (ii) facilitating normal operation of existing vision-based services, such as biometric authentication
  arXiv  Detail & Related papers  (2022-11-07T17:20:39Z)
• Presentation Attack Detection Methods based on Gaze Tracking and Pupil Dynamic: A Comprehensive Survey [0.0]
  This research analyzes various aspects of gaze tracking and pupil dynamic presentation attacks. We discuss future work and the open challenges to creating a secure liveness detection based on challenge-based systems.
  arXiv  Detail & Related papers  (2021-12-07T23:22:37Z)
• Biometrics: Trust, but Verify [49.9641823975828]
  Biometric recognition has exploded into a plethora of different applications around the globe. There are a number of outstanding problems and concerns pertaining to the various sub-modules of biometric recognition systems.
  arXiv  Detail & Related papers  (2021-05-14T03:07:25Z)
• Introducing Representations of Facial Affect in Automated Multimodal Deception Detection [18.16596562087374]
  Automated deception detection systems can enhance health, justice, and security in society. This paper presents a novel analysis of the power of dimensional representations of facial affect for automated deception detection. We used a video dataset of people communicating truthfully or deceptively in real-world, high-stakes courtroom situations.
  arXiv  Detail & Related papers  (2020-08-31T05:12:57Z)
• Vision-based techniques for gait recognition [6.817301687702869]
  We discuss current techniques of gait recognition and modelling with the environment in which the research was conducted. We provide motivations for a novel paradigm in biometrics-based human recognition, i.e. the use of the fronto-normal view of gait as a far-range biometrics combined with biometrics operating at a near distance.
  arXiv  Detail & Related papers  (2020-04-30T06:33:01Z)
• Continuous Emotion Recognition via Deep Convolutional Autoencoder and Support Vector Regressor [70.2226417364135]
  It is crucial that the machine should be able to recognize the emotional state of the user with high accuracy. Deep neural networks have been used with great success in recognizing emotions. We present a new model for continuous emotion recognition based on facial expression recognition.
  arXiv  Detail & Related papers  (2020-01-31T17:47:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.