A Sleep Monitoring System Based on Audio, Video and Depth Information

• URL: http://arxiv.org/abs/2512.06282v1
• Date: Sat, 06 Dec 2025 04:22:32 GMT
• Title: A Sleep Monitoring System Based on Audio, Video and Depth Information
• Authors: Lyn Chao-ling Chen, Kuan-Wen Chen, Yi-Ping Hung,
• Abstract summary: We observe sleeping in home context and classify the sleep disturbances into three types of events: motion events, light-on/off events and noise events.<n>A device with an infrared depth sensor, a RGB camera, and a four-microphone array is used in sleep monitoring in an environment with barely light sources.
• Score: 8.699047443175555
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: For quantitative evaluation of sleep disturbances, a noninvasive monitoring system is developed by introducing an event-based method. We observe sleeping in home context and classify the sleep disturbances into three types of events: motion events, light-on/off events and noise events. A device with an infrared depth sensor, a RGB camera, and a four-microphone array is used in sleep monitoring in an environment with barely light sources. One background model is established in depth signals for measuring magnitude of movements. Because depth signals cannot observe lighting changes, another background model is established in color images for measuring magnitude of lighting effects. An event detection algorithm is used to detect occurrences of events from the processed data of the three types of sensors. The system was tested in sleep condition and the experiment result validates the system reliability.

Related papers

• SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera [61.642416712939095]
  SoundLoc3D treats the task as a set prediction problem, each element in the set corresponds to a potential sound source.<n>We demonstrate the efficiency and superiority of SoundLoc3D on large-scale simulated dataset.
  arXiv  Detail & Related papers  (2024-12-22T05:04:17Z)
• EEPPR: Event-based Estimation of Periodic Phenomena Rate using Correlation in 3D [0.0]
  We present a novel method for measuring the rate of periodic phenomena by an event camera. The approach assumes that for a periodic phenomenon, a highly similar set of events is generated within atemporal window at a time difference to its period space. The proposed method, EEPEP, is evaluated on a dataset of 12 sequences of periodic phenomena.
  arXiv  Detail & Related papers  (2024-08-13T13:50:46Z)
• M3DM-NR: RGB-3D Noisy-Resistant Industrial Anomaly Detection via Multimodal Denoising [63.39134873744748]
  Existing industrial anomaly detection methods primarily concentrate on unsupervised learning with pristine RGB images. This paper proposes a novel noise-resistant M3DM-NR framework to leverage strong multi-modal discriminative capabilities of CLIP. Extensive experiments show that M3DM-NR outperforms state-of-the-art methods in 3D-RGB multi-modal noisy anomaly detection.
  arXiv  Detail & Related papers  (2024-06-04T12:33:02Z)
• EventSleep: Sleep Activity Recognition with Event Cameras [12.584362614255213]
  Event cameras are a promising technology for activity recognition in dark environments. We present EventSleep, a new dataset and methodology to study the suitability of event cameras for a medical application.
  arXiv  Detail & Related papers  (2024-04-02T10:03:23Z)
• SlAction: Non-intrusive, Lightweight Obstructive Sleep Apnea Detection using Infrared Video [1.850099608285478]
  Obstructive sleep apnea (OSA) is a prevalent sleep disorder affecting approximately one billion people world-wide. We present SlAction, a non-intrusive OSA detection system for daily sleep environments using infrared videos.
  arXiv  Detail & Related papers  (2023-09-06T04:52:02Z)
• Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation [79.02808071245634]
  Event-based cameras are bio-inspired sensors that capture brightness change of every pixel in an asynchronous manner. Event streams are divided into grids in the x-y-t coordinates for both positive and negative polarity, producing a set of pillars as 3D tensor representation. Long memory is encoded in the hidden state of adaptive convLSTMs while short memory is modeled by computing spatial-temporal correlation between event pillars.
  arXiv  Detail & Related papers  (2023-03-17T12:12:41Z)
• Audio-visual Representation Learning for Anomaly Events Detection in Crowds [119.72951028190586]
  This paper attempts to exploit multi-modal learning for modeling the audio and visual signals simultaneously. We conduct the experiments on SHADE dataset, a synthetic audio-visual dataset in surveillance scenes. We find introducing audio signals effectively improves the performance of anomaly events detection and outperforms other state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-10-28T02:42:48Z)
• Determining the origin of impulsive noise events using paired wireless sound sensors [0.0]
  This work investigates how to identify the source of impulsive noise events using a pair of wireless noise sensors. One sensor is placed at a known noise source, and another sensor is placed at the noise receiver. To avoid privacy issues, the approach uses on-edge preprocessing that converts the sound into privacy compatible spectrograms.
  arXiv  Detail & Related papers  (2021-08-23T14:19:42Z)
• Differentiable Event Stream Simulator for Non-Rigid 3D Tracking [82.56690776283428]
  Our differentiable simulator enables non-rigid 3D tracking of deformable objects from event streams. We show the effectiveness of our approach for various types of non-rigid objects and compare to existing methods for non-rigid 3D tracking.
  arXiv  Detail & Related papers  (2021-04-30T17:58:07Z)
• Event-based Stereo Visual Odometry [42.77238738150496]
  We present a solution to the problem of visual odometry from the data acquired by a stereo event-based camera rig. We seek to maximize thetemporal consistency of stereo event-based data while using a simple and efficient representation.
  arXiv  Detail & Related papers  (2020-07-30T15:53:28Z)
• Training-free Monocular 3D Event Detection System for Traffic Surveillance [93.65240041833319]
  Existing event detection systems are mostly learning-based and have achieved convincing performance when a large amount of training data is available. In real-world scenarios, collecting sufficient labeled training data is expensive and sometimes impossible. We propose a training-free monocular 3D event detection system for traffic surveillance.
  arXiv  Detail & Related papers  (2020-02-01T04:42:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.