Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection

• URL: http://arxiv.org/abs/2603.17069v1
• Date: Tue, 17 Mar 2026 18:54:21 GMT
• Title: Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection
• Abstract summary: Falls in wet bathroom environments are a major safety risk for seniors living alone.<n>Recent work has shown that mmWave-only, vibration-only, and existing multimodal schemes can support privacy-preserving, non-intrusive fall detection.<n>We propose a two-stream architecture that encodes radar signals with a Motion--Mamba branch for long-range motion patterns and processes floor vibration.
• Score: 2.669350701173451
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Falls in wet bathroom environments are a major safety risk for seniors living alone. Recent work has shown that mmWave-only, vibration-only, and existing multimodal schemes, such as vibration-triggered radar activation, early feature concatenation, and decision-level score fusion, can support privacy-preserving, non-intrusive fall detection. However, these designs still treat motion and impact as loosely coupled streams, depending on coarse temporal alignment and amplitude thresholds, and do not explicitly encode the causal link between radar-observed collapse and floor impact or address timing drift, object drop confounders, and latency and energy constraints on low-power edge devices. To this end, we propose a two-stream architecture that encodes radar signals with a Motion--Mamba branch for long-range motion patterns and processes floor vibration with an Impact--Griffin branch that emphasizes impact transients and cross-axis coupling. Cross-conditioned fusion uses low-rank bilinear interaction and a Switch--MoE head to align motion and impact tokens and suppress object-drop confounders. The model keeps inference cost suitable for real-time execution on a Raspberry Pi 4B gateway. We construct a bathroom fall detection benchmark dataset with frame-level annotations, comprising more than 3~h of synchronized mmWave radar and triaxial vibration recordings across eight scenarios under running water, together with subject-independent training, validation, and test splits. On the test split, our model attains 96.1% accuracy, 94.8% precision, 88.0% recall, a 91.1% macro F1 score, and an AUC of 0.968. Compared with the strongest baseline, it improves accuracy by 2.0 percentage points and fall recall by 1.3 percentage points, while reducing latency from 35.9 ms to 15.8 ms and lowering energy per 2.56 s window from 14200 mJ to 10750 mJ on the Raspberry Pi 4B gateway.

Related papers

• WaVeFuse: Regime-Adaptive Equity Index Forecasting via Channel-Wise Wavelet Denoising and Vertical Attention Fusion [0.0]
  WaVeFuse is a hybrid Deep Learning for equity forecasting framework.<n>It addresses propagation of technical indicators (TIs), channel-indiscriminate decomposition, and static multi-branch fusion.<n>WaVeFuse delivers a computationally efficient, regime-robust framework suitable for research and decision-support deployment.
  arXiv  Detail & Related papers  (2026-09-13T18:50:33Z)
• Event-Based Motion Estimation via Oriented Distance Fields [55.23416502666468]
  Event-based motion estimation is central to tasks that demand high temporal resolution and robustness to fast motion.<n>We propose Oriented Distance Field Motion Estimation (ODF Motion Estimation), which replaces this optimization with a single averaging step over a precomputed field of event distance vectors.<n>On public and self-collected datasets, ODF motion estimation reaches sub-pixel accuracy at the lowest latency among compared methods.
  arXiv  Detail & Related papers  (2026-08-25T08:27:42Z)
• RADAR Perception for Dynamic Obstacle Avoidance onboard small-scale Quadrotor UAVs [5.125365753953585]
  This letter presents the first mmWave RADAR-based perception-and-control system for fast onboard DOA.<n>We derive and analyze latency and spatial bounds that relate sensing range, relative speed, and control delay.<n>An onboard implementation on a Raspberry Pi 4B demonstrates real-time feasibility with an end-to-end sensing-to-command latency of approximately 14 ms.
  arXiv  Detail & Related papers  (2026-08-03T08:04:45Z)
• Disturbance-aware Motion Planning for Over-actuated Underwater Vehicles Exploiting Actuation Redundancy for High-fidelity 3D Reconstruction [9.030271148215196]
  High-power thrusters resuspend sediments and induce turbulence, degrading image quality at the sensor input.<n>We address this actuation-to-perception coupling by exploiting redundancy in over-actuated platforms.<n>Across 440 trials, the approach reduces target-region particle velocity by 67%.<n>It improves 3D reconstruction RMSE by 55% versus a disturbance-unaware baseline.
  arXiv  Detail & Related papers  (2026-07-08T08:32:15Z)
• Delay-Aware Active Triangulation with Uncertainty-Driven Multi-Agent Reinforcement Learning for Counter-UAS [5.4271995156436965]
  Multi-agent active visual triangulation enables precise 3D localization of aerial targets by coordinating mobile observers with controllable cameras.<n>We present a delay-aware, uncertainty-driven multi-agent reinforcement learning framework for target localization in Counter-UAS applications.
  arXiv  Detail & Related papers  (2026-07-07T07:58:13Z)
• LLM-Empowered Multimodal Fusion Framework for Autonomous Driving: Semantic Enhancement and Channel-Adaptive Design [56.76240343283953]
  We propose a Large Language Model-centric Semantic-layer Channel-aware Integrated Perception framework.<n>It fuses a local visual stream with a quality-varying external radar stream used to cover perception-blind spots.<n>Experiments on nuScenes and VIRAT validate our approach.
  arXiv  Detail & Related papers  (2026-07-02T06:44:02Z)
• EventShiftFlow: Towards Hardware-efficient FPGA-based Flow Estimation [43.77587889970362]
  Event-based vision sensors offer asynchronous, high-temporal-resolution measurements.<n>Many event-based motion estimation methods are computationally intensive and difficult to map to FPGA hardware.<n>We present a streaming velocity estimator that discretizes asynchronous events into fixed-duration time bins, constructs a 1-bit spatial occupancy grid, and evaluates multiple velocity hypotheses in parallel.
  arXiv  Detail & Related papers  (2026-05-27T11:13:58Z)
• OmniForcing: Unleashing Real-time Joint Audio-Visual Generation [51.031726911410594]
  Recent joint audio-visual diffusion models achieve remarkable generation quality but suffer from high latency.<n>We propose OmniForcing, the first framework to distill an offline, dual-stream bidirectional diffusion model into a high-fidelity streaming autore generator.
  arXiv  Detail & Related papers  (2026-03-12T08:17:36Z)
• BadCLIP++: Stealthy and Persistent Backdoors in Multimodal Contrastive Learning [73.46118996284888]
  Research on backdoor attacks against multimodal contrastive learning models faces two key challenges: stealthiness and persistence.<n>We propose BadCLIP++, a unified framework that tackles both challenges.<n>For stealthiness, we introduce a semantic-fusion QR micro-trigger that embeds imperceptible patterns near task-relevant regions.<n>For persistence, we stabilize trigger embeddings via radius shrinkage and centroid alignment.
  arXiv  Detail & Related papers  (2026-02-19T08:31:16Z)
• Time-Series at the Edge: Tiny Separable CNNs for Wearable Gait Detection and Optimal Sensor Placement [3.7765281299298015]
  We study on-device time-series analysis for gait detection in Parkinson's disease (PD) from short windows of triaxial acceleration, targeting resource-latency wearables and edge nodes.<n>We compare magnitude thresholding to three 1D CNNs for time-series analysis: a literature baseline (separable convolutions) and two ultra-light models - one purely separable and one with residual connections.
  arXiv  Detail & Related papers  (2025-11-29T08:52:41Z)
• mmPred: Radar-based Human Motion Prediction in the Dark [43.00006337997152]
  Existing Human Motion Prediction methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns.<n>This work introduces radar as a novel sensing modality for HMP, for the first time.<n>We propose mmPred, the first diffusion-based framework tailored for radar-based HMP.
  arXiv  Detail & Related papers  (2025-11-29T06:26:55Z)
• Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks [10.4860429348784]
  We propose a proactive blockage prediction framework that utilizes multi-modal sensing, including camera, GPS, LiDAR, and radar inputs.<n>This approach uses modality-specific deep learning models to process each sensor stream independently and fuses their outputs.<n>Our results display the effectiveness and efficiency of multi-modal sensing for mmWave blockage prediction and provide a pathway for proactive wireless communication in dynamic environments.
  arXiv  Detail & Related papers  (2025-07-21T16:25:44Z)
• Temporal Misalignment Attacks against Multimodal Perception in Autonomous Driving [23.83773255227831]
  We introduce DejaVu, an attack that exploits the in-vehicular network and induces delays across sensor streams to create subtle temporal misalignments.<n>Our comprehensive attack analysis reveals the sensors' task-specific imbalanced sensitivities.<n>With a single-frame LiDAR delay, an attacker can reduce the car detection mAP by up to 88.5%, while with a three-frame camera delay, multiple object tracking accuracy (MOTA) for car drops by 73%.
  arXiv  Detail & Related papers  (2025-07-12T00:44:26Z)
• A novel fast short-time root music method for vibration monitoring of high-speed spindles [5.048369760845484]
  We present a fast Short-Time Root-MUMU (fSTrM) that exploits FFT-accelerated Lanczos bidiagonalization to reduce computational complexity.<n>We show that fSTrM achieves 1.2 Hz frequency resolution (vs. 12.5 Hz), 93% detection rate at $-$5 dB SNR and quantifies defect severity through harmonic content analysis.
  arXiv  Detail & Related papers  (2025-06-21T05:35:38Z)
• Remote Detection of Applications for Improved Beam Tracking in mmWave/sub-THz 5G/6G Systems [37.35086075012511]
  Beam tracking is an essential functionality of millimeter wave (mmWave, 30-100 GHz) and sub-terahertz (sub-THz, 100-300 GHz) 5G/6G systems. It operates by performing antenna sweeping at both base station (BS) and user equipment (UE) sides. In absence of explicit signalling for the type of application at the air interface, in this paper, we propose a way to remotely detect it at the BS side based on the received signal strength pattern.
  arXiv  Detail & Related papers  (2024-10-24T10:55:21Z)
• Fast Information Streaming Handler (FisH): A Unified Seismic Neural Network for Single Station Real-Time Earthquake Early Warning [56.45067876391473]
  Existing EEW approaches treat phase picking, location estimation, and magnitude estimation as separate tasks, lacking a unified framework. We propose a novel unified seismic neural network called Fast Information Streaming Handler (FisH) FisH is designed to process real-time streaming seismic data and generate simultaneous results for phase picking, location estimation, and magnitude estimation in an end-to-end fashion.
  arXiv  Detail & Related papers  (2024-08-13T04:33:23Z)
• Optimal baseline exploitation in vertical dark-matter detectors based on atom interferometry [50.06952271801328]
  Several terrestrial detectors for gravitational waves and dark matter based on long-baseline atom interferometry are currently in the final planning stages or already under construction. We show that resonant-mode detectors based on multi-diamond fountain gradiometers achieve the optimal, shot-noise limited, sensitivity if their height constitutes 20% of the available baseline.
  arXiv  Detail & Related papers  (2023-09-08T08:38:24Z)
• Enhancing Reliability in Federated mmWave Networks: A Practical and Scalable Solution using Radar-Aided Dynamic Blockage Recognition [14.18507067281377]
  This article introduces a new method to improve the dependability of millimeter-wave (mmWave) and terahertz (THz) network services in dynamic outdoor environments. In these settings, line-of-sight (LoS) connections are easily interrupted by moving obstacles like humans and vehicles. The proposed approach, coined as Radar-aided blockage Dynamic Recognition (RaDaR), leverages radar measurements and federated learning (FL) to train a dual-output neural network (NN) model.
  arXiv  Detail & Related papers  (2023-06-22T10:10:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.