WiFi CSI Based Temporal Activity Detection via Dual Pyramid Network

• URL: http://arxiv.org/abs/2412.16233v2
• Date: Sun, 26 Jan 2025 15:22:07 GMT
• Title: WiFi CSI Based Temporal Activity Detection via Dual Pyramid Network
• Authors: Zhendong Liu, Le Zhang, Bing Li, Yingjie Zhou, Zhenghua Chen, Ce Zhu,
• Abstract summary: We propose an efficient Dual Pyramid Network that integrates Temporal Signal Semantics and Local Sensitive Response.<n>The Temporal Signal Semantic splits feature learning into high and low-frequency components, using a novel Signed Mask-Attention mechanism to emphasize important areas and downplay unimportant ones.<n>The Local Sensitive Response captures fluctuations without learning. These feature pyramids are then combined using a new cross-attention fusion mechanism.
• Score: 38.854696923757466
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We address the challenge of WiFi-based temporal activity detection and propose an efficient Dual Pyramid Network that integrates Temporal Signal Semantic Encoders and Local Sensitive Response Encoders. The Temporal Signal Semantic Encoder splits feature learning into high and low-frequency components, using a novel Signed Mask-Attention mechanism to emphasize important areas and downplay unimportant ones, with the features fused using ContraNorm. The Local Sensitive Response Encoder captures fluctuations without learning. These feature pyramids are then combined using a new cross-attention fusion mechanism. We also introduce a dataset with over 2,114 activity segments across 553 WiFi CSI samples, each lasting around 85 seconds. Extensive experiments show our method outperforms challenging baselines.

Related papers

• Extracting Range-Doppler Information of Moving Targets from Wi-Fi Channel State Information [1.3581639904351783]
  We propose a new signal processing approach that addresses both challenges via three key innovations.<n>Our method achieves cm-level accuracy in range Doppler estimation of moving targets, validated using a commercial Intel WiFi AX211.
  arXiv  Detail & Related papers  (2025-08-04T18:10:18Z)
• Advancing RFI-Detection in Radio Astronomy with Liquid State Machines [25.08630315149258]
  Radio Frequency Interference (RFI) from anthropogenic radio sources poses significant challenges to current and future radio telescopes. In this work, we apply Liquid State Machines (LSMs), a class of spiking networks, to RFI-detection. We train LSMs on simulated data derived from the Hyrogen Epoch of Reionization Array (HERA), a known benchmark for RFI-detection. Our model achieves a per-pixel accuracy of 98% and an F1-Integrate of 0.743, demonstrating competitive performance on this highly challenging task.
  arXiv  Detail & Related papers  (2025-04-14T01:51:01Z)
• PCA-Featured Transformer for Jamming Detection in 5G UAV Networks [0.5999777817331317]
  Unmanned Aerial Vehicles (UAVs) face significant security risks from jamming attacks, which can compromise network functionality. Traditional detection methods often fall short when confronting AI-powered jamming that dynamically modifies its behavior. We introduce a novel U-shaped transformer architecture to refine feature representations for improved wireless security.
  arXiv  Detail & Related papers  (2024-12-19T16:13:04Z)
• Spiking Neural Networks for Radio Frequency Interference Detection in Radio Astronomy [25.08630315149258]
  Spiking Neural Networks (SNNs) promise efficienttemporal data processing owing to their dynamic nature.<n>This paper addresses a significant challenge in radio astronomy, Radio Frequency Interference (RFI) detection.<n>We introduce a divisive normalisation-inspired pre-processing step, which improves RF detection performance.<n>To our knowledge, this work is the first to train SNNs on real radio astronomy data successfully.
  arXiv  Detail & Related papers  (2024-12-09T01:02:30Z)
• ViFi-ReID: A Two-Stream Vision-WiFi Multimodal Approach for Person Re-identification [3.3743041904085125]
  Person re-identification (ReID) plays a vital role in safety inspections, personnel counting, and more. Most current ReID approaches primarily extract features from images, which are easily affected by objective conditions. We leverage widely available routers as sensing devices by capturing gait information from pedestrians through the Channel State Information (CSI) in WiFi signals.
  arXiv  Detail & Related papers  (2024-10-13T15:34:11Z)
• SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation [14.684277591969392]
  A novel spatial-frequency learning and topological channel interaction network (SPIRONet) is proposed to address the above issues. Dual encoders are utilized to comprehensively capture local spatial and global frequency vessel features. Cross-attention fusion module is introduced to effectively fuse spatial and frequency features. A topological channel interaction module is designed to filter out task-irrelevant responses based on graph neural networks.
  arXiv  Detail & Related papers  (2024-06-28T08:48:14Z)
• Autosen: improving automatic wifi human sensing through cross-modal autoencoder [56.44764266426344]
  WiFi human sensing is highly regarded for its low-cost and privacy advantages in recognizing human activities. Traditional cross-modal methods, aimed at enabling self-supervised learning without labeled data, struggle to extract meaningful features from amplitude-phase combinations. We introduce AutoSen, an innovative automatic WiFi sensing solution that departs from conventional approaches.
  arXiv  Detail & Related papers  (2024-01-08T19:50:02Z)
• RIDE: Real-time Intrusion Detection via Explainable Machine Learning Implemented in a Memristor Hardware Architecture [24.824596231020585]
  We propose a packet-level network intrusion detection solution that makes use of Recurrent Autoencoders to integrate an arbitrary-length sequence of packets into a more compact joint feature embedding. We show that our approach leads to an extremely efficient, real-time solution with high detection accuracy at the packet level.
  arXiv  Detail & Related papers  (2023-11-27T17:30:19Z)
• A Spatial-Temporal Deformable Attention based Framework for Breast Lesion Detection in Videos [107.96514633713034]
  We propose a spatial-temporal deformable attention based framework, named STNet. Our STNet introduces a spatial-temporal deformable attention module to perform local spatial-temporal feature fusion. Experiments on the public breast lesion ultrasound video dataset show that our STNet obtains a state-of-the-art detection performance.
  arXiv  Detail & Related papers  (2023-09-09T07:00:10Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• HiNoVa: A Novel Open-Set Detection Method for Automating RF Device Authentication [9.571774189070531]
  We introduce a novel open-set detection approach based on the patterns of the hidden state values within a Convolutional Neural Network (CNN) Long Short-Term Memory (LSTM) model. Our approach greatly improves the Area Under the Precision-Recall Curve on LoRa, Wireless-WiFi, and Wired-WiFi datasets.
  arXiv  Detail & Related papers  (2023-05-16T16:47:02Z)
• Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation [79.02808071245634]
  Event-based cameras are bio-inspired sensors that capture brightness change of every pixel in an asynchronous manner. Event streams are divided into grids in the x-y-t coordinates for both positive and negative polarity, producing a set of pillars as 3D tensor representation. Long memory is encoded in the hidden state of adaptive convLSTMs while short memory is modeled by computing spatial-temporal correlation between event pillars.
  arXiv  Detail & Related papers  (2023-03-17T12:12:41Z)
• NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction [79.13750275141139]
  This paper proposes a novel and fast self-supervised solution for sparse-view CBCT reconstruction. The desired attenuation coefficients are represented as a continuous function of 3D spatial coordinates, parameterized by a fully-connected deep neural network. A learning-based encoder entailing hash coding is adopted to help the network capture high-frequency details.
  arXiv  Detail & Related papers  (2022-09-29T04:06:00Z)
• Multi-Band Wi-Fi Sensing with Matched Feature Granularity [37.40429912751046]
  We propose a multi-band Wi-Fi fusion method for Wi-Fi sensing that hierarchically fuses the features from both the fine-grained CSI at sub-6 GHz and the mid-grained beam SNR at 60 GHz. To address the issue of limited labeled training data, we propose an autoencoder-based multi-band Wi-Fi fusion network that can be pre-trained in an unsupervised fashion.
  arXiv  Detail & Related papers  (2021-12-28T05:50:58Z)
• MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking [72.65494220685525]
  We propose a new dynamic modality-aware filter generation module (named MFGNet) to boost the message communication between visible and thermal data. We generate dynamic modality-aware filters with two independent networks. The visible and thermal filters will be used to conduct a dynamic convolutional operation on their corresponding input feature maps respectively. To address issues caused by heavy occlusion, fast motion, and out-of-view, we propose to conduct a joint local and global search by exploiting a new direction-aware target-driven attention mechanism.
  arXiv  Detail & Related papers  (2021-07-22T03:10:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.