CrossFi: A Cross Domain Wi-Fi Sensing Framework Based on Siamese Network
- URL: http://arxiv.org/abs/2408.10919v4
- Date: Fri, 14 Feb 2025 11:12:02 GMT
- Title: CrossFi: A Cross Domain Wi-Fi Sensing Framework Based on Siamese Network
- Authors: Zijian Zhao, Tingwei Chen, Zhijie Cai, Xiaoyang Li, Hang Li, Qimei Chen, Guangxu Zhu,
- Abstract summary: CrossFi is a siamese network-based approach that excels in both in-domain scenario and cross-domain scenario.<n>We develop an extra Weight-Net that can generate a template for each class, so that our CrossFi can work in different scenarios.<n>In gesture recognition task, our CrossFi achieves an accuracy of 98.17% in in-domain scenario, 91.72% in one-shot cross-domain scenario, 64.81% in zero-shot cross-domain scenario, and 84.75% in one-shot new-class scenario.
- Score: 17.33355763750407
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In recent years, Wi-Fi sensing has garnered significant attention due to its numerous benefits, such as privacy protection, low cost, and penetration ability. Extensive research has been conducted in this field, focusing on areas such as gesture recognition, people identification, and fall detection. However, many data-driven methods encounter challenges related to domain shift, where the model fails to perform well in environments different from the training data. One major factor contributing to this issue is the limited availability of Wi-Fi sensing datasets, which makes models learn excessive irrelevant information and over-fit to the training set. Unfortunately, collecting large-scale Wi-Fi sensing datasets across diverse scenarios is a challenging task. To address this problem, we propose CrossFi, a siamese network-based approach that excels in both in-domain scenario and cross-domain scenario, including few-shot, zero-shot scenarios, and even works in few-shot new-class scenario where testing set contains new categories. The core component of CrossFi is a sample-similarity calculation network called CSi-Net, which improves the structure of the siamese network by using an attention mechanism to capture similarity information, instead of simply calculating the distance or cosine similarity. Based on it, we develop an extra Weight-Net that can generate a template for each class, so that our CrossFi can work in different scenarios. Experimental results demonstrate that our CrossFi achieves state-of-the-art performance across various scenarios. In gesture recognition task, our CrossFi achieves an accuracy of 98.17% in in-domain scenario, 91.72% in one-shot cross-domain scenario, 64.81% in zero-shot cross-domain scenario, and 84.75% in one-shot new-class scenario. The code for our model is publicly available at https://github.com/RS2002/CrossFi.
Related papers
- Scale What Counts, Mask What Matters: Evaluating Foundation Models for Zero-Shot Cross-Domain Wi-Fi Sensing [2.5495319679484054]
Wi-Fi sensing offers a compelling, privacy-preserving alternative to cameras.<n>Models trained in one setup fail to generalize to new environments, hardware, or users.<n>Our study pretrains and evaluates models on over 1.3 million samples extracted from 14 datasets.
arXiv Detail & Related papers (2025-11-24T05:46:29Z) - Cross-Domain Multi-Person Human Activity Recognition via Near-Field Wi-Fi Sensing [20.1340684071988]
We propose WiAnchor, a novel training framework for efficient cross-domain adaptation in the presence of incomplete activity categories.<n>We construct a comprehensive dataset to thoroughly evaluate WiAnchor, achieving over 90% cross-domain accuracy with absent activity categories.
arXiv Detail & Related papers (2025-09-27T03:22:15Z) - Few-shot Classification as Multi-instance Verification: Effective Backbone-agnostic Transfer across Domains [11.027466339522777]
Cross-domain few-shot learning is increasingly common in practical use cases.<n>Fine-tuning of backbones (i.e., feature extractors) is impossible or infeasible.<n>We introduce a novel approach to few-shot domain adaptation, named the "MIV-head"
arXiv Detail & Related papers (2025-07-01T03:34:20Z) - Dual Classification Head Self-training Network for Cross-scene Hyperspectral Image Classification [7.482363472369229]
Cross-scene classification has emerged as a widely adopted approach in the remote sensing community.
variations in the reflectance spectrum of the same object between the SD and the TD, as well as differences in the feature distribution of the same land cover class, pose significant challenges to the performance of cross-scene classification.
We introduce a dual classification head self-training strategy for the first time in the cross-scene HSI classification field.
arXiv Detail & Related papers (2025-02-25T06:07:46Z) - Generalizable Metric Network for Cross-domain Person Re-identification [55.71632958027289]
Cross-domain (i.e., domain generalization) scene presents a challenge in Re-ID tasks.
Most existing methods aim to learn domain-invariant or robust features for all domains.
We propose a Generalizable Metric Network (GMN) to explore sample similarity in the sample-pair space.
arXiv Detail & Related papers (2023-06-21T03:05:25Z) - DualCross: Cross-Modality Cross-Domain Adaptation for Monocular BEV Perception [30.113617846516398]
DualCross is a cross-modality cross-domain adaptation framework to facilitate the learning of a more robust BEV perception model.
This work results in the first open analysis of cross-domain cross-sensor perception and adaptation for monocular 3D tasks in the wild.
arXiv Detail & Related papers (2023-05-05T17:58:45Z) - MemSAC: Memory Augmented Sample Consistency for Large Scale Unsupervised
Domain Adaptation [71.4942277262067]
We propose MemSAC, which exploits sample level similarity across source and target domains to achieve discriminative transfer.
We provide in-depth analysis and insights into the effectiveness of MemSAC.
arXiv Detail & Related papers (2022-07-25T17:55:28Z) - One-Class Knowledge Distillation for Face Presentation Attack Detection [53.30584138746973]
This paper introduces a teacher-student framework to improve the cross-domain performance of face PAD with one-class domain adaptation.
Student networks are trained to mimic the teacher network and learn similar representations for genuine face samples of the target domain.
In the test phase, the similarity score between the representations of the teacher and student networks is used to distinguish attacks from genuine ones.
arXiv Detail & Related papers (2022-05-08T06:20:59Z) - Cross Domain Few-Shot Learning via Meta Adversarial Training [34.383449283927014]
Few-shot relation classification (RC) is one of the critical problems in machine learning.
We present a novel model that takes into consideration the afore-mentioned cross-domain situation.
A meta-based adversarial training framework is proposed to fine-tune the trained networks for adapting to data from the target domain.
arXiv Detail & Related papers (2022-02-11T15:52:29Z) - Understanding Cross-Domain Few-Shot Learning: An Experimental Study [17.81177649496765]
Cross-domain few-shot learning has drawn increasing attention for handling large differences between the source and target domains.
Recent works have considered exploiting small-scale unlabeled data from the target domain during the pre-training stage.
This data enables self-supervised pre-training on the target domain, in addition to supervised pre-training on the source domain.
arXiv Detail & Related papers (2022-02-01T12:35:25Z) - Federated Multi-Target Domain Adaptation [99.93375364579484]
Federated learning methods enable us to train machine learning models on distributed user data while preserving its privacy.
We consider a more practical scenario where the distributed client data is unlabeled, and a centralized labeled dataset is available on the server.
We propose an effective DualAdapt method to address the new challenges.
arXiv Detail & Related papers (2021-08-17T17:53:05Z) - Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with
Unlabeled Data [21.348965677980104]
We tackle the problem of cross-domain few-shot recognition with unlabeled target data.
STARTUP was the first method that tackles this problem using self-training.
We propose a simple dynamic distillation-based approach to facilitate unlabeled images from the novel/base dataset.
arXiv Detail & Related papers (2021-06-14T23:44:34Z) - Graph Attention Tracking [76.19829750144564]
We propose a simple target-aware Siamese graph attention network for general object tracking.
Experiments on challenging benchmarks including GOT-10k, UAV123, OTB-100 and LaSOT demonstrate that the proposed SiamGAT outperforms many state-of-the-art trackers.
arXiv Detail & Related papers (2020-11-23T04:26:45Z) - RethinkCWS: Is Chinese Word Segmentation a Solved Task? [81.11161697133095]
The performance of the Chinese Word (CWS) systems has gradually reached a plateau with the rapid development of deep neural networks.
In this paper, we take stock of what we have achieved and rethink what's left in the CWS task.
arXiv Detail & Related papers (2020-11-13T11:07:08Z) - Self-Challenging Improves Cross-Domain Generalization [81.99554996975372]
Convolutional Neural Networks (CNN) conduct image classification by activating dominant features that correlated with labels.
We introduce a simple training, Self-Challenging Representation (RSC), that significantly improves the generalization of CNN to the out-of-domain data.
RSC iteratively challenges the dominant features activated on the training data, and forces the network to activate remaining features that correlates with labels.
arXiv Detail & Related papers (2020-07-05T21:42:26Z) - One-Shot Unsupervised Cross-Domain Detection [33.04327634746745]
This paper presents an object detection algorithm able to perform unsupervised adaption across domains by using only one target sample, seen at test time.
We achieve this by introducing a multi-task architecture that one-shot adapts to any incoming sample by iteratively solving a self-supervised task on it.
arXiv Detail & Related papers (2020-05-23T22:12:20Z) - StarNet: towards Weakly Supervised Few-Shot Object Detection [87.80771067891418]
We introduce StarNet - a few-shot model featuring an end-to-end differentiable non-parametric star-model detection and classification head.
Through this head, the backbone is meta-trained using only image-level labels to produce good features for jointly localizing and classifying previously unseen categories of few-shot test tasks.
Being a few-shot detector, StarNet does not require any bounding box annotations, neither during pre-training nor for novel classes adaptation.
arXiv Detail & Related papers (2020-03-15T11:35:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.