INADVERT: An Interactive and Adaptive Counterdeception Platform for
Attention Enhancement and Phishing Prevention
- URL: http://arxiv.org/abs/2106.06907v1
- Date: Sun, 13 Jun 2021 03:52:55 GMT
- Title: INADVERT: An Interactive and Adaptive Counterdeception Platform for
Attention Enhancement and Phishing Prevention
- Authors: Linan Huang and Quanyan Zhu
- Abstract summary: INADVERT is a systematic solution that generates interactive visual aids in real-time to prevent users from inadvertence and counter visual-deception attacks.
Based on the eye-tracking outcomes and proper data compression, the INADVERT platform automatically adapts the visual aids to the user's varying attention status captured by the gaze location and duration.
- Score: 28.570086492742046
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deceptive attacks exploiting the innate and the acquired vulnerabilities of
human users have posed severe threats to information and infrastructure
security. This work proposes INADVERT, a systematic solution that generates
interactive visual aids in real-time to prevent users from inadvertence and
counter visual-deception attacks. Based on the eye-tracking outcomes and proper
data compression, the INADVERT platform automatically adapts the visual aids to
the user's varying attention status captured by the gaze location and duration.
We extract system-level metrics to evaluate the user's average attention level
and characterize the magnitude and frequency of the user's mind-wandering
behaviors. These metrics contribute to an adaptive enhancement of the user's
attention through reinforcement learning. To determine the optimal
hyper-parameters in the attention enhancement mechanism, we develop an
algorithm based on Bayesian optimization to efficiently update the design of
the INADVERT platform and maximize the accuracy of the users' phishing
recognition.
Related papers
- Evaluating the Effectiveness and Robustness of Visual Similarity-based Phishing Detection Models [10.334870703744498]
We comprehensively scrutinize and evaluate state-of-the-art visual similarity-based anti-phishing models.
Our analysis reveals that while certain models maintain high accuracy, others exhibit notably lower performance than results on curated datasets.
To the best of our knowledge, this work represents the first large-scale, systematic evaluation of visual similarity-based models for phishing detection in real-world settings.
arXiv Detail & Related papers (2024-05-30T01:28:36Z) - Tell Me More! Towards Implicit User Intention Understanding of Language
Model Driven Agents [110.25679611755962]
Current language model-driven agents often lack mechanisms for effective user participation, which is crucial given the vagueness commonly found in user instructions.
We introduce Intention-in-Interaction (IN3), a novel benchmark designed to inspect users' implicit intentions through explicit queries.
We empirically train Mistral-Interact, a powerful model that proactively assesses task vagueness, inquires user intentions, and refines them into actionable goals.
arXiv Detail & Related papers (2024-02-14T14:36:30Z) - Predicting Viral Rumors and Vulnerable Users for Infodemic Surveillance [9.099277246096861]
We propose a novel approach to predict viral rumors and vulnerable users using a unified graph neural network model.
We pre-train network-based user embeddings and leverage a cross-attention mechanism between users and posts.
We also construct two datasets with ground-truth annotations on information virality and user vulnerability in rumor and non-rumor events.
arXiv Detail & Related papers (2024-01-18T04:57:12Z) - SeGA: Preference-Aware Self-Contrastive Learning with Prompts for
Anomalous User Detection on Twitter [14.483830120541894]
We propose SeGA, preference-aware self-contrastive learning for anomalous user detection.
SeGA uses large language models to summarize user preferences via posts.
We empirically validate the effectiveness of the model design and pre-training strategies.
arXiv Detail & Related papers (2023-12-17T05:35:28Z) - Adv-Attribute: Inconspicuous and Transferable Adversarial Attack on Face
Recognition [111.1952945740271]
Adversarial Attributes (Adv-Attribute) is designed to generate inconspicuous and transferable attacks on face recognition.
Experiments on the FFHQ and CelebA-HQ datasets show that the proposed Adv-Attribute method achieves the state-of-the-art attacking success rates.
arXiv Detail & Related papers (2022-10-13T09:56:36Z) - Efficient Human Vision Inspired Action Recognition using Adaptive
Spatiotemporal Sampling [13.427887784558168]
We introduce a novel adaptive vision system for efficient action recognition processing.
Our system pre-scans the global context sampling scheme at low-resolution and decides to skip or request high-resolution features at salient regions for further processing.
We validate the system on EPIC-KENS and UCF-101 datasets for action recognition, and show that our proposed approach can greatly speed up inference with a tolerable loss of accuracy compared with those from state-the-art baselines.
arXiv Detail & Related papers (2022-07-12T01:18:58Z) - Attribute Inference Attack of Speech Emotion Recognition in Federated
Learning Settings [56.93025161787725]
Federated learning (FL) is a distributed machine learning paradigm that coordinates clients to train a model collaboratively without sharing local data.
We propose an attribute inference attack framework that infers sensitive attribute information of the clients from shared gradients or model parameters.
We show that the attribute inference attack is achievable for SER systems trained using FL.
arXiv Detail & Related papers (2021-12-26T16:50:42Z) - Counterfactual Attention Learning for Fine-Grained Visual Categorization
and Re-identification [101.49122450005869]
We present a counterfactual attention learning method to learn more effective attention based on causal inference.
Specifically, we analyze the effect of the learned visual attention on network prediction.
We evaluate our method on a wide range of fine-grained recognition tasks.
arXiv Detail & Related papers (2021-08-19T14:53:40Z) - Assisted Perception: Optimizing Observations to Communicate State [112.40598205054994]
We aim to help users estimate the state of the world in tasks like robotic teleoperation and navigation with visual impairments.
We synthesize new observations that lead to more accurate internal state estimates when processed by the user.
arXiv Detail & Related papers (2020-08-06T19:08:05Z) - Unsupervised Model Personalization while Preserving Privacy and
Scalability: An Open Problem [55.21502268698577]
This work investigates the task of unsupervised model personalization, adapted to continually evolving, unlabeled local user images.
We provide a novel Dual User-Adaptation framework (DUA) to explore the problem.
This framework flexibly disentangles user-adaptation into model personalization on the server and local data regularization on the user device.
arXiv Detail & Related papers (2020-03-30T09:35:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.