50 Shades of Deceptive Patterns: A Unified Taxonomy, Multimodal Detection, and Security Implications

• URL: http://arxiv.org/abs/2501.13351v3
• Date: Tue, 04 Feb 2025 02:33:36 GMT
• Title: 50 Shades of Deceptive Patterns: A Unified Taxonomy, Multimodal Detection, and Security Implications
• Abstract summary: Deceptive patterns (DPs) are user interface designs deliberately crafted to manipulate users into unintended decisions.<n>We have expanded the deceptive pattern taxonomy from security and privacy perspectives, refining its categories and scope.<n>We have developed DPGuard, a novel automatic tool leveraging commercial multimodal large language models (MLLMs) for deceptive pattern detection.
• Score: 33.2581087304465
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deceptive patterns (DPs) are user interface designs deliberately crafted to manipulate users into unintended decisions, often by exploiting cognitive biases for the benefit of companies or services. While numerous studies have explored ways to identify these deceptive patterns, many existing solutions require significant human intervention and struggle to keep pace with the evolving nature of deceptive designs. To address these challenges, we expanded the deceptive pattern taxonomy from security and privacy perspectives, refining its categories and scope. We created a comprehensive dataset of deceptive patterns by integrating existing small-scale datasets with new samples, resulting in 6,725 images and 10,421 DP instances from mobile apps and websites. We then developed DPGuard, a novel automatic tool leveraging commercial multimodal large language models (MLLMs) for deceptive pattern detection. Experimental results show that DPGuard outperforms state-of-the-art methods. Finally, we conducted an extensive empirical evaluation on 2,000 popular mobile apps and websites, revealing that 23.61% of mobile screenshots and 47.27% of website screenshots feature at least one deceptive pattern instance. Through four unexplored case studies that inform security implications, we highlight the critical importance of the unified taxonomy in addressing the growing challenges of Internet deception.

Related papers

• SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information [61.41881137371855]
  We introduce SPIEval, a benchmark for large language models (LLMs)<n> SPIEval comprises 250 tasks spanning 4,335 personal records distributed across 10 apps and supports multi-turn interaction through 21 tools.<n>The best-performing model, GPT-5.5 (xhigh), achieves only 57.3% accuracy, while the weakest achieves just 16.4%.
  arXiv  Detail & Related papers  (2026-08-11T09:14:53Z)
• DPAgent-in-the-Middle: Agentic Defense and Repair Against AI-Groomed Deceptive Patterns [26.785953823532818]
  DPAgent is an agentic and reasoning-aware framework that orchestrates four specialized agents to mitigate the AI Grooming threat.<n> DPAgent detects 90.98% of groomed samples, achieves state-of-the-art privacy deceptive pattern detection with a micro F1 of 0.816.<n>A large-scale study of 485 websites in the wild reveals that up to 98% contain at least one privacy deceptive pattern.
  arXiv  Detail & Related papers  (2026-06-05T05:26:42Z)
• TIDE: Proactive Multi-Problem Discovery via Template-Guided Iteration [74.97459526627395]
  We introduce TIDE, a template-guided iterative framework with two complementary mechanisms.<n>We propose iterative discovery, which surfaces a small batch of candidates per round while conditioning on what has already been found.<n>We show substantial gains over single-shot and parallel multi-agent baselines on task coverage, identification, and resolution.
  arXiv  Detail & Related papers  (2026-06-03T11:23:08Z)
• Bridging Cognitive Neuroscience and Graph Intelligence: Hippocampus-Inspired Multi-View Hypergraph Learning for Web Finance Fraud [10.498542622240285]
  HIMVH is a Hippocampus-Inspired Multi-View Hypergraph learning model for web finance fraud detection.<n>Inspired by the scene conflict monitoring role of the hippocampus, we design a cross-view inconsistency perception module.<n>We also introduce a novelty-aware hypergraph learning module that measures feature deviations from neighborhood expectations.
  arXiv  Detail & Related papers  (2026-01-16T08:18:23Z)
• Multimodal Detection of Fake Reviews using BERT and ResNet-50 [0.0]
  A robust multimodal fake review detection framework is proposed, integrating textual features encoded with BERT and visual features extracted using ResNet-50.<n> Experimental results indicate that the multimodal model outperforms unimodal baselines, achieving an F1-score of 0.934 on the test set.<n>This study demonstrates the critical role of multimodal learning in safeguarding digital trust and offers a scalable solution for content moderation.
  arXiv  Detail & Related papers  (2025-10-24T01:24:53Z)
• A Generative Framework for Personalized Sticker Retrieval [73.57899194210141]
  We propose PEARL, a novel generative framework for personalized sticker retrieval.<n>We make two key contributions: (i) To encode user-specific sticker preferences, we design a representation learning model to learn discriminative user representations, and (ii) To generate stickers aligned with a user's query intent, we propose a novel intent-aware learning objective.<n> Empirical results from both offline evaluations and online tests demonstrate that PEARL significantly outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-09-22T13:11:44Z)
• Deep Learning Models for Robust Facial Liveness Detection [56.08694048252482]
  This study introduces a robust solution through novel deep learning models addressing the deficiencies in contemporary anti-spoofing techniques.<n>By innovatively integrating texture analysis and reflective properties associated with genuine human traits, our models distinguish authentic presence from replicas with remarkable precision.
  arXiv  Detail & Related papers  (2025-08-12T17:19:20Z)
• SVC 2025: the First Multimodal Deception Detection Challenge [16.070848946361696]
  The SVC 2025 Multimodal Deception Detection Challenge is a new benchmark designed to evaluate cross-domain generalization in audio-visual deception detection.<n>We aim to foster the development of more adaptable, explainable, and practically deployable deception detection systems.
  arXiv  Detail & Related papers  (2025-08-06T06:56:39Z)
• Benchmarking Unified Face Attack Detection via Hierarchical Prompt Tuning [58.16354555208417]
  PAD and FFD are proposed to protect face data from physical media-based Presentation Attacks and digital editing-based DeepFakes, respectively.<n>The lack of a Unified Face Attack Detection model to simultaneously handle attacks in these two categories is mainly attributed to two factors.<n>We present a novel Visual-Language Model-based Hierarchical Prompt Tuning Framework that adaptively explores multiple classification criteria from different semantic spaces.
  arXiv  Detail & Related papers  (2025-05-19T16:35:45Z)
• Understanding the Sneaky Patterns of Pop-up Windows in the Mobile Ecosystem [6.475928035972003]
  This paper provides the first in-depth study on the Sneaky patterns in the mobile ecosystem.<n>Our research highlights five distinct Sneaky patterns that compromise user experience, including text mislead, UI mislead, forced action, out of context and privacy-intrusive by default.<n>We develop an automated analysis pipeline called Poker, to tackle the challenges of identifying, dismissing, and collecting diverse PoWs in real-world apps.
  arXiv  Detail & Related papers  (2025-05-17T15:39:13Z)
• Adaptation Method for Misinformation Identification [8.581136866856255]
  We propose ADOSE, an Active Domain Adaptation (ADA) framework for multimodal fake news detection. ADOSE actively annotates a small subset of target samples to improve detection performance. ADOSE outperforms existing ADA methods by 2.72% $sim$ 14.02%, indicating the superiority of our model.
  arXiv  Detail & Related papers  (2025-04-19T04:18:32Z)
• A Knowledge-guided Adversarial Defense for Resisting Malicious Visual Manipulation [93.28532038721816]
  Malicious applications of visual manipulation have raised serious threats to the security and reputation of users in many fields. We propose a knowledge-guided adversarial defense (KGAD) to actively force malicious manipulation models to output semantically confusing samples.
  arXiv  Detail & Related papers  (2025-04-11T10:18:13Z)
• Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models [53.55128042938329]
  Forensics-Bench is a new forgery detection evaluation benchmark suite. It comprises 63,292 meticulously curated multi-choice visual questions, covering 112 unique forgery detection types. We conduct thorough evaluations on 22 open-sourced LVLMs and 3 proprietary models GPT-4o, Gemini 1.5 Pro, and Claude 3.5 Sonnet.
  arXiv  Detail & Related papers  (2025-03-19T09:21:44Z)
• A Federated Learning Approach for Multi-stage Threat Analysis in Advanced Persistent Threat Campaigns [25.97800399318373]
  Multi-stage threats like advanced persistent threats (APT) pose severe risks by stealing data and destroying infrastructure. APTs use novel attack vectors and evade signature-based detection by obfuscating their network presence. This paper proposes a novel 3-phase unsupervised federated learning (FL) framework to detect APTs.
  arXiv  Detail & Related papers  (2024-06-19T03:34:41Z)
• Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models [112.48136829374741]
  In this paper, we unveil a new vulnerability: the privacy backdoor attack. When a victim fine-tunes a backdoored model, their training data will be leaked at a significantly higher rate than if they had fine-tuned a typical model. Our findings highlight a critical privacy concern within the machine learning community and call for a reevaluation of safety protocols in the use of open-source pre-trained models.
  arXiv  Detail & Related papers  (2024-04-01T16:50:54Z)
• The Invisible Game on the Internet: A Case Study of Decoding Deceptive Patterns [19.55209153462331]
  Deceptive patterns are design practices embedded in digital platforms to manipulate users. Despite advancements in detection tools, a significant gap exists in assessing deceptive pattern risks.
  arXiv  Detail & Related papers  (2024-02-05T22:42:59Z)
• Model Stealing Attack against Graph Classification with Authenticity, Uncertainty and Diversity [80.16488817177182]
  GNNs are vulnerable to the model stealing attack, a nefarious endeavor geared towards duplicating the target model via query permissions. We introduce three model stealing attacks to adapt to different actual scenarios.
  arXiv  Detail & Related papers  (2023-12-18T05:42:31Z)
• TII-SSRC-23 Dataset: Typological Exploration of Diverse Traffic Patterns for Intrusion Detection [0.5261718469769447]
  Existing datasets often fall short, lacking the necessary diversity and alignment with the contemporary network environment. This paper introduces TII-SSRC-23, a novel and comprehensive dataset designed to overcome these challenges.
  arXiv  Detail & Related papers  (2023-09-14T05:23:36Z)
• Wild Face Anti-Spoofing Challenge 2023: Benchmark and Results [73.98594459933008]
  Face anti-spoofing (FAS) is an essential mechanism for safeguarding the integrity of automated face recognition systems. This limitation can be attributed to the scarcity and lack of diversity in publicly available FAS datasets. We introduce the Wild Face Anti-Spoofing dataset, a large-scale, diverse FAS dataset collected in unconstrained settings.
  arXiv  Detail & Related papers  (2023-04-12T10:29:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.