From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps

• URL: http://arxiv.org/abs/2411.18084v1
• Date: Wed, 27 Nov 2024 06:39:35 GMT
• Title: From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
• Authors: Jieshan Chen, Zhen Wang, Jiamou Sun, Wenbo Zou, Zhenchang Xing, Qinghua Lu, Qing Huang, Xiwei Xu,
• Abstract summary: AppRay is a system that seamlessly blends task-oriented app exploration with automated dark pattern detection. We contributed two datasets, AppRay-Dark and AppRay-Light, with 2,185 unique deceptive patterns across 18 types from 876 UIs and 871 benign UIs. Experimental results confirm that AppRay can efficiently explore the app and identify a wide range of dark patterns with great performance.
• Score: 23.500272967327543
• License:
• Abstract: Mobile apps are essential in daily life, yet they often employ dark patterns, such as visual tricks to highlight certain options or linguistic tactics to nag users into making purchases, to manipulate user behavior. Current research mainly uses manual methods to detect dark patterns, a process that is time-consuming and struggles to keep pace with continually updating and emerging apps. While some studies targeted at automated detection, they are constrained to static patterns and still necessitate manual app exploration. To bridge these gaps, we present AppRay, an innovative system that seamlessly blends task-oriented app exploration with automated dark pattern detection, reducing manual efforts. Our approach consists of two steps: First, we harness the commonsense knowledge of large language models for targeted app exploration, supplemented by traditional random exploration to capture a broader range of UI states. Second, we developed a static and dynamic dark pattern detector powered by a contrastive learning-based multi-label classifier and a rule-based refiner to perform detection. We contributed two datasets, AppRay-Dark and AppRay-Light, with 2,185 unique deceptive patterns (including 149 dynamic instances) across 18 types from 876 UIs and 871 benign UIs. These datasets cover both static and dynamic dark patterns while preserving UI relationships. Experimental results confirm that AppRay can efficiently explore the app and identify a wide range of dark patterns with great performance.

Related papers

• No Identity, no problem: Motion through detection for people tracking [48.708733485434394]
  We propose exploiting motion clues while providing supervision only for the detections. Our algorithm predicts detection heatmaps at two different times, along with a 2D motion estimate between the two images. We show that our approach delivers state-of-the-art results for single- and multi-view multi-target tracking on the MOT17 and WILDTRACK datasets.
  arXiv  Detail & Related papers  (2024-11-25T15:13:17Z)
• Detecting Android Malware by Visualizing App Behaviors from Multiple Complementary Views [28.69137642535078]
  We propose and implement LensDroid, a novel technique that detects Android malware by visualizing app behaviors from multiple complementary views. Our goal is to harness the power of combining deep learning and software visualization to automatically capture and aggregate high-level features that are not inherently linked.
  arXiv  Detail & Related papers  (2024-10-08T16:00:27Z)
• Detecting Deceptive Dark Patterns in E-commerce Platforms [0.0]
  Dark patterns are deceptive user interfaces employed by e-commerce websites to manipulate user's behavior in a way that benefits the website, often unethically. Existing solutions include UIGuard, which uses computer vision and natural language processing, and approaches that categorize dark patterns based on detectability or utilize machine learning models trained on datasets. We propose combining web scraping techniques with fine-tuned BERT language models and generative capabilities to identify dark patterns, including outliers.
  arXiv  Detail & Related papers  (2024-05-27T16:32:40Z)
• NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration [57.15811390835294]
  This paper describes how we can train a single unified diffusion policy to handle both goal-directed navigation and goal-agnostic exploration. We show that this unified policy results in better overall performance when navigating to visually indicated goals in novel environments. Our experiments, conducted on a real-world mobile robot platform, show effective navigation in unseen environments in comparison with five alternative methods.
  arXiv  Detail & Related papers  (2023-10-11T21:07:14Z)
• AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces [6.922187804798161]
  UI dark patterns can lead end-users toward (unknowingly) taking actions that they may not have intended. We introduce AidUI, a novel approach that uses computer vision and natural language processing techniques to recognize ten unique UI dark patterns. AidUI achieves an overall precision of 0.66, recall of 0.67, F1-score of 0.65 in detecting dark pattern instances, and is able to localize detected patterns with an IoU score of 0.84.
  arXiv  Detail & Related papers  (2023-03-12T23:46:04Z)
• Dark patterns in e-commerce: a dataset and its baseline evaluations [0.14680035572775535]
  We constructed a dataset for dark pattern detection with state-of-the-art machine learning methods. As a result of 5-fold cross-validation, we achieved the highest accuracy of 0.975 with RoBERTa.
  arXiv  Detail & Related papers  (2022-11-12T01:53:49Z)
• SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detection [108.57862846523858]
  We revisit the self-supervised multi-task learning framework, proposing several updates to the original method. We modernize the 3D convolutional backbone by introducing multi-head self-attention modules. In our attempt to further improve the model, we study additional self-supervised learning tasks, such as predicting segmentation maps.
  arXiv  Detail & Related papers  (2022-07-16T19:25:41Z)
• Correlation-Aware Deep Tracking [83.51092789908677]
  We propose a novel target-dependent feature network inspired by the self-/cross-attention scheme. Our network deeply embeds cross-image feature correlation in multiple layers of the feature network. Our model can be flexibly pre-trained on abundant unpaired images, leading to notably faster convergence than the existing methods.
  arXiv  Detail & Related papers  (2022-03-03T11:53:54Z)
• Learnable Online Graph Representations for 3D Multi-Object Tracking [156.58876381318402]
  We propose a unified and learning based approach to the 3D MOT problem. We employ a Neural Message Passing network for data association that is fully trainable. We show the merit of the proposed approach on the publicly available nuScenes dataset by achieving state-of-the-art performance of 65.6% AMOTA and 58% fewer ID-switches.
  arXiv  Detail & Related papers  (2021-04-23T17:59:28Z)
• Robustness of on-device Models: Adversarial Attack to Deep Learning Models on Android Apps [14.821745719407037]
  Most deep learning models within Android apps can easily be obtained via mature reverse engineering. In this study, we propose a simple but effective approach to hacking deep learning models using adversarial attacks.
  arXiv  Detail & Related papers  (2021-01-12T10:49:30Z)
• AutoOD: Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning [72.99415402575886]
  Outlier detection is an important data mining task with numerous practical applications. We propose AutoOD, an automated outlier detection framework, which aims to search for an optimal neural network model. Experimental results on various real-world benchmark datasets demonstrate that the deep model identified by AutoOD achieves the best performance.
  arXiv  Detail & Related papers  (2020-06-19T18:57:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.