Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications
Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu,, Xiwei Xu, Chunyang Chen

TL;DR
This paper introduces UIGuard, an automated system that uses computer vision and natural language processing to detect dark patterns in mobile app UIs, improving detection speed and coverage over previous methods.
Contribution
UIGuard integrates existing taxonomies into a unified framework, automates dark pattern detection, and demonstrates superior performance and user awareness enhancement.
Findings
Achieved 0.82 precision, 0.77 recall, 0.79 F1 score in dark pattern detection.
Created the first large dataset of benign and malicious UIs for dark pattern analysis.
User study shows increased user knowledge about dark patterns.
Abstract
Mobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not in their best interest. Many works have been done to summarize the taxonomy of these patterns and some have tried to mitigate the problems through various techniques. However, these techniques are either time-consuming, not generalisable or limited to specific patterns. To address these issues, we propose UIGuard, a knowledge-driven system that utilizes computer vision and natural language pattern matching to automatically detect a wide range of dark patterns in mobile UIs. Our system relieves the need for manually creating rules for each new UI/app and covers more types with superior performance. In detail, we integrated existing taxonomies into a consistent one, conducted a characteristic analysis and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsWeb Data Mining and Analysis · Spam and Phishing Detection · Advanced Malware Detection Techniques
