User Strategization and Trustworthy Algorithms
Sarah H. Cen, Andrew Ilyas, Aleksander Madry

TL;DR
This paper models user-algorithm interactions as a game, revealing that user strategization can temporarily benefit platforms but ultimately harms data quality and decision accuracy, highlighting the importance of trustworthy algorithm design.
Contribution
It introduces a game-theoretic framework for understanding user strategization, showing its short-term benefits and long-term drawbacks for data integrity and decision-making.
Findings
User strategization can improve short-term platform outcomes.
Strategic behavior corrupts data and impairs counterfactual decision accuracy.
Designing trustworthy algorithms aligns with improving data reliability.
Abstract
Many human-facing algorithms -- including those that power recommender systems or hiring decision tools -- are trained on data provided by their users. The developers of these algorithms commonly adopt the assumption that the data generating process is exogenous: that is, how a user reacts to a given prompt (e.g., a recommendation or hiring suggestion) depends on the prompt and not on the algorithm that generated it. For example, the assumption that a person's behavior follows a ground-truth distribution is an exogeneity assumption. In practice, when algorithms interact with humans, this assumption rarely holds because users can be strategic. Recent studies document, for example, TikTok users changing their scrolling behavior after learning that TikTok uses it to curate their feed, and Uber drivers changing how they accept and cancel rides in response to changes in Uber's algorithm.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBlockchain Technology Applications and Security · Privacy, Security, and Data Protection · Mind wandering and attention
