Demonstrably Informed Consent in Privacy Policy Flows: Evidence from a Randomized Experiment

TL;DR

This study investigates how embedded educational interventions within privacy policies can improve users' understanding and demonstrate informed consent, using a randomized experiment with parents reviewing an edtech app's privacy policy.

Contribution

It introduces pedagogical friction as a design approach to enhance demonstrated comprehension in privacy consent flows, supported by experimental evidence.

Findings

Slide-based presentation achieved highest comprehension threshold (41.7%) on first attempt.

Second review and quiz retakes improved scores, with 64.9% passing on second attempt.

Most participants still consented without demonstrating comprehension, indicating ungated consent flows record agreement regardless of understanding.

Abstract

Privacy policies govern how personal data is collected, used, and shared. Yet, in most privacy-policy consent flows, agreement is operationalized as a single click at the end of a long, opaque policy document. Recent privacy-law scholarship has argued for a standard of demonstrably informed consent. That is, the party drafting and designing privacy-policy consent mechanisms must generate reliable evidence that a person demonstrates comprehension of the consequential terms to which they agree. To this end, we study pedagogical friction as a design framing: minimal interventions embedded within a privacy-policy consent flow that aim to support demonstrated comprehension while keeping burden on the user low. In a randomized experiment, we tested pedagogical friction for demonstrably informed consent in the context of a privacy policy for an edtech app for young children. We recruited 293 parents of kids ages 3-8 to review the app's privacy policy under one of six conditions that varied presentation format and pacing, then complete a six-question comprehension quiz. Three conditions offered a second policy review and quiz retake for participants who did not pass this quiz on their first attempt. We find that the slide-based condition (G3) achieved the highest first-attempt threshold attainment (>=80%) (41.7%), followed by the paced, sectioned condition (G4) (30.6%). In the retake conditions, 64.9% of participants who completed a second attempt improved their score. Notably, in conditions that did not gate consent on demonstrated comprehension, 97.3% of participants who scored below the threshold still chose to consent, suggesting that ungated consent flows can record agreement without demonstrated comprehension. Our results suggest that pedagogical friction can strengthen the evidentiary basis of consent and clarify what it costs in time and burden.