Evaluating the Effectiveness of OpenAI's Parental Control System

TL;DR

This study assesses how well OpenAI's platform-level parental controls moderate a conversational assistant for minors, revealing strengths and gaps in alerting and overblocking, and proposing improvements for better safety and transparency.

Contribution

It introduces a two-phase evaluation protocol for parental controls, compares current and legacy models, and offers actionable recommendations to enhance moderation effectiveness and transparency.

Findings

Notifications are selective, missing alerts for some risks.

Current backend has lower leak-through than legacy models.

Overblocking of benign queries remains a challenge.

Abstract

We evaluate how effectively platform-level parental controls moderate a mainstream conversational assistant used by minors. Our two-phase protocol first builds a category-balanced conversation corpus via PAIR-style iterative prompt refinement over API, then has trained human agents replay/refine those prompts in the consumer UI using a designated child account while monitoring the linked parent inbox for alerts. We focus on seven risk areas -- physical harm, pornography, privacy violence, health consultation, fraud, hate speech, and malware and quantify four outcomes: Notification Rate (NR), Leak-Through (LR), Overblocking (OBR), and UI Intervention Rate (UIR). Using an automated judge (with targeted human audit) and comparing the current backend to legacy variants (GPT-4.1/4o), we find that notifications are selective rather than comprehensive: privacy violence, fraud, hate speech, and malware triggered no parental alerts in our runs, whereas physical harm (highest), pornography, and some health queries produced intermittent alerts. The current backend shows lower leak-through than legacy models, yet overblocking of benign, educational queries near sensitive topics remains common and is not surfaced to parents, revealing a policy-product gap between on-screen safeguards and parent-facing telemetry. We propose actionable fixes: broaden/configure the notification taxonomy, couple visible safeguards to privacy-preserving parent summaries, and prefer calibrated, age-appropriate safe rewrites over blanket refusals.