Cyclic Adaptive Private Synthesis for Sharing Real-World Data in Education

TL;DR

This paper introduces the CAPS framework for iterative, privacy-preserving sharing of high-dimensional educational real-world data, enhancing learning analytics and open science.

Contribution

It presents a novel cyclic adaptive private synthesis method tailored for educational data, addressing challenges of high-dimensionality and continual data sharing.

Findings

CAPS outperforms one-shot synthesis baselines in experiments.

Iterative sharing enhances data utility and supports open science.

Challenges in privacy-utility trade-offs remain and need further research.

Abstract

The rapid adoption of digital technologies has greatly increased the volume of real-world data (RWD) in education. While these data offer significant opportunities for advancing learning analytics (LA), secondary use for research is constrained by privacy concerns. Differentially private synthetic data generation is regarded as the gold-standard approach to sharing sensitive data, yet studies on the private synthesis of educational data remain very scarce and rely predominantly on large, low-dimensional open datasets. Educational RWD, however, are typically high-dimensional and small in sample size, leaving the potential of private synthesis underexplored. Moreover, because educational practice is inherently iterative, data sharing is continual rather than one-off, making a traditional one-shot synthesis approach suboptimal. To address these challenges, we propose the Cyclic Adaptive Private Synthesis (CAPS) framework and evaluate it on authentic RWD. By iteratively sharing RWD, CAPS not only fosters open science, but also offers rich opportunities of design-based research (DBR), thereby amplifying the impact of LA. Our case study using actual RWD demonstrates that CAPS outperforms a one-shot baseline while highlighting challenges that warrant further investigation. Overall, this work offers a crucial first step towards privacy-preserving sharing of educational RWD and expands the possibilities for open science and DBR in LA.