Are private schools better than public schools? Appraisal for Ireland by methods for observational studies

TL;DR

This paper evaluates whether private schools in Ireland offer better education than public schools by analyzing PISA data, adjusting for student ability, and applying advanced observational study methods, revealing public schools perform better after adjustment.

Contribution

It introduces a new method for observational studies to compare treatment effects, accounting for selection bias in educational data analysis.

Findings

Raw scores favor private schools before adjustment.

Adjusted analysis shows public schools perform better.

Supports findings with instrumental variables and latent variable methods.

Abstract

In observational studies the assignment of units to treatments is not under control. Consequently, the estimation and comparison of treatment effects based on the empirical distribution of the responses can be biased since the units exposed to the various treatments could differ in important unknown pretreatment characteristics, which are related to the response. An important example studied in this article is the question of whether private schools offer better quality of education than public schools. In order to address this question, we use data collected in the year 2000 by OECD for the Programme for International Student Assessment (PISA). Focusing for illustration on scores in mathematics of 15-year-old pupils in Ireland, we find that the raw average score of pupils in private schools is higher than of pupils in public schools. However, application of a newly proposed method for observational studies suggests that the less able pupils tend to enroll in public schools, such that their lower scores are not necessarily an indication of bad quality of the public schools. Indeed, when comparing the average score in the two types of schools after adjusting for the enrollment effects, we find quite surprisingly that public schools perform better on average. This outcome is supported by the methods of instrumental variables and latent variables, commonly used by econometricians for analyzing and evaluating social programs.