# Psychometric Properties of the Standardised Instruments that are Used to Measure (Pragmatic) Intervention Effects in Autistic Children: A Systematic Review

## TL;DR

This paper reviews standardized tools used to measure the effects of interventions on pragmatic language in autistic children, finding they lack a key psychometric property called responsiveness.

## Contribution

The study is the first to systematically evaluate the psychometric properties of instruments measuring pragmatic intervention effects in autism.

## Key findings

- 49 studies were analyzed, identifying 19 standardized instruments.
- All instruments showed validity and reliability but none reported responsiveness.
- The study emphasizes the need for better description of outcome measures in autism interventions.

## Abstract

Pragmatic language difficulties can negatively influence the learning, socialization, and mental health of children diagnosed with autism spectrum disorder (ASD). Several studies have sought to determine the effects of interventions, including competencies to help these children use language for social purposes. However, are the instruments used to measure the results of the interventions appropriate and psychometrically adequate? This systematic review aims to analyze the psychometric properties of the standardized instruments that are used to measure the effects of interventions addressing (not exclusively, but also) pragmatic language competencies for autistic children.

Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, systematic literature research was carried out in four electronic indexing databases: CENTRAL, PubMed, Web of Science, and Scopus.

A total of 49 studies from 2005 to 2023 were included and 19 standardized instruments were identified.

After analyzing the instruments psychometric properties, the results indicated that all present some evidence of validity and reliability, but none report responsiveness. Implications: Given the impact that an instrument can have on analyzing the effects of an intervention, this study highlights the importance of considering not only the validity and reliability of an instrument but also responsiveness as a psychometric property, and the need to better describe the rationale for the outcome measures and specify what abilities are being targeted and measured. This will accurately guide future research and improve clinical decision-making around ASD.