# Interrater reliability of the modified Tinkertoy test: A validation study in schizophrenia and control groups

## TL;DR

This study shows that the modified Tinkertoy test is a reliable tool for assessing cognitive functions in people with schizophrenia and healthy controls.

## Contribution

The study provides empirical validation of the interrater reliability of the modified Tinkertoy test in a Japanese sample.

## Key findings

- The m-TTT showed high interrater reliability for complexity, creation process, and total scores in both schizophrenia and control groups.
- Bland–Altman analysis found no fixed or proportional bias, though variability increased at higher scores in the control group.
- The test is recommended as a robust tool for assessing cognitive deficits in psychiatric contexts.

## Abstract

Divergent thinking and executive function are critical components of cognitive performance, necessitating reliable assessment tools to guide clinical decision‐making and research on cognitive deficits. This study aimed to evaluate the interrater reliability of the modified Tinkertoy test (m‐TTT), a neuropsychological tool designed to assess these functions, particularly in individuals with schizophrenia.

The interrater reliability of the m‐TTT was assessed in a sample of 40 Japanese participants, including 20 individuals with schizophrenia (12 males, eight females; mean age = 42.4 [standard deviation, 12.6] years) and 20 healthy controls (12 males, eight females; mean age = 40.0 [standard deviation, 9.6] years). Performances were independently scored by two occupational therapists using a standardized framework. Relative reliability was evaluated using intraclass correlation coefficients (ICCs), and absolute reliability was examined using Bland–Altman analysis.

In the schizophrenia group, ICC values indicated high interrater reliability for complexity (0.979), creation process (0.881), and total (0.969) scores. Similarly, in the control group, ICC values were high for complexity (0.969), creation process (0.790), and total (0.934) scores. Bland–Altman analysis demonstrated no fixed or proportional bias; however, greater variability was observed at higher creation process scores in the control group.

The results confirm the high interrater reliability of the m‐TTT, supporting its utility as a robust tool for assessing cognitive deficits and guiding rehabilitation strategies in psychiatric contexts. However, the study's generalizability is limited by its Japanese‐only sample, necessitating further validation across diverse populations and cultural settings.

This study evaluated the interrater reliability of the modified Tinkertoy test (m‐TTT) in schizophrenia and control groups. Results demonstrated high reliability and highlighted the tool's potential for assessing cognitive deficits in clinical settings.