Reliability of the International Spinal Cord Injury Physical Therapy–Occupational Therapy Basic Data Set

TL;DR

This study evaluates the reliability of a standardized data set for tracking physical and occupational therapy interventions in spinal cord injury patients across multiple centers.

Contribution

The study demonstrates the PT-OT BDS's reliability across diverse clinical settings and therapist backgrounds.

Findings

High agreement was found for five of seven therapy categories.

Therapist pairs showed no significant differences in category selection percentages.

The data set is reliable across different countries and patient impairment levels.

Abstract

In interventional clinical trials for persons with spinal cord injury (SCI), the influence of experimental biological, pharmacological, or device-related interventions must be differentiated from that of physical and occupational therapy interventions, as rehabilitation influences motor-related outcomes. The International Spinal Cord Injury (ISCI) Physical Therapy–Occupational Therapy Basic Data Set (PT-OT BDS) was developed with the intent to track the content and time of rehabilitation interventions that are delivered concurrently with experimental interventions. We assessed the reliability of the PT-OT BDS based on agreement between users. Following an online training session, physical therapists (PTs) and occupational therapists (OTs) from 10 SCI clinical centers across 7 countries participated. At each center, pairs of therapists (a treating therapist and an observing therapist; PT/PT, OT/OT, or PT/OT) used the PT-OT BDS to record the content and time of therapy sessions for 20 patients. Data were analyzed to determine agreement between therapist pairs regarding the content of the therapy session. The influence of therapist characteristics (professional discipline [PT/OT], years of experience working with individuals with SCI), patient characteristics (level [tetraplegia/paraplegia] and severity [complete/incomplete] of injury), setting (inpatient/outpatient), and whether the center was U.S.- versus non-U.S.-based were also analyzed. There was high agreement for five of seven categories and medium agreement for the remaining two categories. For six of the seven intervention categories, there were no significant differences between the treating and the observing therapists in the percentage of instances that a specific category was selected. Characteristics of the therapists, characteristics of the patient, therapy setting, and global location of the center had no meaningful influence on level of agreement between therapist pairs. The BDS is reliable for use across settings, countries, and with patients of various impairment levels. The study also helped identify additional areas where refinement of the syllabus would be of value.