Exploiting ChatGPT for Diagnosing Autism-Associated Language Disorders and Identifying Distinct Features

TL;DR

This study demonstrates that ChatGPT significantly improves the accuracy and efficiency of diagnosing autism-related language disorders by outperforming traditional models and identifying key linguistic features.

Contribution

The paper introduces the use of ChatGPT for autism diagnosis, showing its superior performance over conventional models and highlighting key linguistic features for diagnosis.

Findings

ChatGPT outperforms BERT with over 10% improvement in sensitivity.

Identified ten key linguistic features associated with autism.

ChatGPT achieves high accuracy in zero-shot learning configuration.

Abstract

Diagnosing language disorders associated with autism is a complex challenge, often hampered by the subjective nature and variability of traditional assessment methods. Traditional diagnostic methods not only require intensive human effort but also often result in delayed interventions due to their lack of speed and precision. In this study, we explored the application of ChatGPT, a large language model, to overcome these obstacles by enhancing sensitivity and profiling linguistic features for autism diagnosis. This research utilizes ChatGPT natural language processing capabilities to simplify and improve the diagnostic process, focusing on identifying autism related language patterns. Specifically, we compared ChatGPT performance with that of conventional supervised learning models, including BERT, a model acclaimed for its effectiveness in various natural language processing tasks. We showed that ChatGPT substantially outperformed these models, achieving over 10% improvement in both sensitivity and positive predictive value, in a zero shot learning configuration. The findings underscore the model potential as a diagnostic tool, combining accuracy and applicability. We identified ten key features of autism associated language disorders across scenarios. Features such as echolalia, pronoun reversal, and atypical language usage play a critical role in diagnosing ASD and informing tailored treatment plans. Together, our findings advocate for adopting sophisticated AI tools like ChatGPT in clinical settings to assess and diagnose developmental disorders. Our approach promises enhanced diagnostic precision and supports personalized medicine, potentially transforming the evaluation landscape for autism and similar neurological conditions.