Fine-Tuning Large Language Models Using EEG Microstate Features for Mental Workload Assessment

TL;DR

This paper demonstrates how fine-tuning large language models with EEG microstate features can significantly improve the assessment of cognitive load states, advancing cognitive neuroscience and AI applications.

Contribution

It introduces a novel method of integrating EEG microstate features into LLM prompts for enhanced cognitive load prediction accuracy.

Findings

Significant performance improvement in load classification after fine-tuning

Effective integration of EEG microstate features into LLM prompts

Potential applications in cognitive neuroscience and AI

Abstract

This study explores the intersection of electroencephalography (EEG) microstates and Large Language Models (LLMs) to enhance the assessment of cognitive load states. By utilizing EEG microstate features, the research aims to fine-tune LLMs for improved predictions of distinct cognitive states, specifically 'Rest' and 'Load'. The experimental design is delineated in four comprehensive stages: dataset collection and preprocessing, microstate segmentation and EEG backfitting, feature extraction paired with prompt engineering, and meticulous LLM model selection and refinement. Employing a supervised learning paradigm, the LLM is trained to identify cognitive load states based on EEG microstate features integrated into prompts, producing accurate discrimination of cognitive load. A curated dataset, linking EEG features to specified cognitive load conditions, underpins the experimental framework. The results indicate a significant improvement in model performance following the proposed fine-tuning, showcasing the potential of EEG-informed LLMs in cognitive neuroscience and cognitive AI applications. This approach not only contributes to the understanding of brain dynamics but also paves the way for advancements in machine learning techniques applicable to cognitive load and cognitive AI research.