# Leveraging Distance-Based Effectiveness Indicators for Enhanced Behavioral Pattern Discovery in Complex Problem-Solving Assessment

## TL;DR

This paper introduces effectiveness indicators to improve the analysis of behavioral patterns in complex problem-solving tasks using data-driven methods.

## Contribution

The study introduces distance-based effectiveness indicators to enhance n-gram and clustering methods for better interpretability in complex problem-solving.

## Key findings

- Effectiveness indicators improved the sensitivity of n-gram feature selection and clustering performance.
- State effectiveness representations (ds→ds′) yielded the best outcomes in capturing behavioral patterns.
- Using effectiveness indicators enhanced the interpretability of both n-grams and clusters.

## Abstract

Data-driven approaches have emerged as powerful tools for analyzing process data. This study focuses on two data-driven methods: n-gram chi-square feature selection for extracting key action segments and K-medoids clustering combined with Dynamic Time Warping (DTW) distance for identifying behavioral patterns. To address the limitations that arise when applying these methods to complex tasks where ambiguous raw actions often hinder interpretation, this study introduces distance-based effectiveness indicators to enhance both data-driven methods for analyzing actions in the context of complex problem-solving. The research examines how representing action sequences through state effectiveness (ds) and transition effectiveness (Δds→s′) indicators outperforms the use of raw actions alone within the complex collaborative problem-solving Balance Beam task. Results consistently demonstrated that effectiveness indicators significantly improved the sensitivity of n-gram feature selection, the performance of clustering, and the interpretability of both n-grams and resulting clusters. Specifically, state effectiveness representations (ds→ds′) yielded the best outcomes. These findings advocate for the integration of effectiveness indicators into data-driven process analytics to more effectively capture and explain behavioral patterns of problem-solving.