Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian

TL;DR

This paper investigates whether large language models provide faithful self-explanations in low-resource languages, specifically Persian, revealing that current methods often produce explanations that do not align well with human reasoning despite good classification performance.

Contribution

The study evaluates the faithfulness of LLM explanations in Persian emotion detection, comparing prompting strategies and highlighting limitations in current explanation methods for low-resource languages.

Findings

LLMs perform well in emotion classification in Persian.

Generated explanations often diverge from human reasoning.

Explanation faithfulness is influenced by prompting strategies.

Abstract

Large language models (LLMs) are increasingly used to generate self-explanations alongside their predictions, a practice that raises concerns about the faithfulness of these explanations, especially in low-resource languages. This study evaluates the faithfulness of LLM-generated explanations in the context of emotion classification in Persian, a low-resource language, by comparing the influential words identified by the model against those identified by human annotators. We assess faithfulness using confidence scores derived from token-level log-probabilities. Two prompting strategies, differing in the order of explanation and prediction (Predict-then-Explain and Explain-then-Predict), are tested for their impact on explanation faithfulness. Our results reveal that while LLMs achieve strong classification performance, their generated explanations often diverge from faithful reasoning, showing greater agreement with each other than with human judgments. These results highlight the limitations of current explanation methods and metrics, emphasizing the need for more robust approaches to ensure LLM reliability in multilingual and low-resource contexts.