Leveraging Large Language Models for Enhanced Process Model Comprehension

TL;DR

This paper proposes a framework using Large Language Models to improve understanding of complex business process models, featuring abstraction methods, prompting strategies, and a conversational tool, evaluated through automatic and user studies.

Contribution

It introduces a novel LLM-based framework and tool for process model comprehension, with specific abstraction and prompting techniques, advancing AI integration in BPM.

Findings

Enhanced interpretability of process models with LLMs

Effective abstraction and prompting strategies identified

User study shows improved user understanding

Abstract

In Business Process Management (BPM), effectively comprehending process models is crucial yet poses significant challenges, particularly as organizations scale and processes become more complex. This paper introduces a novel framework utilizing the advanced capabilities of Large Language Models (LLMs) to enhance the interpretability of complex process models. We present different methods for abstracting business process models into a format accessible to LLMs, and we implement advanced prompting strategies specifically designed to optimize LLM performance within our framework. Additionally, we present a tool, AIPA, that implements our proposed framework and allows for conversational process querying. We evaluate our framework and tool by i) an automatic evaluation comparing different LLMs, model abstractions, and prompting strategies and ii) a user study designed to assess AIPA's effectiveness comprehensively. Results demonstrate our framework's ability to improve the accessibility and interpretability of process models, pioneering new pathways for integrating AI technologies into the BPM field.