Goal-Oriented Next Best Activity Recommendation using Reinforcement Learning

TL;DR

This paper presents a reinforcement learning framework for goal-oriented next activity recommendation that ensures process conformance and goal satisfaction, outperforming existing methods on real-world datasets.

Contribution

It introduces a novel reinforcement learning approach combining deep learning and goal estimation to recommend activities that meet specific process goals.

Findings

Outperforms state-of-the-art methods in goal satisfaction

Ensures process conformance in activity recommendations

Effective on diverse real-world datasets

Abstract

Recommending a sequence of activities for an ongoing case requires that the recommendations conform to the underlying business process and meet the performance goal of either completion time or process outcome. Existing work on next activity prediction can predict the future activity but cannot provide guarantees of the prediction being conformant or meeting the goal. Hence, we propose a goal-oriented next best activity recommendation. Our proposed framework uses a deep learning model to predict the next best activity and an estimated value of a goal given the activity. A reinforcement learning method explores the sequence of activities based on the estimates likely to meet one or more goals. We further address a real-world problem of multiple goals by introducing an additional reward function to balance the outcome of a recommended activity and satisfy the goal. We demonstrate the effectiveness of the proposed method on four real-world datasets with different characteristics. The results show that the recommendations from our proposed approach outperform in goal satisfaction and conformance compared to the existing state-of-the-art next best activity recommendation techniques.