An intelligent tutor for planning in large partially observable environments

TL;DR

This paper introduces a novel AI-powered intelligent tutor designed to improve human planning skills in large, partially observable environments by combining new metareasoning algorithms and scaffolding techniques, demonstrating significant effectiveness.

Contribution

It presents the first intelligent tutor for planning in partially observable environments, integrating a new metareasoning algorithm and scaffolding to enhance human decision-making.

Findings

The new strategy discovery algorithm outperforms existing methods.

The tutor significantly improves participants' planning abilities.

The approach is effective in complex, real-world-like environments.

Abstract

AI can not only outperform people in many planning tasks, but it can also teach them how to plan better. A recent and promising approach to improving human decision-making is to create intelligent tutors that utilize AI to discover and teach optimal planning strategies automatically. Prior work has shown that this approach can improve planning in artificial, fully observable planning tasks. Unlike these artificial tasks, many of the real-world situations in which people have to make plans include features that are only partially observable. To bridge this gap, we develop and evaluate the first intelligent tutor for planning in partially observable environments. Compared to previous intelligent tutors for teaching planning strategies, this novel intelligent tutor combines two innovations: 1) a new metareasoning algorithm for discovering optimal planning strategies for large, partially observable environments, and 2) scaffolding the learning process by having the learner choose from an increasing larger set of planning operations in increasingly larger planning problems. We found that our new strategy discovery algorithm is superior to the state-of-the-art. A preregistered experiment with 330 participants demonstrated that the new intelligent tutor is highly effective at improving people's ability to make good decisions in partially observable environments. This suggests our intelligent cognitive tutor can successfully boost human planning in complex, partially observable sequential decision problems. That makes the work presented in this a promising step towards using AI-powered intelligent tutors to improve human planning in the real world.