SPROUT: an Interactive Authoring Tool for Generating Programming Tutorials with the Visualization of Large Language Models

TL;DR

SPROUT is an interactive authoring tool that leverages the tree-of-thought method with large language models to create transparent, customizable, and high-quality programming tutorials through visualizations and user control.

Contribution

The paper introduces SPROUT, a novel interactive tool that enhances user control and understanding in LLM-generated programming tutorials using a tree-of-thought approach.

Findings

User study shows improved tutorial quality and customization.

SPROUT enables more reliable and transparent tutorial creation.

Users actively participate and better understand the generation process.

Abstract

The rapid development of large language models (LLMs), such as ChatGPT, has revolutionized the efficiency of creating programming tutorials. LLMs can be instructed with text prompts to generate comprehensive text descriptions of code snippets. However, the lack of transparency in the end-to-end generation process has hindered the understanding of model behavior and limited user control over the generated results. To tackle this challenge, we introduce a novel approach that breaks down the programming tutorial creation task into actionable steps. By employing the tree-of-thought method, LLMs engage in an exploratory process to generate diverse and faithful programming tutorials. We then present SPROUT, an authoring tool equipped with a series of interactive visualizations that empower users to have greater control and understanding of the programming tutorial creation process. A formal user study demonstrated the effectiveness of SPROUT, showing that our tool assists users to actively participate in the programming tutorial creation process, leading to more reliable and customizable results. By providing users with greater control and understanding, SPROUT enhances the user experience and improves the overall quality of programming tutorial. A free copy of this paper and all supplemental materials are available at https://osf.io/uez2t/?view_only=5102e958802341daa414707646428f86.