Designing Effective LLM-Assisted Interfaces for Curriculum Development

TL;DR

This paper presents two novel user interface designs for educators to interact with large language models more effectively, reducing workload and improving usability in curriculum development.

Contribution

Introduces two new UI designs based on Direct Manipulation principles that enhance usability and decrease workload in LLM-assisted educational content creation.

Findings

UI Predefined outperformed ChatGPT and UI Open in usability

UI Predefined reduced cognitive load significantly

UI Open offered more flexibility but with a steeper learning curve

Abstract

Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and usability issues, which increase workload. Additionally, inaccuracies in LLM outputs can raise issues around output quality and ethical concerns in educational content delivery. Addressing these issues requires careful oversight, best achieved through cooperation between human and AI approaches. This paper introduces two novel User Interface (UI) designs, UI Predefined and UI Open, both grounded in Direct Manipulation (DM) principles to address these challenges. By reducing the reliance on intricate prompt engineering, these UIs improve usability, streamline interaction, and lower workload, providing a more effective pathway for educators to engage with LLMs. In a controlled user study with 20 participants, the proposed UIs were evaluated against the standard ChatGPT interface in terms of usability and cognitive load. Results showed that UI Predefined significantly outperformed both ChatGPT and UI Open, demonstrating superior usability and reduced task load, while UI Open offered more flexibility at the cost of a steeper learning curve. These findings underscore the importance of user-centered design in adopting AI-driven tools and lay the foundation for more intuitive and efficient educator-LLM interactions in online learning environments.