MenuCraft: Interactive Menu System Design with Large Language Models

TL;DR

MenuCraft is an AI-assisted interactive tool that leverages large language models to simplify and enhance the design of user interface menus through dialogue-based customization.

Contribution

The paper introduces MenuCraft, a novel system that uses large language models for collaborative, dialogue-driven menu design in user interfaces.

Findings

Enables easy customization of menu options.

Facilitates collaboration between designers and AI.

Simplifies complex menu design processes.

Abstract

Menu system design for user interfaces is a challenging task involving many design options and various human factors. For example, one crucial factor that designers need to consider is the semantic and systematic relation of menu commands. However, capturing these relations can be challenging due to limited available resources. Large language models can be helpful in this regard, using their pre-training knowledge to design and refine menu systems. In this paper, we propose MenuCraft, an AI-assisted designer for menu design that enables collaboration between the designer and a dialogue system to design menus. MenuCraft offers an interactive language-based menu design tool that simplifies the menu design process and enables easy customization of design options. MenuCraft supports a variety of interactions through dialog that allows performing in-context learning.