TL;DR
PromptDecipher is a tool that helps educators author AI tutoring chatbots by enabling direct correction of bot responses, automating prompt improvements, and emphasizing testing to improve chatbot quality in educational settings.
Contribution
It introduces a correction-based interaction workflow and automated prompt refinement to support educators in creating effective AI tutors.
Findings
Teachers rarely test bots before deployment.
PromptDecipher enforces QA as a core activity.
Prototype and code are publicly available online.
Abstract
Chatbots have long been explored as tools to support learning, and recent advances in large language models have significantly expanded the availability of platforms for educators to author AI tutoring chatbots. Yet effective authorship demands more than writing a system prompt; it requires educators to act as learning designers, AI interaction designers, and QA engineers. In practice, however, teachers rarely fulfill these roles. Our formative study found that virtually none systematically tested their bots before deploying them to students. To address this gap, we present PromptDecipher, a system that restructures the authoring workflow around a direct correction-based interaction rather than writing abstract system prompts, teachers interact with a live chat preview and edit undesirable bot responses. An automated pipeline then analyzes the correction, proposes a targeted system…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
