Phoenix: A Novel Context-Aware Voice-Powered Math Equation Workspace and Editor

TL;DR

This paper introduces Phoenix, a voice-powered math workspace that uses neuroscience insights and large language models to create an intuitive, low-cognitive-load environment for solving math problems, especially aiding those with disabilities.

Contribution

It presents a novel, context-aware voice interface for math editing that reduces cognitive effort and enhances accessibility for users with fine motor disabilities.

Findings

Supports natural language interaction for math editing

Reduces cognitive load in mathematical documentation

Enhances accessibility for users with disabilities

Abstract

Writing mathematical notation requires substantial effort, diverting cognitive resources from conceptual understanding to documentation mechanics, significantly impacting individuals with fine motor disabilities (FMDs). Current limits of speech-based math technologies rely on precise dictation of math symbols and unintuitive command-based interfaces. We present a novel voice-powered math workspace, applying neuroscience insights to create an intuitive problem-solving environment. To minimize cognitive load, we leverage large language models with our novel context engine to support natural language interaction. Ultimately, we enable fluid mathematical engagement for individuals with FMDs -- freed from mechanical constraints.