ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons

TL;DR

ColorCode is an AAC system with two buttons that employs Bayesian inference and information theory to efficiently and accurately interpret user intent, even with errors, enhancing communication for users with limited muscle control.

Contribution

This paper introduces ColorCode, a novel two-button AAC system utilizing Bayesian inference and error correction, advancing communication technology for severely limited users.

Findings

Efficient information extraction despite errors

Nearly optimal error correction capabilities

Open source implementation available

Abstract

Many people with severely limited muscle control can only communicate through augmentative and alternative communication (AAC) systems with a small number of buttons. In this paper, we present the design for ColorCode, which is an AAC system with two buttons that uses Bayesian inference to determine what the user wishes to communicate. Our information-theoretic analysis of ColorCode simulations shows that it is efficient in extracting information from the user, even in the presence of errors, achieving nearly optimal error correction. ColorCode is provided as open source software (https://github.com/mrdaly/ColorCode).