TofuML: A Spatio-Physical Interactive Machine Learning Device for Interactive Exploration of Machine Learning for Novices

TL;DR

TofuML is an innovative physical interface system that enhances engagement and understanding of machine learning for non-experts through intuitive, toy-like interactions, demonstrated by positive user study results.

Contribution

The paper introduces TofuML, a novel physical and spatial interactive system that improves accessibility and engagement in machine learning for novices.

Findings

TofuML increased user engagement compared to GUI systems.

Users showed greater creativity in ML application ideas with TofuML.

The system lowered barriers for non-experts to interact with ML.

Abstract

We introduce TofuML, an interactive system designed to make machine learning (ML) concepts more accessible and engaging for non-expert users. Unlike conventional GUI-based systems, TofuML employs a physical and spatial interface consisting of a small device and a paper mat, allowing users to train and evaluate sound classification models through intuitive, toy-like interactions. Through two user studies -- a comparative study against a GUI-based version and a public event deployment -- we investigated how TofuML impacts users' engagement in the ML model creation process, their ability to provide appropriate training data, and their conception of potential applications. Our results indicated that TofuML enhanced user engagement compared to a GUI while lowering barriers for non-experts to engage with ML. Users demonstrated creativity in conceiving diverse ML applications, revealing opportunities to optimize between conceptual understanding and user engagement. These findings contribute to developing interactive ML systems/frameworks designed for a wide range of users.