The Open Vault Challenge -- Learning how to build calibration-free interactive systems by cracking the code of a vault

TL;DR

This paper presents a challenge involving a calibration-free interactive system that learns user intent in real-time to open a physical vault, demonstrating scalable multimodal interaction methods.

Contribution

It introduces a novel calibration-free interactive system capable of learning user intent on-the-fly, with a practical demonstration involving a physical vault and multimodal input.

Findings

Successful real-time learning of user intent

Demonstration of scalable multimodal interaction

Open challenge to the community for cracking the code

Abstract

This demo takes the form of a challenge to the IJCAI community. A physical vault, secured by a 4-digit code, will be placed in the demo area. The author will publicly open the vault by entering the code on a touch-based interface, and as many times as requested. The challenge to the IJCAI participants will be to crack the code, open the vault, and collect its content. The interface is based on previous work on calibration-free interactive systems that enables a user to start instructing a machine without the machine knowing how to interpret the user's actions beforehand. The intent and the behavior of the human are simultaneously learned by the machine. An online demo and videos are available for readers to participate in the challenge. An additional interface using vocal commands will be revealed on the demo day, demonstrating the scalability of our approach to continuous input signals.