Synesthetic Dice: Sensors, Actuators, And Mappings

TL;DR

This paper introduces the Loaded Dice, a multisensory IoT tool enabling flexible sensor-actuator mappings for co-design workshops, fostering synesthetic exploration of multisensory interactions.

Contribution

It presents a novel multisensory device with customizable sensor-actuator mappings, supporting research into multisensory and synesthetic IoT interactions.

Findings

Loaded Dice supports flexible sensor-actuator configurations

Enables exploration of multisensory design spaces

Facilitates synesthetic understanding of IoT interactions

Abstract

How bright can you cry? How loud does the sun shine? We developed a multisensory and multimodal tool, the Loaded Dice, for use in co-design workshops to research the design space of IoT usage scenarios. The Loaded Dice incorporate the principle of a technical synesthesia, being able to map any of the included sensors to any of the included actuators. With just a turn of one of the cubical devices it is possible to create a new combination. We discuss the core principles of the Loaded Dice, what sensors and actuators are included, how they relate to human senses, and how we realized a meaningful mapping between sensors and actuators. We further discuss where we see additional potential in the Loaded Dice to support synesthetic exploration - as Synesthetic Dice - so that you can eventually find out who cries brighter.