Painted Heart Beats

TL;DR

This paper introduces AURA, a robot-artist framework that uses heartbeat biometrics to adapt its proximity and interaction during collaborative painting, enhancing human-robot artistic synergy.

Contribution

It presents a novel biometrics-informed robot painting system that dynamically adjusts its behavior based on the artist's heartbeat to improve collaboration.

Findings

Robot adjusts proximity based on heartbeat arousal levels.

Heartbeat biometrics effectively inform robot interaction strategies.

Demonstrates natural language and touch interactions in art collaboration.

Abstract

In this work we present AURA, a framework for synergistic human-artist painting. We developed a robot arm that collaboratively paints with a human artist. The robot has an awareness of the artist's heartbeat through the EmotiBit sensor, which provides the arousal levels of the painter. Given the heartbeat detected, the robot decides to increase proximity to the artist's workspace or retract. If a higher heartbeat is detected, which is associated with increased arousal in human artists, the robot will move away from that area of the canvas. If the artist's heart rate is detected as neutral, indicating the human artist's baseline state, the robot will continue its painting actions across the entire canvas. We also demonstrate and propose alternative robot-artist interactions using natural language and physical touch. This work combines the biometrics of a human artist to inform fluent artistic interactions.