A method for Selecting Scenes and Emotion-based Descriptions for a Robot's Diary

TL;DR

This paper introduces a novel scene and emotion-based description method for a robot's daily diary, demonstrating that affective captions influence sentiment and preference, with implications for robot expressiveness and user engagement.

Contribution

It proposes a new scene selection and emotion description method that incorporates semantic and affective information for robot diaries.

Findings

Affective captions increase sentiment change and preference.

Emotion presentation generally enhances diary preference.

Negative or mixed emotions may reduce robot-likeness and preference.

Abstract

In this study, we examined scene selection methods and emotion-based descriptions for a robot's daily diary. We proposed a scene selection method and an emotion description method that take into account semantic and affective information, and created several types of diaries. Experiments were conducted to examine the change in sentiment values and preference of each diary, and it was found that the robot's feelings and impressions changed more from date to date when scenes were selected using the affective captions. Furthermore, we found that the robot's emotion generally improves the preference of the robot's diary regardless of the scene it describes. However, presenting negative or mixed emotions at once may decrease the preference of the diary or reduce the robot's robot-likeness, and thus the method of presenting emotions still needs further investigation.