Affective Digital Twins for Digital Human: Bridging the Gap in Human-Machine Affective Interaction

TL;DR

This paper introduces the concept of affective digital twins for digital humans, aiming to enhance emotional realism in human-machine interactions through a new technical framework grounded in digital twin technology.

Contribution

It proposes a novel concept and framework for affective digital twins, integrating affective modeling, perception, encoding, and expression to improve digital human emotional interactions.

Findings

Develops a technical framework for affective digital twins

Identifies key challenges in affective modeling and expression

Explores future applications and potential issues

Abstract

In recent years, metaverse and digital humans have become important research and industry areas of focus. However, existing digital humans still lack realistic affective traits, making emotional interaction with humans difficult. Grounded in the developments of artificial intelligence, human-computer interaction, virtual reality, and affective computing, this paper proposes the concept and technical framework of "Affective Digital Twins for Digital Human" based on the philosophy of digital twin technology. The paper discusses several key technical issues including affective modeling, affective perception, affective encoding, and affective expression. Based on this, the paper conducts a preliminary imagination of the future application prospects of affective digital twins for digital human, while considering potential problems that may need to be addressed.