Implicit Analysis of Perceptual Multimedia Experience Based on Physiological Response: A Review

TL;DR

This review paper discusses how physiological signals, including cerebral and peripheral types, are used to implicitly analyze users' perceptual multimedia experiences, highlighting recent developments, trends, and challenges in the field.

Contribution

It provides a comprehensive overview of physiological signal analysis methods for multimedia experience assessment and discusses current trends and challenges in this emerging area.

Findings

Physiological signals can effectively reflect perceptual multimedia experience.

Wearable sensors have advanced the collection of physiological data.

Current challenges include signal interpretation and real-time analysis.

Abstract

The exponential growth of popularity of multimedia has led to needs for user-centric adaptive applications that manage multimedia content more effectively. Implicit analysis, which examines users' perceptual experience of multimedia by monitoring physiological or behavioral cues, has potential to satisfy such demands. Particularly, physiological signals categorized into cerebral physiological signals (electroencephalography, functional magnetic resonance imaging, and functional near-infrared spectroscopy) and peripheral physiological signals (heart rate, respiration, skin temperature, etc.) have recently received attention along with notable development of wearable physiological sensors. In this paper, we review existing studies on physiological signal analysis exploring perceptual experience of multimedia. Furthermore, we discuss current trends and challenges.