A Multimodal Dataset of Student Oral Presentations with Sensors and Evaluation Data

TL;DR

This paper introduces SOPHIAS, a comprehensive multimodal dataset of student oral presentations capturing behavioral, physiological, and evaluative data in real classroom settings, enabling advanced analysis and automated feedback development.

Contribution

The paper presents SOPHIAS, the first extensive multimodal dataset of student presentations with synchronized sensors, evaluations, and annotations for research and tool development.

Findings

Dataset includes 50 presentations with multimodal sensor data.

Supports research on behavioral and physiological correlates of performance.

Provides a benchmark for automated feedback and learning analytics.

Abstract

Oral presentation skills are a critical component of higher education, yet comprehensive datasets capturing real-world student performance across multiple modalities remain scarce. To address this gap, we present SOPHIAS (Student Oral Presentation monitoring for Holistic Insights & Analytics using Sensors), a 12-hour multimodal dataset containing recordings of 50 oral presentations (10-15-minute presentation followed by 5-15-minute Q&A) delivered by 65 undergraduate and master's students at the Universidad Autonoma de Madrid. SOPHIAS integrates eight synchronized sensor streams from high-definition webcams, ambient and webcam audio, eye-tracking glasses, smartwatch physiological sensors, and clicker, keyboard, and mouse interactions. In addition, the dataset includes slides and rubric-based evaluations from teachers, peers, and self-assessments, along with timestamped contextual annotations. The dataset captures presentations conducted in real classroom settings, preserving authentic student behaviors, interactions, and physiological responses. SOPHIAS enables the exploration of relationships between multimodal behavioral and physiological signals and presentation performance, supports the study of peer assessment, and provides a benchmark for developing automated feedback and Multimodal Learning Analytics tools. The dataset is publicly available for research through GitHub and Science Data Bank.