Trinity: Synchronizing Verbal, Nonverbal, and Visual Channels to Support Academic Oral Presentation Delivery

TL;DR

Trinity is a mobile-centric system that helps EFL students integrate verbal, nonverbal, and visual elements during academic presentations, improving delivery effectiveness and user experience.

Contribution

It introduces Trinity, a novel hybrid system combining LLM-based script support and mobile visual control for synchronized multi-channel presentation delivery.

Findings

Supports more engaging and effective presentations

Perceived as significantly more helpful than baselines

Does not increase cognitive load

Abstract

Academic Oral Presentation (AOP) allows English-As-Foreign-Language (EFL) students to express ideas, engage in academic discourse, and present research findings. However, while previous efforts focus on training efficiency or speech assistance, EFL students often face the challenge of seamlessly integrating verbal, nonverbal, and visual elements into their presentations to avoid coming across as monotonous and unappealing. Based on a need-finding survey, a design study, and an expert interview, we introduce Trinity, a hybrid mobile-centric delivery support system that provides guidance for multichannel delivery on-the-fly. On the desktop side, Trinity facilitates script refinement and offers customizable delivery support based on large language models (LLMs). Based on the desktop configuration, Trinity App enables a remote mobile visual control, multi-level speech pace modulation, and integrated delivery prompts for synchronized delivery. A controlled between-subject user study suggests that Trinity effectively supports AOP delivery and is perceived as significantly more helpful than baselines, without excessive cognitive load.