MEEDAV: A Synchronous Web Viewer for EEG, Eye-Tracking and Speech Data

TL;DR

MEEDAV is an open-source, web-based tool for synchronized visualization of EEG, eye-tracking, and speech data, supporting various setups and enabling real-time multimodal data exploration.

Contribution

It introduces a flexible, channel-agnostic system for multimodal data visualization with real-time processing and interactive features tailored for cognitive neuroscience research.

Findings

Supports higher-density EEG setups with channel-agnostic processing

Provides real-time, interactive visualizations including timelines and heatmaps

Demonstrates generalizability beyond the initial dataset structure

Abstract

MEEDAV is an open-source web-based application for the synchronised visualisation of electroencephalography (EEG), eye-tracking, and audio data collected in psycholinguistic research. While originally developed for the Eyetracked Multi-Modal Translation (EMMT) corpus, which uses four-channel EEG data from the Muse 2 headband, MEEDAV also supports higher-density EEG setups thanks to its channel-agnostic processing pipeline. The system performs time alignment across all modalities and provides optional ICA-based EEG denoising. It features interactive Plotly visualisations, including unified EEG-audio-gaze timelines, gaze-intensity plots, event markers, and spatial heatmaps of fixation/saccade patterns. Researchers can filter by participant and stimulus, inspect raw versus cleaned signals, and compute cross-modal correlations. All processing is handled in real time, with a modular backend that supports local file access or GitHub-based streaming. Although initially tailored to the structure of the EMMT dataset, MEEDAV demonstrates a generalisable approach to multimodal data exploration and offers a lightweight, browser-accessible solution for cognitive neuroscience and translation studies.