Talking to Data Visualizations: Opportunities and Challenges

TL;DR

This paper explores the potential and difficulties of integrating speech interaction into multimodal data visualization tools for collaborative work across various settings.

Contribution

It provides a comprehensive discussion on opportunities, challenges, and future directions for speech-enabled data visualization in collaborative environments.

Findings

Speech interaction offers new collaboration opportunities.

Challenges include technical integration and user experience issues.

Future research directions are identified for multimodal visualization systems.

Abstract

Speech is one of the interaction modalities that we increasingly come across in natural user interfaces. However, its use in collaborative scenarios has not yet been thoroughly investigated. In this reflection statement, we discuss the opportunities and challenges of integrating speech interaction in multimodal solutions for collaborative work with data visualizations. We discuss related findings from other research communities and how we could build upon their work to explore and make use of speech interaction for data visualizations in co-located, hybrid, and remote settings.