Auditory-visual scenes for hearing research
Steven van de Par, Stephan D. Ewert, Lubos Hladek, Christoph Kirsch,, Julia Sch\"utze, Josep Llorca-Bof\'i, Giso Grimm, Maartje M.E. Hendrikse,, Birger Kollmeier, Bernhard U. Seeber

TL;DR
This paper introduces a set of complex, ecologically valid auditory-visual scenes for hearing research, enabling realistic testing and reproducibility in laboratory studies of real-world listening environments.
Contribution
It provides an extendable, standardized dataset of virtual environments with detailed visual and acoustic models for ecologically valid hearing research.
Findings
Provides three virtual environments: underground station, pub, living room.
Enables comparison of acoustic simulation methods with real measurements.
Supports reproducible and comparable research in complex scenes.
Abstract
While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-life situations as well as for developing and evaluating increasingly sophisticated algorithms for hearing assistance. A range of 'classical' stimuli and paradigms have evolved to de-facto standards in psychoacoustics, which are simplistic and can be easily reproduced across laboratories. While they ideally allow for across laboratory comparisons and reproducible research, they, however, lack the acoustic stimulus complexity and the availability of visual information as observed in everyday life…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHearing Loss and Rehabilitation · Noise Effects and Management · Acoustic Wave Phenomena Research
