Measuring naturalistic speech comprehension in real time
Irmak Ergin, Jill Kries, Shiven Gupta, Maria Papworth Burrel, Laura Gwilliams
TL;DR
This paper introduces a new method to measure how well people understand speech in real time, overcoming the limitations of traditional post-hoc assessments.
Contribution
A novel time-resolved slider method for measuring real-time speech comprehension during naturalistic listening is introduced and validated.
Findings
The time-resolved slider method effectively captures real-time comprehension during naturalistic listening.
Static post hoc assessments have limitations such as recency bias and issues with question design.
The new method can be integrated with neuroimaging techniques for studying dynamic listening processes.
Abstract
Speech comprehension has been described as an effortless and robust process; yet, in real-world contexts, it is common for a listener to misunderstand what was said or fail to derive meaning entirely. Typically, methods of measuring speech comprehension are applied ‘post hoc’ - that is, after the comprehension has happened. This approach fails to capture comprehension as it occurs, limiting the field’s understanding of the cognitive processes involved in real-time comprehension. To overcome these challenges, we designed and tested a novel method of measuring real-time speech comprehension during naturalistic listening. We built a slider device that synchronizes with experimental software and provides millisecond read-out. In three experiments, participants listened to audiobook segments while providing continuous comprehension ratings using the slider. To vary comprehension success, we…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeuroscience and Music Perception · Phonetics and Phonology Research · Neurobiology of Language and Bilingualism