Visual Decisions in the Presence of Measurement and Stimulus Correlations

TL;DR

This paper investigates how correlations in sensory noise and stimuli influence perceptual decision-making, revealing that strong distractor correlations amplify the impact of measurement correlations on performance.

Contribution

It provides an analysis of the effects of stimulus and measurement correlations on perceptual decisions, especially in complex tasks with multiple stimuli.

Findings

Strong distractor correlations significantly affect decision performance.

Measurement correlations have minimal impact when distractor correlations are weak.

Neural response correlations to structured stimuli can greatly influence perceptual judgments.

Abstract

Humans and other animals base their decisions on noisy sensory input. Much work has therefore been devoted to understanding the computations that underly such decisions. The problem has been studied in a variety of tasks and with stimuli of differing complexity. However, the impact of correlations in sensory noise on perceptual judgments is not well understood. Here we examine how stimulus correlations together with correlations in sensory noise impact decision making. As an example, we consider the task of detecting the presence of a single or multiple targets amongst distractors. We assume that both the distractors and the observer's measurements of the stimuli are correlated. The computations of an optimal observer in this task are nontrivial, yet can be analyzed and understood intuitively. We find that when distractors are strongly correlated, measurement correlations can have a strong impact on performance. When distractor correlations are weak, measurement correlations have little impact, unless the number of stimuli is large. Correlations in neural responses to structured stimuli can therefore strongly impact perceptual judgments.