A taxonomy of surprise definitions
Alireza Modirshanechi, Johanni Brea, Wulfram Gerstner

TL;DR
This paper unifies 18 mathematical definitions of surprise within a comprehensive framework, classifies them into conceptual categories, and lays a foundation for studying their roles in brain function and behavior.
Contribution
It introduces a unifying taxonomy of surprise definitions, categorizing them into four conceptual types based on the measured quantity, and analyzes their relationships and indistinguishability conditions.
Findings
Identified 18 surprise definitions within a unifying framework
Classified surprise into four conceptual categories
Provided conditions under which different definitions are indistinguishable
Abstract
Surprising events trigger measurable brain activity and influence human behavior by affecting learning, memory, and decision-making. Currently there is, however, no consensus on the definition of surprise. Here we identify 18 mathematical definitions of surprise in a unifying framework. We first propose a technical classification of these definitions into three groups based on their dependence on an agent's belief, show how they relate to each other, and prove under what conditions they are indistinguishable. Going beyond this technical analysis, we propose a taxonomy of surprise definitions and classify them into four conceptual categories based on the quantity they measure: (i) 'prediction surprise' measures a mismatch between a prediction and an observation; (ii) 'change-point detection surprise' measures the probability of a change in the environment; (iii) 'confidence-corrected…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMemory and Neural Mechanisms
