On the information-theoretic structure of distributed measurements
David Balduzzi (MPI for Intelligent Systems)

TL;DR
This paper introduces a geometric framework using the quale to analyze the internal structure of distributed measurements, quantifying information, context-dependence, and decomposability of measurements.
Contribution
It presents a novel geometric approach with the quale to study the internal structure and information-theoretic properties of distributed measurements.
Findings
Indecomposable measurements are more informative than their submeasurements.
The quale quantifies measurement information and context-dependence.
Decomposability is equivalent to context-independence.
Abstract
The internal structure of a measuring device, which depends on what its components are and how they are organized, determines how it categorizes its inputs. This paper presents a geometric approach to studying the internal structure of measurements performed by distributed systems such as probabilistic cellular automata. It constructs the quale, a family of sections of a suitably defined presheaf, whose elements correspond to the measurements performed by all subsystems of a distributed system. Using the quale we quantify (i) the information generated by a measurement; (ii) the extent to which a measurement is context-dependent; and (iii) whether a measurement is decomposable into independent submeasurements, which turns out to be equivalent to context-dependence. Finally, we show that only indecomposable measurements are more informative than the sum of their submeasurements.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
