Towards an Informational Pragmatic Realism
Ariel Caticha

TL;DR
This paper presents a unified framework for reasoning under uncertainty by combining entropic inference and Bayesian methods, emphasizing pragmatic elements and defining information in relation to rational agents.
Contribution
It introduces an informational pragmatic realism that unifies entropic and Bayesian inference methods through a pragmatic, epistemic perspective on information and reasoning.
Findings
Entropy is identified as the unique inference tool.
The framework includes MaxEnt and Bayes' rule as special cases.
Pragmatic elements are integral to various philosophical realism theories.
Abstract
I discuss the design of the method of entropic inference as a general framework for reasoning under conditions of uncertainty. The main contribution of this discussion is to emphasize the pragmatic elements in the derivation. More specifically: (1) Probability theory is designed as the uniquely natural tool for representing states of incomplete information. (2) An epistemic notion of information is defined in terms of its relation to the Bayesian beliefs of ideally rational agents. (3) The method of updating from a prior to a posterior probability distribution is designed through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting framework includes as special cases both MaxEnt and Bayes' rule. It therefore unifies entropic and Bayesian methods into a single general inference scheme. I find that similar…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsStatistical Mechanics and Entropy · Philosophy and History of Science · Bayesian Modeling and Causal Inference
