Optimization of Scoring Rules
Jason D. Hartline, Yingkai Li, Liren Shan, Yifan Wu

TL;DR
This paper characterizes optimal scoring rules that incentivize truthful information reporting and acquisition, demonstrating their structure and advantages over standard rules in multi-dimensional settings.
Contribution
It introduces a new class of scoring rules tailored for multi-dimensional problems, showing their near-optimality and superiority over traditional scoring methods.
Findings
Optimal scoring rules simplify to binary bets in single-dimensional cases.
In symmetric multi-dimensional problems, agents choose the most surprising signal to be scored.
Standard scoring rules can be significantly suboptimal compared to the proposed optimal rules.
Abstract
We characterize the optimal reward functions (scoring rules) that incentivize an agent to acquire information and report it truthfully to the principal. The optimal scoring rules let the agent make a simple binary bet in single-dimensional problems, and choose the dimension with the most surprising signal to be scored on in symmetric multi-dimensional problems. This scoring rule format remains approximately optimal for asymmetric distributions. These results demonstrate the importance of linking incentives to obtain high-quality information in multi-dimensional problems. In contrast, standard scoring rules like the quadratic scoring rule, or averages of single-dimensional scoring rules can be far from optimal.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsForecasting Techniques and Applications · Decision-Making and Behavioral Economics · Advanced Statistical Process Monitoring
