Incentives for Truthful Evaluations
Luca de Alfaro, Marco Faella, Vassilis Polychronopoulos, Michael, Shavlovsky

TL;DR
This paper introduces scalable, cost-effective incentive schemes for crowdsourcing that motivate users to provide truthful evaluations, applicable to both discrete and quantitative tasks, with the incentive strength unaffected by hierarchy depth.
Contribution
It proposes hierarchical incentive schemes ensuring truthful evaluations in crowdsourcing, scalable to large groups, requiring only workers' knowledge of their hierarchy position.
Findings
Schemes are effective for both discrete and quantitative evaluations.
Incentive strength remains robust regardless of hierarchy depth.
Schemes require minimal additional evaluations and no complex overhead.
Abstract
We consider crowdsourcing problems where the users are asked to provide evaluations for items; the user evaluations are then used directly, or aggregated into a consensus value. Lacking an incentive scheme, users have no motive in making effort in completing the evaluations, providing inaccurate answers instead. We propose incentive schemes that are truthful and cheap: truthful as the optimal user behavior consists in providing accurate evaluations, and cheap because the truthfulness is achieved with little overhead cost. We consider both discrete evaluation tasks, where an evaluation can be done either correctly, or incorrectly, with no degrees of approximation in between, and quantitative evaluation tasks, where evaluations are real numbers, and the error is measured as distance from the correct value. For both types of tasks, we propose hierarchical incentive schemes that can be…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMobile Crowdsensing and Crowdsourcing · Auction Theory and Applications · Optimization and Search Problems
