Output Agreement Mechanisms and Common Knowledge
Access StatusFull text of the requested work is not available in DASH at this time ("dark deposit"). For more information on dark deposits, see our FAQ.
MetadataShow full item record
CitationWaggoner, Bo and Yiling Chen. 2014. Output Agreement Mechanisms and Common Knowledge. Proc. of the 2nd AAAI Conference on Human Computation and Crowdsourcing (HCOMP), Pittsburgh, PA, November 2-4, 2014.
AbstractThe recent advent of human computation – employing nonexperts to solve problems – has inspired theoretical work in mechanism design for eliciting information when responses cannot be verified.We study a popular practical method, output agreement, from a theoretical perspective. In output agreement, two agents are given the same inputs and asked to produce some output; they are scored based on how closely their responses agree. Although simple, output agreement raises new conceptual questions. Primary is the fundamental importance of common knowledge: We show that, rather than being truthful, output agreement mechanisms elicit common knowledge from participants.We show that common knowledge is essentially the best that can be hoped for in any mechanism without verification unless there are restrictions on the information structure. This involves generalizing truthfulness to include responding to a query rather than simply reporting a private signal, along with a notion of common-knowledge equilibria. A final important issue raised by output agreement is focal equilibria and player computation of equilibria. We show that, for eliciting the mean of a random variable, a natural player inference process converges to the common-knowledge equilibrium; but this convergence may not occur for other types of queries. Portions of this work were presented at the 2013 Workshop on Social Computing and User-Generated Content, at the 14th ACM Conference on Electronic Commerce.
Citable link to this pagehttp://nrs.harvard.edu/urn-3:HUL.InstRepos:27473205
- FAS Scholarly Articles