"But you Promised": Methods to Improve Crowd Engagement In Non-Ground Truth Tasks

DSpace/Manakin Repository

"But you Promised": Methods to Improve Crowd Engagement In Non-Ground Truth Tasks

Citable link to this page

 

 
Title: "But you Promised": Methods to Improve Crowd Engagement In Non-Ground Truth Tasks
Author: Elmalech, Avshalom; Grosz, Barbara J.

Note: Order does not necessarily reflect citation order of authors.

Citation: Elmalech, Avshalom and Barbara J. Grosz. 2017. "But you Promised": Methods to Improve Crowd Engagement In Non-Ground Truth Tasks. In Proceedings of the 5th AAAI Conference on Human Computation and Crowdsourcing (HCOMP-17), Québec City, Québec, Canada, 23–26 October, 2017: 21-30.
Full Text & Related Files:
Abstract: Crowdsourcing platforms were initially designed to recruit people to perform tasks that were simple cognitively but difficult for computers. One challenge in these settings is to identify an incentive mechanism for motivating workers to complete tasks and do high-quality work. Previous research has studied the use of financial incentive mechanisms and social comparison as motivators. These mechanisms can only be applied to ground truth tasks, tasks for which there is an objective performance scale. In this paper, we define and compare three innovative methods for improving worker engagement on non-ground truth tasks drawing on a psychological theory of commitment. The three methods are similar in asking participants to promise they will complete a task, but they differ in terms of how the commitment is made. In the first method, participants commit by signing a contract; in the second, by listening to a recording; in the third, by recording a personal commitment. The last two methods significantly improved the task completion rate when compared to two baseline conditions. The methods we propose can be implemented simply, can be used for any task, and do not affect participants' behavior other than by improving their engagement.
Terms of Use: This article is made available under the terms and conditions applicable to Open Access Policy Articles, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#OAP
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:34787806
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)

 
 

Search DASH


Advanced Search
 
 

Submitters