TurKit: Tools for iterative tasks on mechanical Turk

Mechanical Turk (MTurk) is an increasingly popular web service for paying people small rewards to do human computation tasks. Current uses of MTurk typically post independent parallel tasks. We are exploring an alternative iterative paradigm, in which workers build on or evaluate each other's w...

Full description

Bibliographic Details
Main Authors: Little, Danny Greg (Contributor), Chilton, Lydia B. (Contributor), Goldman, Max (Contributor), Miller, Robert C. (Contributor)
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory (Contributor), Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor)
Format: Article
Language:English
Published: Association for Computing Machinery (ACM), 2012-09-13T14:50:20Z.
Subjects:
Online Access:Get fulltext
Description
Summary:Mechanical Turk (MTurk) is an increasingly popular web service for paying people small rewards to do human computation tasks. Current uses of MTurk typically post independent parallel tasks. We are exploring an alternative iterative paradigm, in which workers build on or evaluate each other's work. We describe TurKit, a new toolkit for deploying iterative tasks to MTurk, with a familiar imperative programming paradigm that effectively uses MTurk workers as subroutines.
National Science Foundation (U.S.). (Grant number IIS-0447800)
Quanta Computer (Firm)
Massachusetts Institute of Technology. Center for Collective Intelligence