How Do Crowdworker Communities and Microtask Markets Influence Each Other? A Data-Driven Study on Amazon Mechanical Turk

Jie Yang, Carlo van der Valk, Tobias Hoßfeld, Judith Redi, Alessandro Bozzon

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

Crowdworker online communities -- operating in fora like mTurkForum and TurkerNation -- are an important actor in microwork markets. Albeit central to market dynamics, how the behavior of crowdworker communities and the dynamics of online marketplaces influence each other is yet to be understood. To provide quantitative evidence of such influence, we performed an analysis on 6-years worth of mTurk market activities and community discussions in six fora. We investigated the nature of the relationships that exist between activities in fora, tasks published in mTurk, requesters for such tasks, and task completion speed. We validate -- and expand upon -- results from previous work by showing that (i) there are differences between market demand and community activities that are specific to fora and task types; (ii) the temporal progression of HIT availability in the market is predictive of the upcoming amount of crowdworker discussions, with significant differences across fora and discussion categories; (iii) activities in fora can have a significant positive impact on the completion speed of tasks available in the market.
Original languageEnglish
Title of host publication6th AAAI Conference on Human Computation and Crowdsourcing
Subtitle of host publicationHCOMP 2018
Place of PublicationCambridge, MA
PublisherAmerican Association for Artificial Intelligence (AAAI)
Pages193-202
Number of pages10
Publication statusPublished - 2018
EventHCOMP 2018: 6th AAAI Conference on Human Computation and Crowdsourcing - University of Zurich, Zurich, Switzerland
Duration: 5 Jul 20188 Jul 2018
Conference number: 6

Conference

ConferenceHCOMP 2018
Country/TerritorySwitzerland
CityZurich
Period5/07/188/07/18

Keywords

  • Crowdsourcing
  • Online Community
  • Market Analysis

Fingerprint

Dive into the research topics of 'How Do Crowdworker Communities and Microtask Markets Influence Each Other? A Data-Driven Study on Amazon Mechanical Turk'. Together they form a unique fingerprint.

Cite this