DOI

n essential aspect for building effective crowdsourcing com- putations is the ability of "controlling the crowd", i.e. of dynamically adapting the behaviour of the crowdsourcing systems as response to the quantity and quality of completed tasks or to the availability and reliability of performers. Most crowdsourcing systems only provide limited and predefined controls; in contrast, we present an approach to crowdsourcing which provides fine-level, powerful and flexible controls. We model each crowdsourcing application as composition of elementary task types and we progressively transform these high level specifications into the features of a reactive execution environment that supports task planning, assignment and completion as well as performer monitoring and exclusion. Controls are specified as active rules on top of data structures which are derived from the model of the application; rules can be added, dropped or modified, thus guaranteeing maximal flexibility with limited effort.

We also report on our prototype platform that implements the proposed framework and we show the results of our experimentations with different rule sets, demonstrating how simple changes to the rules can substantially affect time, effort and quality involved in crowdsourcing activities.
Original languageEnglish
Title of host publicationWWW '13 Proceedings of the 22nd international conference on World Wide Web
Place of PublicationNew York
PublisherAssociation for Computing Machinery (ACM)
Pages153-164
Number of pages12
ISBN (Print)978-1-4503-2035-1
DOIs
Publication statusPublished - 2013
Externally publishedYes
EventWWW '13: 22nd international conference on World Wide Web - Rio de Janeiro, Brazil
Duration: 13 May 201317 May 2013
http://www2013.w3c.br/

Conference

ConferenceWWW '13: 22nd international conference on World Wide Web
Abbreviated titleWWW '13
CountryBrazil
CityRio de Janeiro
Period13/05/1317/05/13
Internet address

ID: 15549709