Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage

Jasper Oosterman; Alessandro Bozzon; Geert Jan Houben; Archana Nottamkandath; Chris Dijkshoorn; Lora Aroyo; Mieke H R Leyssen; Myriam C. Traub

doi:10.1145/2567948.2576960

Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage

Jasper Oosterman, Alessandro Bozzon, Geert Jan Houben, Archana Nottamkandath, Chris Dijkshoorn, Lora Aroyo, Mieke H R Leyssen, Myriam C. Traub

Web Information Systems

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

14 Citations (Scopus)

Abstract

The results of our exploratory study provide new insights to crowdsourcing knowledge intensive tasks. We designed and performed an annotation task on a print collection of the Rijksmuseum Amsterdam, involving experts and crowd workers in the domain-specific description of depicted ow- ers. We created a testbed to collect annotations from ower experts and crowd workers and analyzed these in regard to user agreement. The findings show promising results, demonstrating how, for given categories, nichesourcing can provide useful annotations by connecting crowdsourcing to domain expertise.

Original language	English
Title of host publication	WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web
Place of Publication	New York
Publisher	Association for Computing Machinery (ACM)
Pages	567-568
Number of pages	2
ISBN (Electronic)	9781450327459
DOIs	https://doi.org/10.1145/2567948.2576960
Publication status	Published - 2014
Event	23rd International Conference on World Wide Web, WWW 2014 - Seoul, Korea, Republic of Duration: 7 Apr 2014 → 11 Apr 2014

Conference

Conference	23rd International Conference on World Wide Web, WWW 2014
Country/Territory	Korea, Republic of
City	Seoul
Period	7/04/14 → 11/04/14

Keywords

Crowdsourcing
Cultural heritage
Knowledge intensive tasks
Nichesourcing
Tagging

Access to Document

10.1145/2567948.2576960

Cite this

Oosterman, J., Bozzon, A., Houben, G. J., Nottamkandath, A., Dijkshoorn, C., Aroyo, L., Leyssen, M. H. R., & Traub, M. C. (2014). Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage. In WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web (pp. 567-568). Association for Computing Machinery (ACM). https://doi.org/10.1145/2567948.2576960

@inproceedings{f27db6b7c718471a8d7b34633e7a6651,

title = "Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage",

abstract = "The results of our exploratory study provide new insights to crowdsourcing knowledge intensive tasks. We designed and performed an annotation task on a print collection of the Rijksmuseum Amsterdam, involving experts and crowd workers in the domain-specific description of depicted ow- ers. We created a testbed to collect annotations from ower experts and crowd workers and analyzed these in regard to user agreement. The findings show promising results, demonstrating how, for given categories, nichesourcing can provide useful annotations by connecting crowdsourcing to domain expertise.",

keywords = "Crowdsourcing, Cultural heritage, Knowledge intensive tasks, Nichesourcing, Tagging",

author = "Jasper Oosterman and Alessandro Bozzon and Houben, {Geert Jan} and Archana Nottamkandath and Chris Dijkshoorn and Lora Aroyo and Leyssen, {Mieke H R} and Traub, {Myriam C.}",

year = "2014",

doi = "10.1145/2567948.2576960",

language = "English",

pages = "567--568",

booktitle = "WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web",

publisher = "Association for Computing Machinery (ACM)",

address = "United States",

note = "23rd International Conference on World Wide Web, WWW 2014 ; Conference date: 07-04-2014 Through 11-04-2014",

}

Oosterman, J, Bozzon, A , Houben, GJ, Nottamkandath, A, Dijkshoorn, C, Aroyo, L, Leyssen, MHR & Traub, MC 2014, Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage. in WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web. Association for Computing Machinery (ACM), New York, pp. 567-568, 23rd International Conference on World Wide Web, WWW 2014, Seoul, Korea, Republic of, 7/04/14. https://doi.org/10.1145/2567948.2576960

Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage. / Oosterman, Jasper; Bozzon, Alessandro ; Houben, Geert Jan et al.
WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web. New York: Association for Computing Machinery (ACM), 2014. p. 567-568.

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Crowd vs. Experts

T2 - 23rd International Conference on World Wide Web, WWW 2014

AU - Oosterman, Jasper

AU - Bozzon, Alessandro

AU - Houben, Geert Jan

AU - Nottamkandath, Archana

AU - Dijkshoorn, Chris

AU - Aroyo, Lora

AU - Leyssen, Mieke H R

AU - Traub, Myriam C.

PY - 2014

Y1 - 2014

N2 - The results of our exploratory study provide new insights to crowdsourcing knowledge intensive tasks. We designed and performed an annotation task on a print collection of the Rijksmuseum Amsterdam, involving experts and crowd workers in the domain-specific description of depicted ow- ers. We created a testbed to collect annotations from ower experts and crowd workers and analyzed these in regard to user agreement. The findings show promising results, demonstrating how, for given categories, nichesourcing can provide useful annotations by connecting crowdsourcing to domain expertise.

AB - The results of our exploratory study provide new insights to crowdsourcing knowledge intensive tasks. We designed and performed an annotation task on a print collection of the Rijksmuseum Amsterdam, involving experts and crowd workers in the domain-specific description of depicted ow- ers. We created a testbed to collect annotations from ower experts and crowd workers and analyzed these in regard to user agreement. The findings show promising results, demonstrating how, for given categories, nichesourcing can provide useful annotations by connecting crowdsourcing to domain expertise.

KW - Crowdsourcing

KW - Cultural heritage

KW - Knowledge intensive tasks

KW - Nichesourcing

KW - Tagging

UR - http://www.scopus.com/inward/record.url?scp=84990966410&partnerID=8YFLogxK

U2 - 10.1145/2567948.2576960

DO - 10.1145/2567948.2576960

M3 - Conference contribution

AN - SCOPUS:84990966410

SP - 567

EP - 568

BT - WWW 2014 Companion - Proceedings of the 23rd International Conference on World Wide Web

PB - Association for Computing Machinery (ACM)

CY - New York

Y2 - 7 April 2014 through 11 April 2014

ER -

Crowd vs. Experts: Nichesourcing for knowledge intensive tasks in cultural heritage

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this