Standard

On the impact of group size on collaborative search effectiveness. / Moraes, Felipe; Grashoff, Kilian; Hauff, Claudia.

In: Information Retrieval Journal, Vol. 22, No. 5, 2019, p. 476–498.

Research output: Contribution to journalArticleScientificpeer-review

Harvard

Moraes, F, Grashoff, K & Hauff, C 2019, 'On the impact of group size on collaborative search effectiveness' Information Retrieval Journal, vol. 22, no. 5, pp. 476–498. https://doi.org/10.1007/s10791-018-09350-9

APA

Vancouver

Author

Moraes, Felipe ; Grashoff, Kilian ; Hauff, Claudia. / On the impact of group size on collaborative search effectiveness. In: Information Retrieval Journal. 2019 ; Vol. 22, No. 5. pp. 476–498.

BibTeX

@article{36db069678f04f4ab09e26813fb863b8,
title = "On the impact of group size on collaborative search effectiveness",
abstract = "While today’s web search engines are designed for single-user search, over the years research efforts have shown that complex information needs—which are explorative, open-ended and multi-faceted—can be answered more efficiently and effectively when searching in collaboration. Collaborative search (and sensemaking) research has investigated techniques, algorithms and interface affordances to gain insights and improve the collaborative search process. It is not hard to imagine that the size of the group collaborating on a search task significantly influences the group’s behaviour and search effectiveness. However, a common denominator across almost all existing studies is a fixed group size—usually either pairs, triads or in a few cases four users collaborating. Investigations into larger group sizes and the impact of group size dynamics on users’ behaviour and search metrics have so far rarely been considered—and when, then only in a simulation setup. In this work, we investigate in a large-scale user experiment to what extent those simulation results carry over to the real world. To this end, we extended our collaborative search framework SearchX with algorithmic mediation features and ran a large-scale experiment with more than 300 crowd-workers. We consider the collaboration group size as a dependent variable, and investigate collaborations between groups of up to six people. We find that most prior simulation-based results on the impact of collaboration group size on behaviour and search effectiveness cannot be reproduced in our user experiment.",
keywords = "Collaborative search, Interactive search, Search effectiveness",
author = "Felipe Moraes and Kilian Grashoff and Claudia Hauff",
year = "2019",
doi = "10.1007/s10791-018-09350-9",
language = "English",
volume = "22",
pages = "476–498",
journal = "Information Retrieval",
issn = "1386-4564",
publisher = "Springer",
number = "5",

}

RIS

TY - JOUR

T1 - On the impact of group size on collaborative search effectiveness

AU - Moraes, Felipe

AU - Grashoff, Kilian

AU - Hauff, Claudia

PY - 2019

Y1 - 2019

N2 - While today’s web search engines are designed for single-user search, over the years research efforts have shown that complex information needs—which are explorative, open-ended and multi-faceted—can be answered more efficiently and effectively when searching in collaboration. Collaborative search (and sensemaking) research has investigated techniques, algorithms and interface affordances to gain insights and improve the collaborative search process. It is not hard to imagine that the size of the group collaborating on a search task significantly influences the group’s behaviour and search effectiveness. However, a common denominator across almost all existing studies is a fixed group size—usually either pairs, triads or in a few cases four users collaborating. Investigations into larger group sizes and the impact of group size dynamics on users’ behaviour and search metrics have so far rarely been considered—and when, then only in a simulation setup. In this work, we investigate in a large-scale user experiment to what extent those simulation results carry over to the real world. To this end, we extended our collaborative search framework SearchX with algorithmic mediation features and ran a large-scale experiment with more than 300 crowd-workers. We consider the collaboration group size as a dependent variable, and investigate collaborations between groups of up to six people. We find that most prior simulation-based results on the impact of collaboration group size on behaviour and search effectiveness cannot be reproduced in our user experiment.

AB - While today’s web search engines are designed for single-user search, over the years research efforts have shown that complex information needs—which are explorative, open-ended and multi-faceted—can be answered more efficiently and effectively when searching in collaboration. Collaborative search (and sensemaking) research has investigated techniques, algorithms and interface affordances to gain insights and improve the collaborative search process. It is not hard to imagine that the size of the group collaborating on a search task significantly influences the group’s behaviour and search effectiveness. However, a common denominator across almost all existing studies is a fixed group size—usually either pairs, triads or in a few cases four users collaborating. Investigations into larger group sizes and the impact of group size dynamics on users’ behaviour and search metrics have so far rarely been considered—and when, then only in a simulation setup. In this work, we investigate in a large-scale user experiment to what extent those simulation results carry over to the real world. To this end, we extended our collaborative search framework SearchX with algorithmic mediation features and ran a large-scale experiment with more than 300 crowd-workers. We consider the collaboration group size as a dependent variable, and investigate collaborations between groups of up to six people. We find that most prior simulation-based results on the impact of collaboration group size on behaviour and search effectiveness cannot be reproduced in our user experiment.

KW - Collaborative search

KW - Interactive search

KW - Search effectiveness

UR - http://www.scopus.com/inward/record.url?scp=85059837596&partnerID=8YFLogxK

U2 - 10.1007/s10791-018-09350-9

DO - 10.1007/s10791-018-09350-9

M3 - Article

VL - 22

SP - 476

EP - 498

JO - Information Retrieval

T2 - Information Retrieval

JF - Information Retrieval

SN - 1386-4564

IS - 5

ER -

ID: 51240257