TY - GEN
T1 - Dockerising terrier for the open-source IR replicability challenge
AU - Câmara, Arthur
AU - MacDonald, Craig
PY - 2019
Y1 - 2019
N2 - Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.
AB - Reproducibility and replicability are key concepts in science, and it is therefore important for information retrieval (IR) platforms to aid in reproducing and replicating experiments. In this paper, we describe the creation of a Docker container for Terrier within the framework of the OSIRRC 2019 challenge, which allows typical runs to be reproduced on TREC Test Collections such as Robust04, GOV2, Core2018. In doing so, it is hoped that the produced Docker image can be of aid to other (re)producing baseline experiments on these test collections. Initiatives like OSIRRC are key in advancing these key concepts in the IR area. By making not only the source code available, but also the exact same environment and standardising inputs and outputs, it is possible to easily compare approaches and thereby improve the quality of the research for Information Retrieval.
UR - http://www.scopus.com/inward/record.url?scp=85070711498&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85070711498
T3 - CEUR Workshop Proceedings
SP - 26
EP - 30
BT - OSIRRC 2019 The Open-Source IR Replicability Challenge
A2 - Clancy, Ryan
A2 - Ferro, Nicola
A2 - Hauff, Claudia
A2 - Lin, Jimmy
A2 - Sakai, Tetsuya
A2 - Wu, Ze Zhong
PB - CEUR-WS
T2 - 2019 Open-Source IR Replicability Challenge, OSIRRC 2019
Y2 - 25 July 2019 through 25 July 2019
ER -