Towards stochastic simulations of relevance profiles

Kevin Roitero, Andrea Brunello, Julián Urbano, Stefano Mizzaro

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

73 Downloads (Pure)

Abstract

Recently proposed methods allow the generation of simulated scores representing the values of an effectiveness metric, but they do not investigate the generation of the actual lists of retrieved documents. In this paper we address this limitation: we present an approach that exploits an evolutionary algorithm and, given a metric score, creates a simulated relevance profile (i.e., a ranked list of relevance values) that produces that score. We show how the simulated relevance profiles are realistic under various analyses.

Original languageEnglish
Title of host publicationCIKM 2019 - Proceedings of the 28th ACM International Conference on Information and Knowledge Management
PublisherAssociation for Computing Machinery (ACM)
Pages2217-2220
Number of pages4
ISBN (Electronic)9781450369763
DOIs
Publication statusPublished - 3 Nov 2019
Event28th ACM International Conference on Information and Knowledge Management, CIKM 2019 - Beijing, China
Duration: 3 Nov 20197 Nov 2019

Conference

Conference28th ACM International Conference on Information and Knowledge Management, CIKM 2019
Country/TerritoryChina
CityBeijing
Period3/11/197/11/19

Keywords

  • Genetic algorithms
  • Stochastic simulations
  • Test collections

Fingerprint

Dive into the research topics of 'Towards stochastic simulations of relevance profiles'. Together they form a unique fingerprint.

Cite this