Abstract
Running in its third year at CLEF, NewsREEL challenged participantsto develop news recommendation algorithms and have them benchmarked inan online (Task 1) and offline setting (Task 2), respectively. This paper providesan overview of the NewsREEL scenario, outlines this year’s campaign, presentsresults of both tasks, and discusses the approaches of participating teams. Moreover,it overviews ideas on living lab evaluation that have been presented as partof a “New Ideas” track at the conference in Portugal. Presented results illustratepotentials for multi-dimensional evaluation of recommendation algorithms ina living lab and simulation based evaluation setting.
| Original language | English |
|---|---|
| Title of host publication | CLEF 2016 Working Notes |
| Subtitle of host publication | Conference and Labs of the Evaluation Forum |
| Editors | Krisztian Balog, Linda Cappellato, Nicola Ferro, Craig Macdonald |
| Publisher | CEUR-WS |
| Pages | 593-605 |
| Number of pages | 13 |
| Publication status | Published - 2016 |
| Event | CLEF 2016 - Conference and Labs of the Evaluation Forum: Information Access Evaluation meets Multilinguality, and Interaction - University of Évora, Évora, Portugal Duration: 5 Sept 2016 → 8 Sept 2016 Conference number: 7th http://clef2016.clef-initiative.eu/ |
Publication series
| Name | CEUR Workshop Proceedings |
|---|---|
| Publisher | CEUR |
| Volume | 1609 |
| ISSN (Electronic) | 1613-0073 |
Conference
| Conference | CLEF 2016 - Conference and Labs of the Evaluation Forum |
|---|---|
| Country/Territory | Portugal |
| City | Évora |
| Period | 5/09/16 → 8/09/16 |
| Internet address |
Keywords
- recommender systems
- news
- multi-dimensional evaluation
- living lab
- stream-based recommender