CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems

Benjamin Kille; Andreas Lommatzsch; Frank Hopfgartner; Martha Larson; Torben Brodt

CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems

Benjamin Kille, Andreas Lommatzsch, Frank Hopfgartner, Martha Larson, Torben Brodt

Multimedia Computing

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

70 Downloads (Pure)

Abstract

The CLEF NewsREEL challenge allows researchers to evaluate news recommendation algorithms both online (NewsREEL Live) and offline (News-REEL Replay). Compared with the previous year NewsREEL challenged participants with a higher volume of messages and new news portals. In the 2017 edition of the CLEF NewsREEL challenge a wide variety of new approaches have been implemented ranging from the use of existing machine learning frameworks, to ensemble methods to the use of deep neural networks. This paper gives an
overview over the implemented approaches and discusses the evaluation results. In addition, the main results of Living Lab and the Replay task are explaine

Original language	English
Title of host publication	CLEF 2017 Working Notes
Subtitle of host publication	Conference and Labs of the Evaluation Forum
Editors	Linda Cappellato, Nicola Ferro, Lorraine Goeuriot, Thomas Mandl
Publisher	CEUR-WS
Pages	1-13
Number of pages	13
Publication status	Published - 2017
Event	CLEF 2017 - Conference and Labs of the Evaluation Forum: Information Access Evaluation meets Multilinguality, Multimodality, amd Visualization - Dublin, Ireland Duration: 11 Sept 2017 → 14 Sept 2017 Conference number: 8 http://clef2017.clef-initiative.eu/

Publication series

Name	CEUR Workshop Proceedings
Publisher	CEUR
Volume	1866
ISSN (Electronic)	1613-0073

Conference

Conference	CLEF 2017 - Conference and Labs of the Evaluation Forum
Country/Territory	Ireland
City	Dublin
Period	11/09/17 → 14/09/17
Internet address	http://clef2017.clef-initiative.eu/

Keywords

recommender systems
news
multi-dimensional evaluation
living lab
stream-based recommender

Access to Document

35743256Final published version, 777 KB

Cite this

Kille, Benjamin ; Lommatzsch, Andreas ; Hopfgartner, Frank et al. / CLEF NewsREEL 2017 Overview : Offline and Online Evaluation of Stream-based News Recommender Systems. CLEF 2017 Working Notes : Conference and Labs of the Evaluation Forum. editor / Linda Cappellato ; Nicola Ferro ; Lorraine Goeuriot ; Thomas Mandl. CEUR-WS, 2017. pp. 1-13 (CEUR Workshop Proceedings).

@inproceedings{6e51fc271e254bf788d662eed9ebced5,

title = "CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems",

abstract = "The CLEF NewsREEL challenge allows researchers to evaluate news recommendation algorithms both online (NewsREEL Live) and offline (News-REEL Replay). Compared with the previous year NewsREEL challenged participants with a higher volume of messages and new news portals. In the 2017 edition of the CLEF NewsREEL challenge a wide variety of new approaches have been implemented ranging from the use of existing machine learning frameworks, to ensemble methods to the use of deep neural networks. This paper gives anoverview over the implemented approaches and discusses the evaluation results. In addition, the main results of Living Lab and the Replay task are explaine",

keywords = "recommender systems, news, multi-dimensional evaluation, living lab, stream-based recommender",

author = "Benjamin Kille and Andreas Lommatzsch and Frank Hopfgartner and Martha Larson and Torben Brodt",

year = "2017",

language = "English",

series = "CEUR Workshop Proceedings",

publisher = "CEUR-WS",

pages = "1--13",

editor = "Linda Cappellato and Nicola Ferro and Lorraine Goeuriot and Thomas Mandl",

booktitle = "CLEF 2017 Working Notes",

note = "CLEF 2017 - Conference and Labs of the Evaluation Forum : Information Access Evaluation meets Multilinguality, Multimodality, amd Visualization ; Conference date: 11-09-2017 Through 14-09-2017",

url = "http://clef2017.clef-initiative.eu/",

}

Kille, B, Lommatzsch, A, Hopfgartner, F, Larson, M & Brodt, T 2017, CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems. in L Cappellato, N Ferro, L Goeuriot & T Mandl (eds), CLEF 2017 Working Notes : Conference and Labs of the Evaluation Forum. CEUR Workshop Proceedings, vol. 1866, CEUR-WS, pp. 1-13, CLEF 2017 - Conference and Labs of the Evaluation Forum, Dublin, Ireland, 11/09/17.

CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems. / Kille, Benjamin; Lommatzsch, Andreas; Hopfgartner, Frank et al.
CLEF 2017 Working Notes : Conference and Labs of the Evaluation Forum. ed. / Linda Cappellato; Nicola Ferro; Lorraine Goeuriot; Thomas Mandl. CEUR-WS, 2017. p. 1-13 (CEUR Workshop Proceedings; Vol. 1866).

Research output: Chapter in Book/Conference proceedings/Edited volume › Conference contribution › Scientific › peer-review

TY - GEN

T1 - CLEF NewsREEL 2017 Overview

T2 - CLEF 2017 - Conference and Labs of the Evaluation Forum

AU - Kille, Benjamin

AU - Lommatzsch, Andreas

AU - Hopfgartner, Frank

AU - Larson, Martha

AU - Brodt, Torben

N1 - Conference code: 8

PY - 2017

Y1 - 2017

N2 - The CLEF NewsREEL challenge allows researchers to evaluate news recommendation algorithms both online (NewsREEL Live) and offline (News-REEL Replay). Compared with the previous year NewsREEL challenged participants with a higher volume of messages and new news portals. In the 2017 edition of the CLEF NewsREEL challenge a wide variety of new approaches have been implemented ranging from the use of existing machine learning frameworks, to ensemble methods to the use of deep neural networks. This paper gives anoverview over the implemented approaches and discusses the evaluation results. In addition, the main results of Living Lab and the Replay task are explaine

AB - The CLEF NewsREEL challenge allows researchers to evaluate news recommendation algorithms both online (NewsREEL Live) and offline (News-REEL Replay). Compared with the previous year NewsREEL challenged participants with a higher volume of messages and new news portals. In the 2017 edition of the CLEF NewsREEL challenge a wide variety of new approaches have been implemented ranging from the use of existing machine learning frameworks, to ensemble methods to the use of deep neural networks. This paper gives anoverview over the implemented approaches and discusses the evaluation results. In addition, the main results of Living Lab and the Replay task are explaine

KW - recommender systems

KW - news

KW - multi-dimensional evaluation

KW - living lab

KW - stream-based recommender

UR - http://resolver.tudelft.nl/uuid:6e51fc27-1e25-4bf7-88d6-62eed9ebced5

M3 - Conference contribution

T3 - CEUR Workshop Proceedings

SP - 1

EP - 13

BT - CLEF 2017 Working Notes

A2 - Cappellato, Linda

A2 - Ferro, Nicola

A2 - Goeuriot, Lorraine

A2 - Mandl, Thomas

PB - CEUR-WS

Y2 - 11 September 2017 through 14 September 2017

ER -

CLEF NewsREEL 2017 Overview: Offline and Online Evaluation of Stream-based News Recommender Systems

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this