CLEF NewsREEL 2017: Comparing Multi-dimensional Offline and Online Evaluation of News Recommender Systems


The CLEF NewsREEL challenge allows researchers to evaluate news recommendation algorithms both online (NewsREEL Live) and offline (News- REEL Replay). Compared with the previous year NewsREEL challenged participants with a higher volume of messages and new news portals. In the 2017 edition of the CLEF NewsREEL challenge a wide variety of new approaches have been implemented ranging from the use of existing machine learning frameworks, to ensemble methods to the use of deep neural networks. This paper gives an overview over the implemented approaches and discusses the evaluation results. In addition, the main results of Living Lab and the Replay task are explained.

author = {Benjamin Kille and Andreas Lommatzsch and Frank Hopfgartner and Martha Larson and Torben Brodt},
title = {{CLEF NewsREEL 2017}},
booktitle = {Working Notes of CLEF 2017},
year = {2017},
isbn = {1613-0073},
numpages = {13},
location = {Dublin, Ireland},
publisher = {CEUR Workshop Proceedings},
note = {}
Benjamin Kille, Andreas Lommatzsch, Frank Hopfgartner, Martha Larson, Torben Brodt
Conference Paper
Working Notes of CLEF 2017, CEUR Workshop Proceedings Vol. 1866