Abstract

Running in its third year at CLEF, NewsREEL challenged participants to develop news recommendation algorithms and have them benchmarked in an online (Task 1) and offline setting (Task 2), respectively. This paper provides an overview of the NewsREEL scenario, outlines this year's campaign, presents results of both tasks, and discusses the approaches of participating teams. Moreover, it overviews ideas on living lab evaluation that have been presented as part of a "New Ideas" track at the conference in Portugal. Presented results illustrate potentials for multi-dimensional evaluation of recommendation algorithms in a living lab and simulation based evaluation setting.

@inproceedings{KilleEtAl-NewsREEL-ExtendedLabOverview2016,
author = {Benjamin Kille and Andreas Lommatzsch and Frank Hopfgartner and Martha Larson and Jonas Seiler and Davide Malagoli and Andras Sereny and Torben Brodt},
title = {{CLEF NewsREEL 2016: Comparing Multi-dimensional Offline and Online Evaluation of News Recommender Systems}},
booktitle = {Working Notes of CLEF 2016},
year = {2016},
isbn = {1613-0073},
volume={1609},
pages = {593-605},
location = {Evora, Portugal},
publisher = {CEUR Workshop Proceedings},
note = {http://ceur-ws.org/Vol-1609/16090593.pdf}
}