Abstract

In this work we describe an approach at multi-objective recommender system evaluation based on a previously introduced 3D benchmarking model. The benchmarking model takes user-centric, business-centric and technical constraints into consideration in order to provide a means of comparison of recommender algorithms in similar scenarios. We present a comparison of three recommendation algorithms deployed in a user study using this 3D model and compare to standard evaluation methods. The proposed approach simplifies benchmarking of recommender systems and allows for simple multi-objective comparisons.

@inproceedings{Said:2013:3AR,
author = {Alan Said and Brijnesh J. Jain and Sahin Albayrak},
title = {A 3D Approach to Recommender System Evaluation},
booktitle = {Proceedings of 16th ACM Conference on Computer Supported Cooperative Work and Social Computing},
year = {2013},
publisher = {ACM},
series = {CSCW},
}