Offline and online evaluation of news recommender systems at swissinfo


  • Context-tree recommender systems which profile the users in real-time
  • the CTR overestimates the actual impact for popular items and thus gives a skewed impression of the actual performance. Therefore, only comparing the actual article views can accurately picture actual performance.
  • Placing the recommendations at the top of the page more than doubled the CTR than at the bottom


Increase in CTR about 35% for longer user sessions (context tree vs. random)


Florent Garcin, Boi Faltings, Olivier Donatsch, Ayar Alazzawi, Christophe Bruttin, and Amr Huber, “Offline and online evaluation of news recommender systems at,” in Proceedings of the 8th ACM Conference on Recommender systems - RecSys ’14, Foster City, Silicon Valley, California, USA, 2014, pp. 169–176. doi: 10.1145/2645710.2645745.

#recommender-system/news #recommender-system